Commit Graph

147 Commits

Author SHA1 Message Date
Iain Sproat d36e2036aa fix(server): database connection pool timeouts reduced (#2646)
* fix(server): database connection pool timeouts reduced
- previous acquisition timeout was 60s; this is reduced to 16s for faster responsiveness
- this allows for 3x attempts of 5s each to create a connection, plus idle time between attempts

* Apply to other knex instances
2024-08-26 09:47:27 +01:00
Iain Sproat 60251e45cb Revert "fix(server): revert 55cad9662a (#2633)" (#2650)
This reverts commit f2c5677b4a.
2024-08-13 11:48:20 +01:00
Iain Sproat f2c5677b4a fix(server): revert 55cad9662a (#2633)
* Revert "refactor(server/upload): convert js to ts (#2618)"

This reverts commit e9f7286f67.

* Revert "feat(logging): pass request logger to core/services/objects (#2599)"

This reverts commit ee3e9af78d.

* Revert "feat(server): configurable maximum objects POST size and improved logging (#2594)"

This reverts commit 55cad9662a.
2024-08-12 10:26:53 +01:00
Iain Sproat ee3e9af78d feat(logging): pass request logger to core/services/objects (#2599)
* chore(logging): include additional detail on object upload logs

* allow max file size to be configurable

* feat(logging): add logger to core/services/objects

* fix log line

* fix tests

* typo

* fix variable name

* convert values to megabytes

* calculating memory was causing the system to freeze

* calculating memory was causing the system to freeze

* DRY the logging metadata

* all required variables should be passed to calculateLogMetadata

* fix many things with the logging
2024-08-09 10:15:37 +02:00
Iain Sproat e55a94028d fix(metrics): include num pending validations in knex metrics (#2444) 2024-06-27 14:05:02 +01:00
Iain Sproat d851cecc02 feat(metrics): calculate remaining capacity in pg connection pool (#2443)
* feat(metrics): calculate remaining capacity in pg connection pool

* Apply metric to all relevant services
2024-06-26 21:23:56 +01:00
Kristaps Fabians Geikins c7fdc6acc2 chore: updating ws everywhere to resolve SNYK-JS-WS-7266574 (#2385)
* chore: updating ws in various ways

* puppeteer upgrade

* updating codegen deps

* workspaces cmd update

* various extra fixes

* minor preview-service troubleshooting improvements

* dockerfile fixes

* hopefully fixing docker build fe2

* try again

* try large again
2024-06-18 13:26:01 +03:00
github-actions[bot] a79680da00 Update image digests (#2203)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-06-18 10:18:46 +01:00
Kristaps Fabians Geikins 83d8035dc2 chore: upgrade to eslint 9 (#2348)
* root + server

* frontend

* frontend-2

* dui3

* dui3

* tailwind theme

* ui-components

* preview service

* viewer

* viewer-sandbox

* fileimport-service

* webhook service

* objectloader

* shared

* ui-components-nuxt

* WIP full config

* WIP full linter

* eslint projectwide util

* minor fix

* removing redundant ci

* clean up test errors

* fixed prettier formatting

* CI improvements

* TSC lint fix

* 'buildBatch' needs to be async since some batch types (like Text) require it. Removed a disabled liniting rule from ObjLoader

* removed unnecessary void

---------

Co-authored-by: AlexandruPopovici <alexandrupopoviciioan@gmail.com>
2024-06-12 14:38:02 +03:00
Kristaps Fabians Geikins 2f8272b6ae feat(shared): modularized package & node16 support (#2336)
* feat(shared): modularized package & node16 support

* lockfile update

* various fixes

* moar fixes

* added znv and zod as devdeps of shared

* lockfile update
2024-06-11 14:12:13 +03:00
dependabot[bot] bf14146f64 chore(deps): bump undici from 5.28.3 to 5.28.4 (#2194)
Bumps [undici](https://github.com/nodejs/undici) from 5.28.3 to 5.28.4.
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v5.28.3...v5.28.4)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-23 11:24:53 +01:00
github-actions[bot] 11b62f3824 Update image digests (#2189)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-04-09 10:05:32 +01:00
github-actions[bot] 4947573584 Update image digests (#2172)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-03-28 08:57:01 +00:00
github-actions[bot] bbe48effd0 Update image digests (#2139)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-03-15 16:42:10 +00:00
github-actions[bot] f9ac9e98a3 Update image digests (#2075)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-02-25 16:03:08 +00:00
github-actions[bot] 4418932832 Update image digests (#2040)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-02-23 12:42:29 +00:00
dependabot[bot] 1be2fde52e chore(deps): bump undici from 5.26.3 to 5.28.3 (#2050)
Bumps [undici](https://github.com/nodejs/undici) from 5.26.3 to 5.28.3.
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v5.26.3...v5.28.3)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-16 18:35:58 +00:00
github-actions[bot] 8185683b4a Update image digests (#1966)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-02-09 01:13:48 +00:00
Iain Sproat a92ee0f5b6 fix(fileimport-service): max object size should match objects service (#2004) 2024-02-01 13:52:53 +00:00
Iain Sproat ceeb30ec67 fix(fileimport-service): write valid messages from underlying parsers (#1969) 2024-01-16 21:02:25 +00:00
github-actions[bot] 36f749b24a chore(deps): bump image digests (#1939)
* fix(github action): use correct format for author & committer git signing

* Update image digests

Signed-off-by: specklebot <devops@speckle.systems>

---------

Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
Co-authored-by: specklebot <devops@speckle.systems>
2024-01-05 15:57:25 +00:00
Iain Sproat b396029cf6 chore(Dockerfile): bump images to debian bookworm, pin images by digest, and github action to auto-bump (#1937)
* chore(Dockerfile): pin images by digest this ensures consistent builds with images pinned by SHA
* introduces a GitHub Action will create a PR to update the images when there is a new version, and will pin to that newer version SHA.

* Bump debian to 12 'bookworm'
* Bump pypi libraries
  * except frontend-1, as only debian 11 is currently supported by openresty
* Bump debian packages
2024-01-05 11:51:04 +00:00
Iain Sproat 3db83e50be chore(deps): bump node from 18.18.2 to 18.19.0 (#1921)
* chore(deps): bump node from 18.18.2 to 18.19.0

* Additional dependencies
2023-12-15 11:30:07 +01:00
Kristaps Fabians Geikins f5b757de79 fix(fe1): emitting 'converting' file upload status through subscriptions 2023-12-04 16:35:45 +02:00
Iain Sproat 438c6bbf0d chore(deps): bump node from 18.17.1 to 18.18.2 (#1844) 2023-10-31 18:08:25 +00:00
Iain Sproat 7bad5abed6 Revert "MAX_OBJECT_SIZE_MB should be configurable in the fileimport service (#1837)" (#1838)
This reverts commit 4973622c18.
2023-10-26 16:24:18 +01:00
Iain Sproat 4973622c18 MAX_OBJECT_SIZE_MB should be configurable in the fileimport service (#1837)
* fix(helm chart): fileimport service maximum object size should match server
- allow maximum object size to be configurable and to match the server value

* Explicitly provide the environment variable to docker-compose
- this indicates to operators of clusters that this environment variable exists and can be configured
2023-10-26 15:53:55 +01:00
dependabot[bot] ef3fb7b00f chore(deps): bump undici from 5.22.1 to 5.26.2 (#1820)
Bumps [undici](https://github.com/nodejs/undici) from 5.22.1 to 5.26.2.
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v5.22.1...v5.26.2)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-18 16:04:55 +01:00
Gergő Jedlicska 11bcb8d4a2 gergo/ifcParsingMaterialIdFix (#1807)
* feat: add source app name const

* chore: cleanup

* fix(ifc parser): calculate material ids

* fix: broken package ref
2023-10-03 08:11:54 +02:00
Gergő Jedlicska e2c2719232 fix ifc argb material calculation (#1788) 2023-09-08 14:06:24 +02:00
Iain Sproat 080e8197f9 chore(deps): bump node from 18.17.0 to 18.17.1 (#1771) 2023-08-24 10:55:43 +01:00
Gergő Jedlicska ad0228c434 fix(monorepo): make sure to use 127.0.0.1 instead of localhost 2023-08-03 10:28:57 +02:00
Gergő Jedlicska ad1fba7fea Merge branch 'main' of github.com:specklesystems/speckle-server into gergo/serverGuest/main 2023-08-01 16:01:24 +02:00
Gergő Jedlicska b06959b092 Merge pull request #1713 from specklesystems/gergo/objectInsertionChunking
feat(server objects): add insertion object chunking logic
2023-08-01 15:19:09 +02:00
Gergő Jedlicska b8f0cee93e refactor(server objects): all object inserts use the memory optimized query 2023-07-28 17:43:44 +02:00
Iain Sproat ea941b3b81 chore(deps): bump node to 18.17.0 (#1722) 2023-07-26 12:38:50 +01:00
Gergő Jedlicska 878f97baa2 refactor(server scopes): use constants for streams write scopes 2023-07-26 13:13:09 +02:00
Gergő Jedlicska bb5778bf2d refactor(server scopes): use constants for streams read scopes 2023-07-26 13:09:34 +02:00
Iain Sproat fd04a1d055 fix(fileimport): destructuring for...of should use entries() (#1704) 2023-07-13 21:18:51 +01:00
Iain Sproat b9b9f7dee9 fix(fileimport): return timeout error message to server & suppress noisy logging (#1703)
* fix(fileimport): reduce noisiness of logging
* fix(fileimport): return timeout error message to server
2023-07-13 20:52:04 +01:00
Iain Sproat 9c3d595141 fix(fileimport): logging of child process should not be suppressed as debug (#1702)
- log as info, not debug level
2023-07-13 19:55:44 +01:00
Iain Sproat 87a7397061 chore(fileimport): improve logging (#1697) 2023-07-13 19:11:29 +01:00
Kristaps Fabians Geikins 3999372b68 fix: pino dep missing 2023-07-12 11:55:48 +03:00
Iain Sproat ffc3c5186f chore(node): bump to 18.16.1 (#1675) 2023-07-07 16:54:18 +01:00
Kristaps Fabians Geikins 42a49fb635 chore: ensuring react ttypes are always stubbed (#1570) 2023-05-08 14:07:56 +03:00
Kristaps Fabians Geikins b02a07e2b6 feat: Frontend 2.0 MVP 2023-05-08 10:47:01 +03:00
Iain Sproat 4eab7d9dcd chore(deps): bump node to 18.16.0 (#1564) 2023-05-05 12:43:39 +01:00
Snyk bot ead926dea6 [Snyk] Security upgrade numpy from 1.21.3 to 1.22.2 (#1512)
* fix: packages/fileimport-service/requirements.txt to reduce vulnerabilities


The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-NUMPY-2321964
- https://snyk.io/vuln/SNYK-PYTHON-NUMPY-2321966
- https://snyk.io/vuln/SNYK-PYTHON-NUMPY-2321970

* chore(deps): file-import python requirements should include required peers

* Improve comment on requirement

---------

Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
2023-04-10 15:25:26 +01:00
Iain Sproat f4ce7a2a5d chore(deps): remove unused aws-sdk (#1510)
* Remove aws-sdk as it does not appear to be used
2023-04-10 11:00:44 +01:00
Iain Sproat 87e8d08e64 chore(deps): bump node to 18.15.0 (#1446) 2023-03-10 11:01:30 +00:00