Commit Graph

47 Commits

Author SHA1 Message Date
Iain Sproat 60251e45cb Revert "fix(server): revert 55cad9662a (#2633)" (#2650)
This reverts commit f2c5677b4a.
2024-08-13 11:48:20 +01:00
Iain Sproat f2c5677b4a fix(server): revert 55cad9662a (#2633)
* Revert "refactor(server/upload): convert js to ts (#2618)"

This reverts commit e9f7286f67.

* Revert "feat(logging): pass request logger to core/services/objects (#2599)"

This reverts commit ee3e9af78d.

* Revert "feat(server): configurable maximum objects POST size and improved logging (#2594)"

This reverts commit 55cad9662a.
2024-08-12 10:26:53 +01:00
Iain Sproat ee3e9af78d feat(logging): pass request logger to core/services/objects (#2599)
* chore(logging): include additional detail on object upload logs

* allow max file size to be configurable

* feat(logging): add logger to core/services/objects

* fix log line

* fix tests

* typo

* fix variable name

* convert values to megabytes

* calculating memory was causing the system to freeze

* calculating memory was causing the system to freeze

* DRY the logging metadata

* all required variables should be passed to calculateLogMetadata

* fix many things with the logging
2024-08-09 10:15:37 +02:00
Kristaps Fabians Geikins 83d8035dc2 chore: upgrade to eslint 9 (#2348)
* root + server

* frontend

* frontend-2

* dui3

* dui3

* tailwind theme

* ui-components

* preview service

* viewer

* viewer-sandbox

* fileimport-service

* webhook service

* objectloader

* shared

* ui-components-nuxt

* WIP full config

* WIP full linter

* eslint projectwide util

* minor fix

* removing redundant ci

* clean up test errors

* fixed prettier formatting

* CI improvements

* TSC lint fix

* 'buildBatch' needs to be async since some batch types (like Text) require it. Removed a disabled liniting rule from ObjLoader

* removed unnecessary void

---------

Co-authored-by: AlexandruPopovici <alexandrupopoviciioan@gmail.com>
2024-06-12 14:38:02 +03:00
Kristaps Fabians Geikins 2f8272b6ae feat(shared): modularized package & node16 support (#2336)
* feat(shared): modularized package & node16 support

* lockfile update

* various fixes

* moar fixes

* added znv and zod as devdeps of shared

* lockfile update
2024-06-11 14:12:13 +03:00
Iain Sproat a92ee0f5b6 fix(fileimport-service): max object size should match objects service (#2004) 2024-02-01 13:52:53 +00:00
Iain Sproat ceeb30ec67 fix(fileimport-service): write valid messages from underlying parsers (#1969) 2024-01-16 21:02:25 +00:00
Iain Sproat 7bad5abed6 Revert "MAX_OBJECT_SIZE_MB should be configurable in the fileimport service (#1837)" (#1838)
This reverts commit 4973622c18.
2023-10-26 16:24:18 +01:00
Iain Sproat 4973622c18 MAX_OBJECT_SIZE_MB should be configurable in the fileimport service (#1837)
* fix(helm chart): fileimport service maximum object size should match server
- allow maximum object size to be configurable and to match the server value

* Explicitly provide the environment variable to docker-compose
- this indicates to operators of clusters that this environment variable exists and can be configured
2023-10-26 15:53:55 +01:00
Gergő Jedlicska 11bcb8d4a2 gergo/ifcParsingMaterialIdFix (#1807)
* feat: add source app name const

* chore: cleanup

* fix(ifc parser): calculate material ids

* fix: broken package ref
2023-10-03 08:11:54 +02:00
Gergő Jedlicska e2c2719232 fix ifc argb material calculation (#1788) 2023-09-08 14:06:24 +02:00
Gergő Jedlicska ad0228c434 fix(monorepo): make sure to use 127.0.0.1 instead of localhost 2023-08-03 10:28:57 +02:00
Gergő Jedlicska b8f0cee93e refactor(server objects): all object inserts use the memory optimized query 2023-07-28 17:43:44 +02:00
Iain Sproat fd04a1d055 fix(fileimport): destructuring for...of should use entries() (#1704) 2023-07-13 21:18:51 +01:00
Iain Sproat b9b9f7dee9 fix(fileimport): return timeout error message to server & suppress noisy logging (#1703)
* fix(fileimport): reduce noisiness of logging
* fix(fileimport): return timeout error message to server
2023-07-13 20:52:04 +01:00
Iain Sproat 87a7397061 chore(fileimport): improve logging (#1697) 2023-07-13 19:11:29 +01:00
Gergő Jedlicska e06cea6b06 fix(ifc parser): replace empty children arrays with elements (#1333) 2023-01-20 20:57:03 +01:00
Gergő Jedlicska 62411f504d gergo/ifcParserRootObjectFIx (#1330)
* fix(ifc parser): make sure the commit root object is a Speckle Base

* feat(ifc parser): rename ifc node children prop key to elements to match with connectors
2023-01-19 17:16:39 +01:00
Gergő Jedlicska bd9bc81e71 fix(ifc parser): make sure the commit root object is a Speckle Base (#1329) 2023-01-19 17:01:34 +01:00
Iain Sproat 4d01e13a84 feat(structured logging) (#1242)
* Revert "Revert structured logging 2 (#1240)"
This reverts commit 78ecaeffcb.
* Logging should not be bundled into core shared directory
* making sure observability stuff isnt bundled into frontend


Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>
2022-12-06 11:51:18 +00:00
Iain Sproat 78ecaeffcb Revert structured logging 2 (#1240)
* Revert "'@' shortcut must come after it is configured in bootstrap (#1239)"

This reverts commit 967329473f.

* Revert "Structured logging (attempt 2) (#1234)"

This reverts commit 444d2ca7dd.
2022-12-05 15:46:09 +00:00
Iain Sproat 444d2ca7dd Structured logging (attempt 2) (#1234)
* Revert "Revert "feat(structured logging): implements structured logging for backend (#1217)" (#1227)"

This reverts commit 63e6581162.

* Use pino-http instead of express pino logger
* Use correct reference to knex and do not instantiate HttpLogger prematurely
* Adds missing dependency for pino to webhook-service
* Do not instantiate middleware when passed to express
* Refactor to move logging into shared
* Copy shared packages into dockerfiles
* Build shared workspace in docker build-stage for fileimport & webhook
2022-12-05 14:49:52 +00:00
Gergő Jedlicska bc83391c21 fix(fileimports): fix IFC file imports commit message (#1230) 2022-11-29 18:33:54 +01:00
Dimitrie Stefanescu 69c1993f09 feat(ifc): prevents stack overflowing from too many args to array.push 2022-11-27 15:39:58 +00:00
Dimitrie Stefanescu 950077dcab Revert "feat(ifc): removes stale comment"
This reverts commit 83d2b2bf25.
2022-11-25 09:05:44 +00:00
Dimitrie Stefanescu 48085bffb4 feat(ifc): some tweaks 2022-11-24 20:10:23 +00:00
Dimitrie Stefanescu 83d2b2bf25 feat(ifc): removes stale comment 2022-11-23 22:25:18 +00:00
Dimitrie Stefanescu 4ca0e19abb feat(ifc): fixes error capture on commit creation 2022-11-23 22:24:15 +00:00
Dimitrie Stefanescu ca9d8d8515 feat(IFC): making gitguardian happy, removed my localhost access token 2022-11-23 21:57:20 +00:00
Dimitrie Stefanescu 44f2af2a2e feat(IFC): reverts path to temp output 2022-11-23 21:50:54 +00:00
Dimitrie Stefanescu 2b0e4a7dd5 feat(IFC): adds file id and parsing time to root commit object 2022-11-23 21:26:26 +00:00
Dimitrie Stefanescu 16c989e43c feat(IFC): WIP IFC parser cleanup 2022-11-23 21:00:51 +00:00
Dimitrie Stefanescu 9ac75eecd8 feat(IFC): WIP IFC parser improvements 2022-11-23 19:53:21 +00:00
Dimitrie Stefanescu 093089a2c4 feat(IFC): WIP IFC parser improvements 2022-11-23 18:55:06 +00:00
Gergő Jedlicska ed458fb619 Add blob storage backend (#802)
* feat(server): add server authz pipeline rework first sketch

* feat(server authz): add new server authz middleware poc implementation

* test(server authz): add unittests for the new server authz workflow

* feat(wip rework of fileuploads vs blob storage): add basim impl of separate blob storage service

* feat(fileimport service): refactored file import service to utilize the new asssetstorage service

* refactor(server errors): refactor server errors to use the shared module definitions

Now all the errors inherit from BaseError

* refactor(fileimport service): cleanup after refactor

* feat(frontend fileimports): use the new blob storage for downloading the original file

* refactor(server fileimports): clean up the remnants of S3 storage from file imports

* refactor(server authz): centralize generic authz pipeline configs

* refactor(server blob storage): refactor / rename everything to use the `blob-storage` name

* ci(circleci): add s3 objectstorage environment variables

* ci(circleci): fix missing env variables

* ci(circleci): add minio test container

* ci(circleci): fix minio app startup

* ci(circleci): enable circleci remote docker

* ci(circleci): fix minio startup

* ci(cirleci): detach and wait properly for minio to start

* ci(circleci): revert to additional minio img config, it only fails when the container is stopped ?!

* ci(circleci): disable file uploads

* fix(fileimports): update with blob storage refactor leftovers

* feat(server blob storage): add blob storage graphql api

* refactor(server errors): merge new errors to shared module

* fix(server comments rte): fix import for RTE error

* chore(fileimports): remove node-fetch from dependency

* chore(server): remove body parser dependency

* fix(server blob storage): fix gql api

* fix(frontend): fix fileupload item not loading the new upload status, cause of premature event fire

* feat(server blob storage): fix file size limit and allow for public streams

* Update packages/server/modules/blobstorage/graph/schemas/blobstorage.graphql

Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>

* chore(blobstorage): fix PR review issues

* fix(server): fix import bugs

Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>
2022-06-16 11:31:03 +02:00
luz paz 915cb0afaf Fix various typos
Found via `codespell -q 3 -S CHANGELOG.md -L doesnt,optio,promisses,tread,usera`
2022-04-15 13:49:46 -04:00
Gergő Jedlicska 89d0d9e0ed style: fix eslint warnings 2022-04-04 22:32:34 +02:00
Fabians 1c7436e7ff extra prefer-const & object-shorthand 2022-04-04 19:00:24 +03:00
Gergő Jedlicska 08af792aec style(fileimport-service): fix eslint errors 2022-03-30 10:09:49 +02:00
Gergő Jedlicska 569b4688fa style(all): reformat with print width 88 2022-03-29 19:46:49 +02:00
Fabians aa5e94d640 chore: reformatting everything with prettier 2022-03-29 17:12:31 +03:00
Kristaps Fabians Geikins 8010bf3c4c feat: Standardized & cleaned up formatting & linting across repo #617 (#618)
* feat: Standardized & cleaned up formatting & linting across repo

Co-authored-by: Kristaps Fabians Geikins <fabians@speckle.systems>
Co-authored-by: Gergő Jedlicska <gergo@jedlicska.com>
2022-03-16 10:10:30 +02:00
Alan Rynne 8421456ccd feat(ifc): Pset extraction + refactoring of repeated code 2022-02-15 11:09:01 +01:00
Alan Rynne ccbbe8e6d0 feat(ifc): Modify traverse to save spatial children as properties 2022-02-10 13:03:22 +01:00
Alan Rynne e45844c2ef fix(ifc): Resolve promises in values and arrays 2022-02-09 19:42:55 +01:00
Dimitrie Stefanescu b29b9302e1 feat(ifc): frontend implementation + backend fixes/fiddles
it's still a dirty WIP
2021-10-06 12:25:18 +01:00
cristi8 f437ec158c fileimport-service 2021-10-05 14:41:19 +03:00