Commit Graph

38 Commits

Author SHA1 Message Date
Kristaps Fabians Geikins 0b2ca9a515 feat: add missing FE1 fields to the FE2 GQL schema (#2471)
* WIP version create

* commitCreate migrated

* minor cleanup

* commitReceived migrated

* added Project.object

* Project.comment introduced

* moving away old API usages in FE1

* ProjectMutations.batchDelete

* project pending access requests

* WIP project access req tests

* project access req tests done

* ModelByName test

* version mutation tests

* project.object tests

* batch delete tests

* minor improvements to redirect logging
2024-07-10 11:33:53 +02:00
Dimitrie Stefanescu c4bd9f73df Dim/closures patches (#2428)
* fix(server): advanced query route fix

* fix(server): fixes getObjectsChildrenStream

* fix(server): fixes getObjectChildrenStream in preview service copy pasted code@
2024-06-25 14:31:15 +02:00
Dimitrie Stefanescu 6d08aba068 fix(objects): cleanup 2024-06-19 15:40:06 +01:00
Dimitrie Stefanescu d24e95c046 fix(objects): wip fix on getObjectChildren in post closure world 2024-06-19 15:22:54 +01:00
Dimitrie Stefanescu 1c13fed24e feat(objs): fast fixes 2024-06-17 15:38:45 +01:00
Dimitrie Stefanescu 85f74a4ea4 feat(objs): adds feature flag for no closure writing 2024-06-17 13:30:46 +01:00
Gergő Jedlicska 24b71644a7 fix(objects): use the correct speckle_type value on objects (#2375) 2024-06-16 16:30:50 +02:00
Gergő Jedlicska c79f0c5501 fix(objects): logger templating (#2374) 2024-06-16 13:42:31 +02:00
Kristaps Fabians Geikins ef37030287 fix(server): optimized commit download (#1913)
* fix(server): optimized commit download

* added test
2023-12-13 14:31:09 +02:00
Gergő Jedlicska 42d90b71cd rename string size calculator function to estimate 2023-07-28 17:55:24 +02:00
Gergő Jedlicska b8f0cee93e refactor(server objects): all object inserts use the memory optimized query 2023-07-28 17:43:44 +02:00
Gergő Jedlicska a0bdea5774 chore(server objects): use units in variable names 2023-07-21 10:15:34 +02:00
Gergő Jedlicska b71dce61c0 feat(server objects): add insertion object chunking logic 2023-07-20 12:52:24 +02:00
Iain Sproat 9f0418893f chore(objects upload): improves response when error due to large object size (#1685)
* test(objects upload): adds a test for large object
* print object too large messages in response
* allows object maximum size to be configured
2023-07-12 10:57:59 +01:00
Iain Sproat 4d01e13a84 feat(structured logging) (#1242)
* Revert "Revert structured logging 2 (#1240)"
This reverts commit 78ecaeffcb.
* Logging should not be bundled into core shared directory
* making sure observability stuff isnt bundled into frontend


Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>
2022-12-06 11:51:18 +00:00
Iain Sproat 78ecaeffcb Revert structured logging 2 (#1240)
* Revert "'@' shortcut must come after it is configured in bootstrap (#1239)"

This reverts commit 967329473f.

* Revert "Structured logging (attempt 2) (#1234)"

This reverts commit 444d2ca7dd.
2022-12-05 15:46:09 +00:00
Iain Sproat 444d2ca7dd Structured logging (attempt 2) (#1234)
* Revert "Revert "feat(structured logging): implements structured logging for backend (#1217)" (#1227)"

This reverts commit 63e6581162.

* Use pino-http instead of express pino logger
* Use correct reference to knex and do not instantiate HttpLogger prematurely
* Adds missing dependency for pino to webhook-service
* Do not instantiate middleware when passed to express
* Refactor to move logging into shared
* Copy shared packages into dockerfiles
* Build shared workspace in docker build-stage for fileimport & webhook
2022-12-05 14:49:52 +00:00
Iain Sproat 63e6581162 Revert "feat(structured logging): implements structured logging for backend (#1217)" (#1227)
This reverts commit 84cb74e8b3.
2022-11-25 16:57:28 +00:00
Iain Sproat 84cb74e8b3 feat(structured logging): implements structured logging for backend (#1217)
* each log line is a json object
* structured logging allows logs to be ingested by machines and the logs to be indexed and queried addresses #1105
* structured logging allows arbitrary properties to be appended to each log line, and ingestion of logs to remain robust
* Structured logging provided by `pino` library
* Add `express-pino-logger` dependency
* Remove `debug`, `morgan`, and `morgan-debug` and replace with structured logging
* `console.log` & `console.error` replaced with structured logging in backend
* Remove `DEBUG` environment variable and replace with `LOG_LEVEL`
- Note that there is a test which reads from a logged line on `stdout`. This is not robust, it would be better to use the childProcess.pid to look up the port number.
* Log errors at points we explicitly send error to Sentry
* Amend indentation of a couple of log messages to align indentation with others
2022-11-25 16:05:05 +00:00
Kristaps Fabians Geikins 5f48ae8086 feat(server): optimized command for importing commits from other servers (#1113) 2022-10-17 10:32:01 +03:00
Fabians 4699e6794c reformatting again for 88 width 2022-04-04 19:21:28 +03:00
Fabians 1c7436e7ff extra prefer-const & object-shorthand 2022-04-04 19:00:24 +03:00
Gergő Jedlicska b2d5cd3a01 style(previews): fix eslint for preview service 2022-03-31 17:23:35 +02:00
Gergő Jedlicska d53df11f77 style(server): fix all eslint errors and break the tests 2022-03-31 14:18:44 +02:00
Gergő Jedlicska 569b4688fa style(all): reformat with print width 88 2022-03-29 19:46:49 +02:00
Kristaps Fabians Geikins aeeb88340d feat: favoriting streams #620 (#633) 2022-03-29 16:30:49 +03:00
Dimitrie Stefanescu 0aab4f4833 fix(server): multiple fixes
1/ prevents hanging response on null object save; 2/ ignores globals branch commits (count & stream
commits route)
2021-08-24 20:07:09 +03:00
Cristian Balas bd5bea6915 get object data as text from DB when streaming children (#364) 2021-08-01 22:07:04 +03:00
luz paz ad97cdf444 Fix various typos
Found via `codespell -q 3 -L optio,promisses,usera`
2021-07-22 09:23:21 -04:00
Cristian Balas 3447ee1210 increase db streaming cache to 500 objects (#304) 2021-06-18 16:34:09 +03:00
Dimitrie Stefanescu 94c4c90d60 feat(server): increasing highwatermark in db stream; adding passthrough for bigger (500k) buffers cc @crist8 2021-06-17 13:27:42 +01:00
Cristian Balas eea73470d8 Set upload limits (10mb obj, 50mb batch) (#300) 2021-06-16 12:10:35 +03:00
cristi8 399e219fa9 test 2021-06-07 08:54:28 +03:00
Cristian Balas 3840068cad diff endpoints + added version in ServerInfo (#235) 2021-05-11 20:23:42 +03:00
Cristian Balas adcbe1278a Fixed knex db query in getObjectChildrenQuery (#178) 2021-04-18 21:02:46 +03:00
Cristian Balas dfded037f4 Add streamId field to objects (#155) 2021-03-25 21:58:46 +02:00
cristi8 eeb411c94e fix deadlocks when inserting batches of objects 2021-03-17 18:40:40 +02:00
Dimitrie Stefanescu cd95c28939 refactor(global): restructures repo with lerna 2021-01-03 13:35:53 +02:00