270 Commits

Author SHA1 Message Date
Alexandru Popovici d96d1c5446 Fix build packages (#5738)
* bump gnupg version to match minimum supported by debian

* bumped version

---------

Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
2026-01-15 12:41:35 +00:00
Daniel Gak Anagrov 2cda36203f fix: bump package version (#5395)
* fix: bump package version

* fix: bump cert versions

* fix: error

* fix: undo

* fix: gnupg and tini version bump
2025-09-08 14:58:10 +02:00
Daniel Gak Anagrov 0137fbd0b5 chore: bumb blacksmith build and push action version (#5309)
* chore: bumb blacksmith

* feat: try bump up all machines

* fix: docker builder

* fix: unpin version, fix dockerfiles

* fix: unpin version, fix dockerfiles

* fix: py version
2025-08-26 15:35:14 +02:00
Kristaps Fabians Geikins 9688ef68ea fix(fe2): more fixes and performance improvements (#5281)
* fix(fe2): further preview image cleanup/optimization

* server log streaming

* more hydration mismatch fixes

* lint fix
2025-08-21 09:57:47 +03:00
Kristaps Fabians Geikins a6287fc06d feat(fe2 & server): saved views foundation (list & view) + bits n bobs (#5163)
* init db migration

* WIP store view

* create service call

* WIP insertion

* insert sort of works

* moving code arounmd

* creation tests

* avoid duplicate entries

* fixes from main

* basic group retrieval works

* group filtering works

* WIP view listing

* filter by acl

* fixes + WIP single group retrieval

* wip pivot

* more pivot query fixes

* tests fixed after pivot

* views list tests

* fixing test command

* business plan only checks

* more tests for coverage

* .dts import fix

* cli fix

* anutha one

* auth policy tests for business plan access

* WIP saved views panel base

* BE listing adjustments

* WIP group rendering

* group render done

* WIP post create cache updates

* listing fine?

* my vs theirs

* auto open

* minor fixes

* click load omg

* nicely loading views

* type fix

* less spammy loading

* another type fix:

* more lint fix

* test fix

* codecov disable

* moar coverage

* fix sidebar flashin

* more test coverage

* more test cvoverage

* minor adfjustments

* adj

* saved view wipe fixes

* CSR viewer

* more improvements

* extra feature flag checks

* lint fix

* feature flags fix

* more test fixes
2025-08-05 11:52:50 +03:00
Iain Sproat b960ba6f2a fix(preview service): relative import should use alias (#5075) 2025-07-15 12:22:03 +01:00
Daniel Gak Anagrov e6cd2ab441 feat(preview-service): re introduce preview service acceptance test (#5049)
* feat: basic structure for running tests

* feat: added test to ci

* feat: added server test (wip)

* refactor: restuctured entrypoint

* feat: added supertest

* fix: missing deps

* fix: test example ci

* fix: updated default envs

* feat: debug ci

* feat: switch browser

* fix: superadmin ci

* feat: try another image

* fix: try another image with node

* fix: mr comments

* fix: ci job

* chore: workaround to push the image

* chore: try with new base image

* chore: retry

* chore: retry

* chore: retry

* chore: retry

* chore: retry

* fix: test via debug

* fix: envbar

* chore: wrapped up changes, cleaned mr

* chore: fix linter and skiped puppeteer download

* fix: removed paralelism

* fix: paralelism issues
2025-07-15 10:56:09 +02:00
Iain Sproat 4a58e66d99 feat(file importer): send skp to rhino parser (#4973) 2025-06-23 13:45:26 +01:00
Iain Sproat 55cffc3782 ci(docker): tidy dockerfiles with aim to increase cache hits (#4819) 2025-06-09 16:54:24 +01:00
Gergő Jedlicska 2e86a723c6 feat(fileimport-service): add next gen file importer (#4697)
* feat(fileimport-service): add next gen file importer

* feat(fileimports): integrate server and fileimporter

* chore(dui3): remove leftover artifacts

* fix(server): test typing fixes

* fix(fileimports): test and pr comment fixes

* feat(fileimports: moare test fixes

* fix(fileimports): tests and yarn dedupe
2025-05-23 10:27:00 +02:00
Alexandru Popovici a385823b2d feat(viewer): objectloader2 integration (#4267)
* feat(viewer-sandbox): Made a sandbox function that will only invoke the object-loader loading objects

* first pass of creating an objectloader2

* updated build + added vitest

* try to get viewer sandbox to use new code

* sandbox type fix

* refactor a bit

* can download root

* intermediate commit for downloader/caching queue

* can download stuff!

* refactor files

* intro isBase and fix isString

* move single download to downloader

* fix download

* PR feedback

* some intermediate commit

* do clean up and download better

* clean up promises and linting

* can generate values while downloading and caching

* add a finish method

* remove unused functions

* remove asBase

* add temporary docs

* add more docs with mermaid

* add more test models

* add response validation

* add tests and redo options

* add test for download batch

* fix downloader tests and change Item to have clearer Base items

* add tests and refactor a little

* use fetch in downloader as an option

* use optional in-memory indexdb instead of monkey patching the global one

* more refactors for options for objectloader2

* add tests for objectloader2

* adjust single download

* benchmark loading and adjust ol2 batches

* download more!

* adjust to use hash privates

* refactored again with renaming

* cleanup

* make setupCacheDb throw instead

* use BatchedPool for downloads!

* fix tests

* adjust timings and add adaptive waiting

* Only wait if queue wasn't empty and queue size was full

* fix tests

* fix file names and some private usage

* fix interval and private usage

* rename vars

* use params for methods

* fix params for constructors and tests

* fix params for constructors and tests again

* using dexie

* faster settings but doesn't end well

* fixed end, optimized and removed logs

* fix tests

* fix types?

* update lock with WSL

* add e2e small model test

* fix/update yarn.lock

* Remove unused eslint ignore to fix pre-commit

* prettier fixes

* fix real DB usage

* rename methods to better match OL1

* rename methods to better match OL1 again

* add extra header collection

* add headers correctly

* test getTotalObjectCount

* feat(viewer-lib): Replaced old object loader with Adam's  objectloder2

* fix(viewer-lib): Removed the old object loader. Removed unneeded pause time in speckle loader

* Testing

* only deferred if not downloaded....don't save everything

* Lockfile

* pool isn't adjustable, adjust download buckets, dexie read is faster

* chore

* fix(viewer-lib): Fixed compiler errors

* fix getObject access with real indexeddb...adjust buffer for deferred access

* Fix disposal and pausing

* don't index item!

* fix dockerfiles to use OL2

* fix Dockerfile

* Fix dockerfile

* defer correctly and use record to add/lookup/remove to

* delete stuff correctly

* chore(sandbox): Enabled viewer loading

* use objects instead of arrays to avoid findIndex

* remove extra count

* add a found cache to avoid some db hits

* order matters for deferment

* move found map to deferment

* change option numbers

* 2 level cache with expiry

* defer everything, use loader to track what is requested....expire only found items

* add deferment disposal

* oops mismerge

* chore(sandbox): Default stream

* Beta version of CachePump and CacheReader

* Clean up initialization

* More clean up

* chore(objectloader2): Fixed CI compiler error

* chore(objectloader2): Fixed prettier

* add cachePump tests

* add cacheReader tests

* fixed more tests

* fixed final tests

* moving stuff around and lock return value

* try to move stuff out of objectloader2

* use a factory

* rename factory

* formatting

* eslist fixes

* try allocating no strings

* add comments

* small refactor and add another test

* fix deferment expiration and have test

* use byte size for max memory cache size

* fix deferment manager tests

* saved comment

* fix(viewer-sandbox): Fixed compiler error

* ignore tshy

* chore(frontend): Attempt to make viewer loading sequential

---------

Co-authored-by: Adam Hathcock <adam@hathcock.uk>
Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>
Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
2025-05-21 10:05:50 +03:00
Iain Sproat 6e8a868c40 Merge pull request #2671 from specklesystems/iain/dockerfile-node18-node22
chore(node): bump from 18 to 22
2025-05-13 09:19:00 +01:00
Kristaps Fabians Geikins e98029ef63 fix: disable pino-pretty in inspector to avoid freezes (#4718)
* fix: disable pino-pretty in inspector to avoid freezes

* CR comments
2025-05-13 11:14:50 +03:00
Iain Sproat ab06b712a7 Merge branch 'main' into iain/dockerfile-node18-node22 2025-05-12 14:46:40 +01:00
Kristaps Fabians Geikins b406d0e32d chore(server): node16 & export maps support for server (#4698)
* chore(server): node16 & export maps support for server

* moar cleanup

* lint fixc
2025-05-12 14:27:34 +03:00
Gergő Jedlicska 2fdcf1bd1d refactor(shared): unified queue handling (#4691)
* feat(shared): unified queue initialization in shared

* feat(queues): use the new queue creation everywhere

* chore(shared): move to redis module

* chore(shared): fix export maps

* chore(fileimport): add deps properly

* fix(shared): import fix

* fix(everything): moear imports

* fix(server): cjs imports
2025-05-08 16:58:43 +02:00
Iain Sproat 6c8b715365 chore(shared): refactor previews in to worker directory
- add file imports to worker directory
2025-05-07 18:35:56 +02:00
Iain Sproat 8a32b3f2ae chore(CI): speed up yarn install by skipping install of browsers 2025-05-01 20:35:43 +01:00
Daniel Gak Anagrov 6437f237aa feat(ci): move arg to improve docker cache hits (#4642)
Co-authored-by: Daniel Gak Anagrov <daniel@speckle.systems>
2025-05-01 12:39:44 +02:00
Iain Sproat ee4218b870 fix(preview service): remove reference to library it cannot access 2025-04-22 14:42:13 +01:00
Iain Sproat 2adf7a97ae Merge pull request #4499 from specklesystems/iain/likes-time_ms
chore(readable code): use TIME_MS for readable durations
2025-04-22 09:48:19 +01:00
Iain Sproat 920099c39f chore(readable code): use TIME_MS for readable durations
- we recently added TIME_MS helper; this applies it to existing durations
2025-04-18 17:51:43 +01:00
Iain Sproat b77899626e Merge branch 'main' into iain/web-2928-bull-queue-fails-silently-if-it-cannot-connect-to-a-redis 2025-04-15 07:45:10 +01:00
Iain Sproat fe859a075c chore(preview-service): update README (#4389)
* chore(preview-service): update README

* Update README for docker
2025-04-11 17:06:58 +02:00
Iain Sproat 66f3f6ff74 Gracefully handle preview-service shutdown 2025-04-11 13:33:30 +01:00
Iain Sproat 188518dd8c chore(preview service): include redis readiness check in healthcheck 2025-04-11 13:28:05 +01:00
Iain Sproat 2071a36e5d fix(previews): disable previews is previews Redis is not reachable
- exit preview-service process if Redis is not reachable
- improve server healthcheck to include Redis client readiness check
2025-04-11 13:25:19 +01:00
Iain Sproat af1acf3983 fix(preview service): check bull queue is ready before processing 2025-04-11 12:02:03 +01:00
Alexandru Popovici c1958d199d chore(preview-service): Chrome's passed args are logged (#4381)
* chore(preview-service): Chrome's passed args are logged

* improve log lines produced by preview service

---------

Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
2025-04-11 11:08:43 +03:00
Iain Sproat 1b18786281 chore(preview service): use gl-egl over vulkan 2025-04-08 18:05:24 +01:00
Iain Sproat 5fc2d5c089 Merge pull request #4180 from specklesystems/iain/preview-service-handle-errors
fix(preview service): handle errors and failures
2025-04-08 17:55:49 +01:00
Iain Sproat 35c83d62a8 Revert change already in another PR 2025-04-08 15:13:40 +01:00
Iain Sproat b66b19e1ac Remove duplication of browser close 2025-04-08 15:10:39 +01:00
Iain Sproat 58ed9fc58b Merge branch 'main' into iain/preview-service-handle-errors 2025-04-08 15:08:00 +01:00
Iain Sproat be9bbc234f Disable unnecessary chromium components 2025-04-08 14:56:05 +01:00
Iain Sproat bbadd643b9 chore(preview service): improve logging 2025-04-08 10:57:12 +01:00
Iain Sproat 5b619c83a3 Fix dependency version 2025-04-07 17:41:51 +01:00
Iain Sproat 65564acc5a feat(preview service): enable GPU rendering via Puppeteer 2025-04-07 17:34:31 +01:00
Iain Sproat 2433380a1c feat(helm chart): separate helm chart for preview service 2025-03-31 18:19:44 +01:00
Iain Sproat 33e32ed02c Add comments about role of shutdown process managing browser closure 2025-03-28 10:43:43 +00:00
Iain Sproat 0caaa7a264 SIGTERM could close browser before parent, resulting in race
- SIGTERM is no longer handled by puppeteer
2025-03-27 17:13:49 +00:00
Iain Sproat 3c753b5609 Use specific type 2025-03-27 15:49:16 +00:00
Iain Sproat 954d6d8871 Ensure browser is always closed 2025-03-27 15:46:57 +00:00
Iain Sproat 269b25d1a2 fix by using const 2025-03-27 15:32:54 +00:00
Iain Sproat d788253f92 fix 2025-03-27 14:52:06 +00:00
Iain Sproat d4c3ccd548 Use zod to split job id 2025-03-27 14:22:12 +00:00
Iain Sproat cab78143c2 Log as warning if app is shutting down 2025-03-27 13:35:53 +00:00
Iain Sproat dfd328f236 log job attempts made 2025-03-27 11:57:41 +00:00
Iain Sproat b82e0dd370 Merge branch 'main' into iain/preview-service-handle-errors 2025-03-26 08:50:37 +00:00
Iain Sproat a555fc1c1a Merge branch 'main' into iain/web-2811-new-preview-service-pods-stuck-on-terminating 2025-03-25 16:32:55 +00:00