Commit Graph

35 Commits

Author SHA1 Message Date
Daniel Gak Anagrov 58fad54c51 chore(dockerfile): increase likelihood of docker layer caching (#4972) 2025-06-23 08:42:00 +01:00
Iain Sproat 55cffc3782 ci(docker): tidy dockerfiles with aim to increase cache hits (#4819) 2025-06-09 16:54:24 +01:00
Alexandru Popovici a385823b2d feat(viewer): objectloader2 integration (#4267)
* feat(viewer-sandbox): Made a sandbox function that will only invoke the object-loader loading objects

* first pass of creating an objectloader2

* updated build + added vitest

* try to get viewer sandbox to use new code

* sandbox type fix

* refactor a bit

* can download root

* intermediate commit for downloader/caching queue

* can download stuff!

* refactor files

* intro isBase and fix isString

* move single download to downloader

* fix download

* PR feedback

* some intermediate commit

* do clean up and download better

* clean up promises and linting

* can generate values while downloading and caching

* add a finish method

* remove unused functions

* remove asBase

* add temporary docs

* add more docs with mermaid

* add more test models

* add response validation

* add tests and redo options

* add test for download batch

* fix downloader tests and change Item to have clearer Base items

* add tests and refactor a little

* use fetch in downloader as an option

* use optional in-memory indexdb instead of monkey patching the global one

* more refactors for options for objectloader2

* add tests for objectloader2

* adjust single download

* benchmark loading and adjust ol2 batches

* download more!

* adjust to use hash privates

* refactored again with renaming

* cleanup

* make setupCacheDb throw instead

* use BatchedPool for downloads!

* fix tests

* adjust timings and add adaptive waiting

* Only wait if queue wasn't empty and queue size was full

* fix tests

* fix file names and some private usage

* fix interval and private usage

* rename vars

* use params for methods

* fix params for constructors and tests

* fix params for constructors and tests again

* using dexie

* faster settings but doesn't end well

* fixed end, optimized and removed logs

* fix tests

* fix types?

* update lock with WSL

* add e2e small model test

* fix/update yarn.lock

* Remove unused eslint ignore to fix pre-commit

* prettier fixes

* fix real DB usage

* rename methods to better match OL1

* rename methods to better match OL1 again

* add extra header collection

* add headers correctly

* test getTotalObjectCount

* feat(viewer-lib): Replaced old object loader with Adam's  objectloder2

* fix(viewer-lib): Removed the old object loader. Removed unneeded pause time in speckle loader

* Testing

* only deferred if not downloaded....don't save everything

* Lockfile

* pool isn't adjustable, adjust download buckets, dexie read is faster

* chore

* fix(viewer-lib): Fixed compiler errors

* fix getObject access with real indexeddb...adjust buffer for deferred access

* Fix disposal and pausing

* don't index item!

* fix dockerfiles to use OL2

* fix Dockerfile

* Fix dockerfile

* defer correctly and use record to add/lookup/remove to

* delete stuff correctly

* chore(sandbox): Enabled viewer loading

* use objects instead of arrays to avoid findIndex

* remove extra count

* add a found cache to avoid some db hits

* order matters for deferment

* move found map to deferment

* change option numbers

* 2 level cache with expiry

* defer everything, use loader to track what is requested....expire only found items

* add deferment disposal

* oops mismerge

* chore(sandbox): Default stream

* Beta version of CachePump and CacheReader

* Clean up initialization

* More clean up

* chore(objectloader2): Fixed CI compiler error

* chore(objectloader2): Fixed prettier

* add cachePump tests

* add cacheReader tests

* fixed more tests

* fixed final tests

* moving stuff around and lock return value

* try to move stuff out of objectloader2

* use a factory

* rename factory

* formatting

* eslist fixes

* try allocating no strings

* add comments

* small refactor and add another test

* fix deferment expiration and have test

* use byte size for max memory cache size

* fix deferment manager tests

* saved comment

* fix(viewer-sandbox): Fixed compiler error

* ignore tshy

* chore(frontend): Attempt to make viewer loading sequential

---------

Co-authored-by: Adam Hathcock <adam@hathcock.uk>
Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>
Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
2025-05-21 10:05:50 +03:00
Iain Sproat ab06b712a7 Merge branch 'main' into iain/dockerfile-node18-node22 2025-05-12 14:46:40 +01:00
Iain Sproat 8a32b3f2ae chore(CI): speed up yarn install by skipping install of browsers 2025-05-01 20:35:43 +01:00
Daniel Gak Anagrov 6437f237aa feat(ci): move arg to improve docker cache hits (#4642)
Co-authored-by: Daniel Gak Anagrov <daniel@speckle.systems>
2025-05-01 12:39:44 +02:00
Iain Sproat 335f6a2a06 Merge branch 'main' into iain/dockerfile-node18-node22 2025-03-20 09:35:59 +00:00
Iain Sproat 575d48fdaf chore(dockerfiles): bump curl version for debian images
- debian has once again passively agressively removed older curl versions from their packages, forcing us to bump the version in order to build our image
2025-03-15 12:07:40 +00:00
Kristaps Fabians Geikins b1ed49297b chore: fix objectloader sourcemaps in datadog (#4136) 2025-03-07 14:07:00 +02:00
Kristaps Fabians Geikins f7ac90b520 chore: better viewer sourcemaps in datadog (#4132) 2025-03-07 10:01:59 +02:00
Kristaps Fabians Geikins 9e0da93f51 feat(fe2): new publish sourcemaps mechanism (#4076)
* WIP new publish sourcemaps mechanism

* config fix1

* config fix2

* config fix3

* config fix4

* switch to npx

* path fix

* a bit of cleanup

* CR fixes
2025-02-26 19:00:31 +02:00
Iain Sproat aaaf75d151 Merge branch 'main' into iain/dockerfile-node18-node22 2025-02-05 12:16:04 +00:00
Iain Sproat e6adceda6c chore(Dockerfile): use COPY --link flag (#3869) 2025-01-22 15:03:13 +00:00
Iain Sproat a1352fe8c8 chore(Dockerfile): remove all ADD statements as cache is missed (#3865) 2025-01-22 13:07:39 +00:00
Iain Sproat efbdd16fdd small fixes to the docker file 2024-08-16 12:42:23 +01:00
Iain Sproat 2991984a7e fix nix package name 2024-08-16 09:33:32 +01:00
Iain Sproat cd3ef0e951 chore(node): bump from 18 to 22 2024-08-16 08:49:34 +01:00
Kristaps Fabians Geikins b6ef90eb4f fix(fe2): dont build sourcemaps unnecessarily (#2597) 2024-08-08 11:56:36 +03:00
Kristaps Fabians Geikins c7fdc6acc2 chore: updating ws everywhere to resolve SNYK-JS-WS-7266574 (#2385)
* chore: updating ws in various ways

* puppeteer upgrade

* updating codegen deps

* workspaces cmd update

* various extra fixes

* minor preview-service troubleshooting improvements

* dockerfile fixes

* hopefully fixing docker build fe2

* try again

* try large again
2024-06-18 13:26:01 +03:00
github-actions[bot] a79680da00 Update image digests (#2203)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-06-18 10:18:46 +01:00
Kristaps Fabians Geikins bf9e6673a5 fix: ensuring all sourcemaps are cleaned from fe2 build image 2024-06-14 11:43:50 +03:00
Kristaps Fabians Geikins d661ff2deb fix: hadolint dockerfile lint issues 2024-06-14 10:37:32 +03:00
Kristaps Fabians Geikins 93fc3f6fc9 fix: broken dev source maps 2024-06-14 10:24:12 +03:00
github-actions[bot] 11b62f3824 Update image digests (#2189)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-04-09 10:05:32 +01:00
github-actions[bot] 4947573584 Update image digests (#2172)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-03-28 08:57:01 +00:00
github-actions[bot] bbe48effd0 Update image digests (#2139)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-03-15 16:42:10 +00:00
github-actions[bot] f9ac9e98a3 Update image digests (#2075)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-02-25 16:03:08 +00:00
github-actions[bot] 4418932832 Update image digests (#2040)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-02-23 12:42:29 +00:00
github-actions[bot] 8185683b4a Update image digests (#1966)
Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: specklebot <devops@speckle.systems>
2024-02-09 01:13:48 +00:00
github-actions[bot] 36f749b24a chore(deps): bump image digests (#1939)
* fix(github action): use correct format for author & committer git signing

* Update image digests

Signed-off-by: specklebot <devops@speckle.systems>

---------

Signed-off-by: specklebot <devops@speckle.systems>
Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
Co-authored-by: specklebot <devops@speckle.systems>
2024-01-05 15:57:25 +00:00
Iain Sproat b396029cf6 chore(Dockerfile): bump images to debian bookworm, pin images by digest, and github action to auto-bump (#1937)
* chore(Dockerfile): pin images by digest this ensures consistent builds with images pinned by SHA
* introduces a GitHub Action will create a PR to update the images when there is a new version, and will pin to that newer version SHA.

* Bump debian to 12 'bookworm'
* Bump pypi libraries
  * except frontend-1, as only debian 11 is currently supported by openresty
* Bump debian packages
2024-01-05 11:51:04 +00:00
Iain Sproat 2a96ce1b66 chore(frontend-2): base on distroless image (#1920) 2024-01-03 11:44:45 +00:00
Gergő Jedlicska 636b3afd44 fix(fe2dockerfile): add postbuild script to the docker image 2023-05-19 17:02:37 +02:00
Kristaps Fabians Geikins 7d3be1d131 feat: tailwind theme & Vue base components extracted to own NPM packages (#1576) 2023-05-16 13:43:04 +03:00
Kristaps Fabians Geikins b02a07e2b6 feat: Frontend 2.0 MVP 2023-05-08 10:47:01 +03:00