- Fixed an age old issue where transparent mesh batch ranges were incorrectly reported
- Diff materials now have their visible flag reset to false when opacity is 0 and set when otherwise, so that they are not picked up by the edges pipeine in the transparent edges generation pass
* feat(viewer-lib): Implemented custom object visibility on a per pass basis. With this, we can have ghosted objects not render lines even if they are still transparent
* chore(viewer-lib): Fixd compiler error
---------
Co-authored-by: Mucahit Bilal GOKER <51519350+bimgeek@users.noreply.github.com>
* fix(viewer-lib): Transformed is no longer baked in if matrix is identity
* fix(viewer-lib): Do not use uint32 indices unless we have to
* fix(viewer-lib): Do not use Float64 array unless the batch needs RTE
* feat(viewer-lib): Update on reducing memory allocation during startup:
- Geometry data is now stored as separate DataChunks as they come
- Dechunking now no longer allocates memory. It just returns the DataChunk array
- Updated the SpeckleGeometryConverter to work with chunk arrays
- Updated Geometry and triangulation to work with chunk arrays
- All geometry type batches now work with chunk arrays instead of flattened arrays
- Chunks are tracked by use and deleted after all render views are done with them. The chunks also track their usage across different render views so they aren't deleted until all render views that use tham are finished with them
- In order to better support this new way of working with geometry data, VirtualArray and ChunkArray classes have been implemented. They make it easier to work with segmented data and offer a unified view on the array of array segments
* chore(viewer-lib): Denormalized normals to keep parity, even though they should be normalized
* feat(viewer-lib): Geometry transformation is now deferred until we build batches, and we transform the batched arrays leaving the original data chunks intact. Text and TextBatchObject now use the render view's 'transform' property to store it's final startup transformation and not 'bakeTransform' anymore
* fix(viewer-lib): Fixed the issues caused by chunking geometry to the acceleration structures.
* chore(viewer-lib): Made a pass on the entire viewer project and removed pointless typed array backing buffer re-allocations
* feat(viewer-lib): Updates on better large model support:
- Fixed an issue in LineBatach that broke building it
- Improved VirtualArray performance and added some extra functionality
- Already triangulated faces no longer allocate redundant memory, they get processed in place
- Moved triangulation to SpeckleConverter so that processed index chunks get stored in local storage so we don't have to re-triangulate each time
* feat(viewer-lib): Gave up on trying to cache triangulated indice. Too much hasle and edge cases to handle when only some chunks get saved as triangulated in a multi chunk setup
* fix(viewer-lib): Fixed non triangulted geometry converter return
* feat(viewer-lib): Glow-up to our triangulation implementation. Faster, zero allocation
* fix(viewer-lib): Frontfacing not backfacing triangles
* chore(viewer-lib): Fixed compile errors
* fix(viewer-lib): Already processed chunks just copy over
* fix(viewer-lib): Skip processed chunks when computing triangulation index size
* fix(viewer-lib): Some fixes:
- Fixed an issue where instances that will not be rendered as instanced geometry were not correctly transformed
- Removed geometry duplication from instances that were de-instanced in the batcher
- Fixed an issue with LineBatch and buffer type
* fix(viewer-lib): Implemented box3 bounds generation from ChunkArray which takes care to respect inter-chunk bounds for vec3. Without this, box3s were incorrectly calculated by computing a box3 for each chunk
* fix(viewer-lib): Fixed an issue where transformations that contain non-uniform scaling incorrectly produce node render views aabb values. So we recompute them based on the post-transform geometry when building batches
* fix(viewer-lib): When mixing triangles with ngons we also need to increment total tris count for the triangle case as well
* fix(viewer-lib): If geometry is invalid, clear it all
* fix(viewer-lib): Instanced rvs no longer transform their aabbs when building the render tree because they don't need to
* fix(viewer-lib): aabb for render views needs to be recomputed when de-instanced by the batcher
* Allow undoing rotations
* Allow redoing undos
* Improve how the very first rotation is stored
* Track the history of any section box edit
* Also update section outlines when undoing/redoing
* Increase how much history we store
* Start initial index at 0
* Rewrite some comments
* Use existing OBB class instead
* Get rid of fudge
* Only support undo/redo when section tool is visible
* Update naming
* Rotate by 15 degrees when shift key is pressed
* Move consts outside
* Make snap angle a configurable option
* Add comment about support for snapped rotation
* we don't want to break eviction checking for first item...continue the check
* always include size when adding
* scan for references and count them...request when found and don't clean up if referenced
* add display of closure calculation
* add always output to sandbox
* formatting fixes
* removed tracking of deferments, moved caching to separate concern and class
* fixed cache checking and simplifed deferment
* add tests for new deferment and cache
* formatting
* Update packages/objectloader2/src/deferment/BaseCache.ts
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update packages/objectloader2/src/deferment/BaseCache.ts
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update packages/objectloader2/src/core/objectLoader2.ts
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update packages/objectloader2/src/core/objectLoader2.ts
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update packages/objectloader2/src/core/objectLoader2.ts
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix AI suggestions
* rename BaseCache to MemoryCache
* use private method
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* feat(viewer-lib): Text updates:
- Update to latest troika-three-text version
- Started working on the new TextBatch whoich will actually batch texts
- Augmented BatchedText type from troika
- Renamed old SpeckleText to TextLabel
* feat)viewer-lib): Copied over the batched version for the speckle text into our text material since troika won't export it
* feat(viewer-lib): First draft on text batching
* feat(viewer-lib): WIP on TextBatch and SpeckleText
* feat(viewer-lib): SpeckleText batch now has working TAS and BAS. Overloaded getBatches to also take an array of geometry types and added GeometryType.TEXT in places where required alongisde MESH
* feat(viewer-lib): Text batch has correctly transformed texts
* feat(viewer-lib): Patched troika BatchedText to allow per text opacity. Draw ranges for text batches are now functional
* feat(viewer-lib): Fixed an issue with the BAS not correctly reporting bounds. Had to override two methods completely in our SpeckleText extension of the BatchedText just so that we don't do stupid things and still get good performance when dealing with a huge number of texts
* feat(viewer-lib): Added text batch object count limit. Default is 5k. Implemented proper material caching and cloning inside SpeckleText. Overriden the default updateBounds function so that we don't waste tens of millisecons per frame!!! pointlessly
* feat(viewer-lib): Implemented TextBatchObject along with individual text batch object transform manipulation at batch level.
* chore(viewer-lib): Updated the pipelines to not render text geometries twice
* feat(viewer-lib): Implemented RTE for batched text rendering. As with the rest of the geometry types, RTE is automaic and will only be used when needed
* feat(viewer-lib): Integrated remaining text v3 features: alignments and maxWidth
* feat(viwer-lib): Implemented billboarding and RTE billboarding for text.
* feat(viewer-lib): Text batches now report correct object materials and can be filtered properly
* fix(viewer-lib): Some Fixes:
- The need for text RTE is now correctly being computed on the right text dimensions
- Sequential update ranges now correctly apply materials to all of them
* fix(viewer-lib): RTE text box is now correctly transformed. The text batch object only uses the TAS for intersecting since it's BAS is redundant.
* feat(viewer-lib): Text batches now correctly use gradient/ramp textures along with sample indices for colored filtering.
* feat(viewer-lib): Implemented raycasting for billboarded text batches in the most simple and robust way I was capable of. Lacks TAS speedup but it's a compromise we have to make and one which we probably will never regret
* feat(viewer-lib): Good progress on reworking TextLabel, which replaces the old multi purpose SpeckleText, which we use internally for measurements. More precise rendering, no more rogue margins between text and background. Regular billboarding now also works, along with non-billboarded rendering
* feat(viewer-lib): Finally a unified billboarding solution in SpeckleBasicMaterial. Supporting both world and screen billboarding; SpeckleTextMaterial now extends SpeckleBasicMaterial; TextLabel now has proper control over size and margins. No more weird offsets. Added background margins to the text params which work in both world and screen space.
* feat(viewer-lib): Implemented raycasting for all billboarding types. Spent quite some time on the screen billboarding one because of a stupid mistake
* chore(viewer-lib): Added (vibed) type declaration file for troika's Text class and fixed compiler errors for TextLabel
* chore(viewer-lib): Renamed SpeckleText to SpeckleBatchedText and fixed all compiler errors. Updated type definition file
* feat(viewer-lib): Integrated TextLabel with measurements. Simplified a lot of code
* fix(viewer-lib): Some updates and fixes to text and measurements integration
- Screen space billboarding now also takes an NDC offset alongside the size.
- Added auto margin calculation for TextLabel background so it's always centered regardless of anchor-ing
- DPR is automatically factored in for TextLabel
- Some changes to sizes and margins for measurements
* fix(viewer-lib): Bunch of fixes and tweaks
* fix(viewer-lib): Area measurement's area plane no longer overdraws on top of the area value text label via simple stenciling
* fix(viewer-lib): Fixed CI build
* fix(viewer-lib): Fixed CI build
* feat(viewer-lib): Slightly reduces the size and h margin of text gizmos for measurements
* fix(viewer-lib): Fixed incorrect text transformation when neither RTE nor billboarded
* chore(viewer-lib): Added review suggestions
* feat(viewer-lib): Implemented support for duplicate speckle objects. The world tree now accepts duplicates by appending a unique identifier to the node ids. The speckle object ids remain the same. Searching for a duplicated node id will also yield all nodes
* feat(viewer-lib): Changed the way duplication handling works. It's more simple, cleaner and it works better. NodeMap now registers duplicates softly, and only renderable objects are actually duplicated
* fix(viewer-lib): Fixed typo
* Fix deferment logging
* Add count and total for traversal and rendering
* Prettier
* ESlint fixes
* Don't have a total for traversal
* revert lock change
* chore(viewer-lib): Added a comment abou render trees and reported node counts
* Traversal has no total
* ignore conversion total
* remove total for converted
* forgot a build breakage
* make the count callback optional
---------
Co-authored-by: AlexandruPopovici <alexandrupopoviciioan@gmail.com>
* fix(viewer-lib): Both deltaTarget and deltaPosition need to smaller than epsilon ot return early in 'fromPositionAndTarget'
* chore(viewer-lib): Deleted unused source
* Adding more progress to loading and rendering of a model
* have separate values for loading totals
* Allow callback to be null
* Fix loading test
* Prettier
* Revert sandbox changes
* chore(viewer-lib): testing numbers
* feat(viewer-lib): Implemented a way to compute the projected pixxel difference between fp32 and fp64 as it would happen on the GPU. With this we can determine which streams need RTE
* feata(viewer-lib): Proper precision loss detection
* feat(viewer-lib): Removed default 'USE_RTE' defines from all non instanced mesh materials. Updated standard shader to compile and work properly in non RTE mode
* fix(viewer-lib): non-RTE vertex transform also takes pivot into account
* feat(viewer-lib): All required vertex programs now have proper non-RT vertex and shadow transformation pipelines
* feat(viewer-lib): Mesh batch determines if it needs RTE on it's own
* feat(viewer-lib): Shadowmap now also renders properly with selective RTE
* feat(viewer-lib): Instanced batches no longer use RTE regardless of the RTE need source
* feat(viewer-lib): Lines now have no RTE by default and it's only enabled on demand by the batch when required
* feat(viewer-lib): Points and point clouds no longer use RTE by default. It's enabled on demand
* feat(viewer-lib): WIP on area measurement
* feat(viewer-lib): WIP on area measurement. Basics are working. Needs more bling
* feat(viewer-lib): Implemented polygon triangulation for measured area
* chore(shared): Updated MeasurementType
* Add Area control to measure panel
* feat(viewer-lib): Real time updates of the fill polygon and area value
* feat(viewer-lib): Added pole of innacessibility as area label anchor using the polylabel libraryh
* feat(viewer-lib): Fixed fill polygon material
* feat(viewer-lib): Changed the surface normal indicator from the faulty disc to a outlined rectangle. Looks and works much better now
* fix(viewer-lib): Measurements get clipped by sections planes
* faet(viewer-lib): Measurements can now optionally define their own snapping method. Area measurement snaps to first point in screen space. Generic vertex snap still applies if enabled
* fix(viewer-lib): Forgot to project the measured point
* feat(viewer-lib): Double click auto-finishes the area measurmenet by instantly joining with the first point. Right clikc removes current area measurement point so you can 'undo'
* fix(viewer-lib: Fixed a stupid bug relatedto text because somebody thought that making it 'async' would be sooooo cool...
* fix(frontend): Prevent zoom on double click when using area measurement
* chore(viewer-lib): Refined and fomralized a bit now that the general idea of a measurement has got more complex
* chore(viewer-lib): Moved state switching a bit
* chore(viewer-lib): Replaced the old disc normal indicator with the new one and made it standard. Added an option to the gizmo's style that determines the pixels size of the normal indicator
* chore(viewer-lib): Documented the area measurement tool
* chore(viewer-lib): Some updates:
- Implemented proper bounds getter for area measurement
- Got rid of the static vector buffers in Measurement and replaced them with consts where needed
- Reduced the min click timing from 250ms to 150ms
- Other small adjustments
* feat(viewer-lib): Added the option to chain measurements
* chore(frontend-2): Added toggle for measurement chaining
* chore(viewer-lib): Perpendicular measurement chaining now align on the same line as requested
* feat(viewer-lib): Implemented point (coordinate) measurement:
- Added support for billboard offseting in NDC in the shader via vec2 offset uniform. Not a dream come true, but required mostly because of how troika works
- SpeckleText background now follows text anchoring
- Implemented new POINT measurement type
* chore(viewer-lib): Separated label position calculation. We now update only the label transform each frame, instead of updating the entire label redunantly
* chore(viewer-lib): Offsets are now constants. Removed redundant vector and matrix creation
* chore(frontend-2): Placeholder radio button for point measurement type. Fixed compile errors
* fix(viewer-lib): Fixes WEB-3105. Export all measurement types
* updated icons
* Update description
---------
Co-authored-by: andrewwallacespeckle <andrew@speckle.systems>
Co-authored-by: Mike Tasset <mike.tasset@gmail.com>
* feat(viewer-sandbox): Made a sandbox function that will only invoke the object-loader loading objects
* first pass of creating an objectloader2
* updated build + added vitest
* try to get viewer sandbox to use new code
* sandbox type fix
* refactor a bit
* can download root
* intermediate commit for downloader/caching queue
* can download stuff!
* refactor files
* intro isBase and fix isString
* move single download to downloader
* fix download
* PR feedback
* some intermediate commit
* do clean up and download better
* clean up promises and linting
* can generate values while downloading and caching
* add a finish method
* remove unused functions
* remove asBase
* add temporary docs
* add more docs with mermaid
* add more test models
* add response validation
* add tests and redo options
* add test for download batch
* fix downloader tests and change Item to have clearer Base items
* add tests and refactor a little
* use fetch in downloader as an option
* use optional in-memory indexdb instead of monkey patching the global one
* more refactors for options for objectloader2
* add tests for objectloader2
* adjust single download
* benchmark loading and adjust ol2 batches
* download more!
* adjust to use hash privates
* refactored again with renaming
* cleanup
* make setupCacheDb throw instead
* use BatchedPool for downloads!
* fix tests
* adjust timings and add adaptive waiting
* Only wait if queue wasn't empty and queue size was full
* fix tests
* fix file names and some private usage
* fix interval and private usage
* rename vars
* use params for methods
* fix params for constructors and tests
* fix params for constructors and tests again
* using dexie
* faster settings but doesn't end well
* fixed end, optimized and removed logs
* fix tests
* fix types?
* update lock with WSL
* add e2e small model test
* fix/update yarn.lock
* Remove unused eslint ignore to fix pre-commit
* prettier fixes
* fix real DB usage
* rename methods to better match OL1
* rename methods to better match OL1 again
* add extra header collection
* add headers correctly
* test getTotalObjectCount
* feat(viewer-lib): Replaced old object loader with Adam's objectloder2
* fix(viewer-lib): Removed the old object loader. Removed unneeded pause time in speckle loader
* Testing
* only deferred if not downloaded....don't save everything
* Lockfile
* pool isn't adjustable, adjust download buckets, dexie read is faster
* chore
* fix(viewer-lib): Fixed compiler errors
* fix getObject access with real indexeddb...adjust buffer for deferred access
* Fix disposal and pausing
* don't index item!
* fix dockerfiles to use OL2
* fix Dockerfile
* Fix dockerfile
* defer correctly and use record to add/lookup/remove to
* delete stuff correctly
* chore(sandbox): Enabled viewer loading
* use objects instead of arrays to avoid findIndex
* remove extra count
* add a found cache to avoid some db hits
* order matters for deferment
* move found map to deferment
* change option numbers
* 2 level cache with expiry
* defer everything, use loader to track what is requested....expire only found items
* add deferment disposal
* oops mismerge
* chore(sandbox): Default stream
* Beta version of CachePump and CacheReader
* Clean up initialization
* More clean up
* chore(objectloader2): Fixed CI compiler error
* chore(objectloader2): Fixed prettier
* add cachePump tests
* add cacheReader tests
* fixed more tests
* fixed final tests
* moving stuff around and lock return value
* try to move stuff out of objectloader2
* use a factory
* rename factory
* formatting
* eslist fixes
* try allocating no strings
* add comments
* small refactor and add another test
* fix deferment expiration and have test
* use byte size for max memory cache size
* fix deferment manager tests
* saved comment
* fix(viewer-sandbox): Fixed compiler error
* ignore tshy
* chore(frontend): Attempt to make viewer loading sequential
---------
Co-authored-by: Adam Hathcock <adam@hathcock.uk>
Co-authored-by: Kristaps Fabians Geikins <fabis94@live.com>
Co-authored-by: Iain Sproat <68657+iainsproat@users.noreply.github.com>
* feat(viewer-lib): WIP on the new OrientedSectionTool
* feat(viewer-lib): Added proper face pulling for the oriented section box
* feat(viewer-lib): Several updates on the oriented sectioning tool
- Implemented section planes calculation and propagation
- Unified obb computation from all gizmos
- Implemented proper setBox function
- Updated the viewer-core to work with OBB instead of AABB for it's clipping volume
- Updated the intersections to work with OBB for their intersting bounds
- Added extension methods to Box3 and OBB
* feat(viewer-lib): Better way of handling gizmo input events overlapping
* fix(viewer-lib): Updated clippingVolume occurences to OBB
* feat(viewer-lib): Section outlines now work with oriented section tool!
* feat(viewer-lib): Integrated new section tool with the frontend and API
- Defined an archtype for SectionTool which all section tools can derive from
- The old section tool is renamed to AxisAlignedSectionTool
- Replaced the old section tool with the oriented one in the frontend
* fix(viewer-lib): Fixed compile errors
* feat(viewer-lib): Some updates:
- Section tool outline, the visible box, is now rendered as before however it's correctly being RTE'd. And we can also make it thinner/thicker now
- Fixed the issue where the scale controls had 'exponential' growth. It's now linear like the translate one
* feat(viewer-lib): Implemented highlghting the box face when clicking on it to extend/retract it
* fix(viewer-lib): A bunch of fixes for the oriented section tool
* feat(viewer-lib): Some updates:
- Documented new OrientedSectionTool code
- Fixed som issues related to section box reseting
- Hid the translation and rotation gizmos that we aren't using
- Tidied up a bit
* feat(viewer-lib): Set the translate and rotate gizmos in local space so the rotation will affect them as wll
* chore(viewer-lib): Purged the old section tool
* chore(viewer-lib): Updated section box data type. Updated LegacyViewer section box data handling. Updated frontend to use new data type. Still not working doe
* fix(viewer-lib): Fixed an issue where comments with section boxes did not enable section outlines at startup
* chore(frontend): Fixed ci compiler error
* fix(viewer-lib): Fixes WEB-1593
* feat(viewer-lib): Adding outline rendering support for all/any pipeline:
- Implemented EdgesPipeline as a standalone pipeline. Can be used as is, but it's mostly used by other pipelines to add outline rendering support
- Moved the MRT/non-MRT versions for edge generation inside the EdgesPipeline. This removed a lot of redundant pipelines
- Added optional outline rendering support for all relevant pipelines
* feat(viewer-lib): Added optional edges to the TAA pipeline.
* chore(viewer-lib): Renamed some of the pipelines to be more consistent with the names given by the frontend. Cleaned up older stuff
* chore(viewer-lib): ViewportPass makes sure it requests renders until matcap texture finished loading
* chore(frontend-2): Updated the frontend with the new view mode type changes
* feat(viewer-lib): Some updates on view modes:Added support for outline thickness and color. Removed the background texture option from edges pass
* feat(viewer-lib): Handles WEB-3147:
- Outlines are now displayable on top of any dom element.
- There is one asterisk. Pure black colored outlines (0) do not blend properly because of some browser weirdness
* feat(viewer-lib): All pipelines besides pen now draw the outlines of transparent objects with a bunch of downsides
* chore(viewer-lib): Fixed sandbox errors
* feat(viewer-lib): Updated ViewModes extension to work with pipeline options. Defined EdgesPipelineOptions
* chore(viewer-lib): Fixed sandbox compile errors
* chore(sandbox): Viewer load not object loader only
* chore(viewer-lib): Fixed linting issues. are now optional when setting view modes
* feat(fe): View mode menu changes with no integration
* feat(fe): Frontend view mode menu integration
* fix(viewer-lib): Fixed the false gradient generated at the edges of the screen when in pen mode
* fix(fe): Better naming. Parse line weight to number
* chore(viewer-lib): A few updates:
- ViewModes now caches it's current options so it can properly determine when to do a full pipeline change and when to just update options
- Default pipeline options are now exported by the viewer
- Default pipeline options have edges enabled
* feat(fe): Design changes. Remove unneeded watch. Fix shortcuts
* feat(fe): use dark mode colours. add colour controls
* fix(fe): shortcuts and colours
* fix(fe): reactive defaultColor
* feat(fe): New descriptions. New hex colours.
* feat(fe): add mixpanel. watch darkmode
* fix(fe): fix dark mode watch
---------
Co-authored-by: andrewwallacespeckle <andrew@speckle.systems>
andrewwallacespeckle