* Don't log cancelling
* redo exception handling for receive
* remove null test case
* clean up with Id/Json and more cancels
* Change the exception stacks
* fix serialization test
* make a custom scrubber for internalized exceptions
* clean up
* fix namespaces again :(
* adjust the scrubber
* try to make tests more predictable
* rework exceptions again
* strip out compile files used
* formatting
* custom exception validation
* fix init
* Move serialization to own class
* save serialize test
* add deep clean
* add cancellation test on save to cache
* cancellation tests
* format
* do DI correctly
* receive cancel works
* Add exception handling for SerializeProcess with CancellationTokenSource
* formatting
* add exception test to make sure we handle a server exception
* add extra exception and handling to stop
* add comment and another test
* one last chance for user to cancel
* formatting
* snapshot testing with verify
* formatting
* add back old serialization tests
* pass verify
* use json correctly
* formatting
* Don't use Quibble and order ourselves because ordering doesn't matter
* whitespace on snapshot
* Better json diffing? Quibble is back
* add common project
* add object unit tests to see how verify would work
* format
* move random exes to new solution folder
* update lock files
* xunit unit tests
* most pass with formatting
* convert objects to xunit
* remove nunit
* format
* merge fixes
* switch objects to fluent assertions
* update to fluent assertions
* more FA
* convert all to FA
* Format
* Fix tests
* formatting
* hopefully made credential test better
* Catch more specific exception
* use another more specific exception
* Fix tests
* update to xunit
* update packages
* add ServerObjectManagerFactory
* add usage of a command pool
* add more disposal
* save saving increase
* fix tests
* fixes
* push out concurrency and disposablity
* Add a custom task scheduler
* Better usage, don't wait to enqueue to save to channels
* Completely pre-cal batch size to avoid spinning issues
* Try to fix cache counting
* properly dispose things
* format
* clean up
* adjust count and save on current thread
* move batch it's own file
* update a few packages
* fix build and add batch tests
* revert and format
* Revert "save saving increase"
This reverts commit 3b50c857fb.
* revert change
* adjust and add tests
* Dispose sqlite manager properly
* Make Batch a IMemoryOwner to allow for pooling
* Fix tests
* Upgrade some deps
* try to make tests more explicit
* remove return value
* Use named tuple for all objects
* Add a custom task scheduler
* Better usage, don't wait to enqueue to save to channels
* Completely pre-cal batch size to avoid spinning issues
* Try to fix cache counting
* properly dispose things
* format
* clean up
* adjust count and save on current thread
* move batch it's own file
* update a few packages
* fix build and add batch tests
* add list pool creation
* add back base cache for closures
* use bounded channels and tell them to wait
* format and add exception
* adding back json cache?
* nevermind
* format
* add option to skip total finding
* add some comments
* Remove operator overloading and Equals/GetHashCode which caused problems
* properly have nullability annotations on Base
* redeux known nullables
* fmt
* more nullability
* fmt
* remove point equality operator
* Revert "Remove operator overloading and Equals/GetHashCode which caused problems"
This reverts commit 6b5d3f1462.
* Revert "remove point equality operator"
This reverts commit 9b14330147.
* revert nullable accounts
* fix build issues
* refactor options to use on factories, add dummies
* format
* reduce lists to yield return
* get primitives first to avoid to string
* fmt
* add cache base option
* Can debug dependencies
* Different exceptions
* Uses root id only after we found it to signal the end
* DataChunks are created later and need to be accounted for
* format
* use app ids in tests and references
* check sqlite cache after serialize
* use dummy to go through channels to end
* fmt
* Extend channel lib to batch by size
* fmt
* build fix
* adjust limits
* FIx sending
* Optimize reference generation
* more
* remove tolist
* rework closures to be constant and serializer only deals with current....references bases are cached
* fix chunk creation
* another bug fix
* clean up with factories
* add deserializer factory
* Needed to reference interface
* add Id and Json types
* Fix tests
* remove optional
* add another missing id write
* fix merge
* Fix new code
* Can debug dependencies
* Different exceptions
* Uses root id only after we found it to signal the end
* DataChunks are created later and need to be accounted for
* format
* use app ids in tests and references
* check sqlite cache after serialize
* use dummy to go through channels to end
* fmt
* Extend channel lib to batch by size
* fmt
* build fix
* adjust limits
* FIx sending
* Optimize reference generation
* more
* remove tolist
* rework closures to be constant and serializer only deals with current....references bases are cached
* fix chunk creation
* another bug fix
* clean up with factories
* add deserializer factory
* Needed to reference interface
* move around streamId
* some clean up
* Use StringBuilder pool on serialization to reduce memory pressure
* remove extra
* remove extra clears
* Fix a flaw in batchsize
* use default complete
* format
* loader should use 1 writer that is batched
* remove redundant ref gen
* Fix graphql commands by adding project id
* Can debug dependencies
* Different exceptions
* Uses root id only after we found it to signal the end
* DataChunks are created later and need to be accounted for
* format
* use app ids in tests and references
* check sqlite cache after serialize
* use dummy to go through channels to end
* fmt
* fix tests and add more send events
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* Hides ObjectPool dependency
* fmt
* Use the 1.0 BCL async to try to be more compatible
* rename to dependencies
* Move Polly to internal dependencies
* format
* remove more old references
* remove stackchannel
* fixes for registration
* remove console writeline
* add cache check shortcut for root object
* start refactoring send
* recevie2 benchmark
* add test for deserialize new
* use channels for sending
* test and fixes
* Use same asyncinterfaces as Dynamo. Merge fixes
* clean up
* fix download object progress
* put back from bad merge
* intermediate commit: separating get child function from serializer
* send didn't error
* add channels
* Use net48, netstandard2.1 and net8
* remove collection special case
* have to make a tree of tasks even though it may serialize things twice
* pre-id changing during serialize
* need AsyncInterfaces for net48 :(
* options changes
* revert to netstandard2.0 and net8.0
* fix totals
* revert httpcontext changes
* format
* clean up
* active tasks works when accounting for id not being stable
* add id tests
* more fixes
* works
* format
* Convert to BaseItem and use single SQLite checks to avoid locks
* use locks and batch sqlite operations
* hook up and handle null ids
* remove unused parameter
* remove progress from serializer itself
* invert has objects call
* readd object references
* format
* fix tests
* remove active tasks check
* bug fix for json cache
* remove locks from sqlite
* General Send test
* add childclosures
* redo extract all to be enumerable
* group tests in projects
* caching json does matter
* cache checking should be managed by channels
* format
* Merge pull request #152 from specklesystems/new-json-test
Uses a new objects test in Revit for serialization tests
* add skip
* add new roundtrip test
* fix finish
* clean up tests
* check happens in serialize...don't do it twice
* better progress reporting
* fix progress reporting
* only use detached properties when children gathering
* move detached tests
* add detached tests
* fix merge
* Fix progress change
* fix more tests
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
Co-authored-by: Claire Kuang <kuang.claire@gmail.com>
* removes unused classes and gh schema constructors
* additional cleanup of backwards compatibility (v2)
* Update Arc.cs
* updates unit tests
* re-adds bbox to box
* updates tests
* pr fixes for backwards compatibility
* Uses a new objects test in Revit for serialization tests
* format
* updates revit model curve class to inherit from curve geometry, and adds deprecated v2 classes
* fixes transform unit tests
* fixes deprecated speckle type
* removes unnecessary new revit curve classes
---------
Co-authored-by: Adam Hathcock <adam@hathcock.uk>
Co-authored-by: Alan Rynne <alan@rynne.es>
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* Hides ObjectPool dependency
* fmt
* Use the 1.0 BCL async to try to be more compatible
* rename to dependencies
* Move Polly to internal dependencies
* format
* remove more old references
* remove stackchannel
* fixes for registration
* remove console writeline
* add cache check shortcut for root object
* recevie2 benchmark
* add test for deserialize new
* Use same asyncinterfaces as Dynamo. Merge fixes
* clean up
* fix download object progress
* add channels
* Use net48, netstandard2.1 and net8
* need AsyncInterfaces for net48 :(
* options changes
* revert to netstandard2.0 and net8.0
* fix totals
* revert httpcontext changes
* format
* add active tasks collection
* format
* remove more changes and remove unused method
* remove more comment changes
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* remove stackchannel
* remove console writeline
* add cache check shortcut for root object
* recevie2 benchmark
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
* initial burn
* fix: Minor fixes, some pending
* fix: Minor fix + DeepClean target
* setup things to be injected
* things compile and activites are instanced
* compiles except tests
* tests compile
* fmt
* fix merge
* Activities are now an interface
* fmt
* fully remove logging DLL
* clean up
* fix tests
* more cleanup
* Fix integration tests
* clean up hash tests
* clean up path provider
* more cleanup for path
* merge fixes
* Merge fixes
* remove some extra classes
---------
Co-authored-by: Alan Rynne <alan@speckle.systems>
* Use Concurrent Dictionaries and ignore case on them to avoid ToLower
* remove single array allocation
* allocate GetClosures differently
* Use JsonReader for closures
* add comment
* use isdefined
* more readonly with less allocations
* sorts
* fmt
* use element type when making an array
* first pass
* Fix reading for object and array
* serialization works?
* Fix closure parsing
* things are way faster
* Deserialize is async
* fmt
* renames
* remove deserialize threads
* fmt
* faster to use ordinal compare
* serialization looks okay
* fix closure writing
* fixes
* use possibly different values for compute id
* use closure parser on download
* memory test for blobs
* decompose serialization
* fmt
* fmt
* for decomposing, values should be used instead of original
* set id after computing it
* redo more closure parsing
* fix memory test
* don't throw on try get deserialized
* fmt
* fix integration tests
* fix tests
* disable memory blob storage by default
* put back ?
* merge fixes and delete worker threads
* fmt
* serialization of old floats pass
* serialization of old floats pass
* rename class
* Use async/await on GetObject
* await deserialization
* fmt
* uncomment and fix tests
* don't allow things to exist in the closure table that doesn't exist
* detach blob tests
* rename serializer
* async more correct
* revert
* fix merge
* fix blob tests again
* more fixes
* Fix building
* async fixes
* more async fixes
* fix tests?
* rename GetId to GetIdAsync
* clean up
* more cleanup
* fmt
* fix test
* fix analyzer errors
* use ConcurrentDictionary to be thread safe
* Use Concurrent Dictionaries and ignore case on them to avoid ToLower
* remove single array allocation
* allocate GetClosures differently
* Use JsonReader for closures
* add comment
* use isdefined
* more readonly with less allocations
* sorts
* fmt
* use element type when making an array
* first pass
* Fix reading for object and array
* serialization works?
* Fix closure parsing
* things are way faster
* Deserialize is async
* fmt
* renames
* remove deserialize threads
* fmt
* faster to use ordinal compare
* serialization looks okay
* fix closure writing
* fixes
* use possibly different values for compute id
* use closure parser on download
* memory test for blobs
* decompose serialization
* fmt
* fmt
* for decomposing, values should be used instead of original
* set id after computing it
* redo more closure parsing
* fix memory test
* don't throw on try get deserialized
* fmt
* fix integration tests
* fix tests
* disable memory blob storage by default
* put back ?
* merge fixes and delete worker threads
* fmt
* serialization of old floats pass
* serialization of old floats pass
* rename class
* uncomment and fix tests
* don't allow things to exist in the closure table that doesn't exist
* detach blob tests
* rename serializer
* revert
* fix blob tests again
* progress intermediate commit
* add progress for download
* remove unused code
* remove batch sent callbacks
* multi-threaded deserialize works
* Progress for download and deserialization
* Fix tests
* Have less indeterminate deserialization
* fix deserialization
* make download faster with buffered stream
* put local receive back
* remove unused callback
* fmt
* Progress for serialization and upload
* fix uploading
* clean up from progress
* merge fixes and fmt
* compiles with relevant deletions
* Test fixes
* fix type loading
* type load for tests
* speckle objects renamespace
* rename Core to Sdk
* Fix test references
* tests renaming
* rename logging
* fmt
* start of adding an attribute to all base types
* convert all types and do basic test
* Fix most tests
* fix more tests
* fmt
* Build fix
* add changes and more tests
* Fix tests
* Fix integration tests
Adam Hathcock