* Add a custom task scheduler
* Better usage, don't wait to enqueue to save to channels
* Completely pre-cal batch size to avoid spinning issues
* Try to fix cache counting
* properly dispose things
* format
* clean up
* adjust count and save on current thread
* move batch it's own file
* update a few packages
* fix build and add batch tests
* disable channels when skipping things
* pass child closures to current. Current closures out to parent.
* fix build
* adjust options
* use a dictionary pool and pool correctly
* add pools for data chunks
* format
* add list pool creation
* add back base cache for closures
* use bounded channels and tell them to wait
* format and add exception
* adding back json cache?
* nevermind
* format
* add option to skip total finding
* add some comments
* Remove operator overloading and Equals/GetHashCode which caused problems
* properly have nullability annotations on Base
* redeux known nullables
* fmt
* more nullability
* fmt
* remove point equality operator
* Revert "Remove operator overloading and Equals/GetHashCode which caused problems"
This reverts commit 6b5d3f1462.
* Revert "remove point equality operator"
This reverts commit 9b14330147.
* revert nullable accounts
* fix build issues
* refactor options to use on factories, add dummies
* format
* reduce lists to yield return
* get primitives first to avoid to string
* fmt
* add cache base option
* Can debug dependencies
* Different exceptions
* Uses root id only after we found it to signal the end
* DataChunks are created later and need to be accounted for
* format
* use app ids in tests and references
* check sqlite cache after serialize
* use dummy to go through channels to end
* fmt
* Extend channel lib to batch by size
* fmt
* build fix
* adjust limits
* FIx sending
* Optimize reference generation
* more
* remove tolist
* rework closures to be constant and serializer only deals with current....references bases are cached
* fix chunk creation
* another bug fix
* clean up with factories
* add deserializer factory
* Needed to reference interface
* add Id and Json types
* Fix tests
* remove optional
* add another missing id write
* fix merge
* Fix new code
* Can debug dependencies
* Different exceptions
* Uses root id only after we found it to signal the end
* DataChunks are created later and need to be accounted for
* format
* use app ids in tests and references
* check sqlite cache after serialize
* use dummy to go through channels to end
* fmt
* Extend channel lib to batch by size
* fmt
* build fix
* adjust limits
* FIx sending
* Optimize reference generation
* more
* remove tolist
* rework closures to be constant and serializer only deals with current....references bases are cached
* fix chunk creation
* another bug fix
* clean up with factories
* add deserializer factory
* Needed to reference interface
* move around streamId
* some clean up
* Use StringBuilder pool on serialization to reduce memory pressure
* remove extra
* remove extra clears
* Fix a flaw in batchsize
* use default complete
* format
* loader should use 1 writer that is batched
* remove redundant ref gen
* Fix graphql commands by adding project id
* Can debug dependencies
* Different exceptions
* Uses root id only after we found it to signal the end
* DataChunks are created later and need to be accounted for
* format
* use app ids in tests and references
* check sqlite cache after serialize
* use dummy to go through channels to end
* fmt
* fix tests and add more send events
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* Hides ObjectPool dependency
* fmt
* Use the 1.0 BCL async to try to be more compatible
* rename to dependencies
* Move Polly to internal dependencies
* format
* remove more old references
* remove stackchannel
* fixes for registration
* remove console writeline
* add cache check shortcut for root object
* start refactoring send
* recevie2 benchmark
* add test for deserialize new
* use channels for sending
* test and fixes
* Use same asyncinterfaces as Dynamo. Merge fixes
* clean up
* fix download object progress
* put back from bad merge
* intermediate commit: separating get child function from serializer
* send didn't error
* add channels
* Use net48, netstandard2.1 and net8
* remove collection special case
* have to make a tree of tasks even though it may serialize things twice
* pre-id changing during serialize
* need AsyncInterfaces for net48 :(
* options changes
* revert to netstandard2.0 and net8.0
* fix totals
* revert httpcontext changes
* format
* clean up
* active tasks works when accounting for id not being stable
* add id tests
* more fixes
* works
* format
* Convert to BaseItem and use single SQLite checks to avoid locks
* use locks and batch sqlite operations
* hook up and handle null ids
* remove unused parameter
* remove progress from serializer itself
* invert has objects call
* readd object references
* format
* fix tests
* remove active tasks check
* bug fix for json cache
* remove locks from sqlite
* General Send test
* add childclosures
* redo extract all to be enumerable
* group tests in projects
* caching json does matter
* cache checking should be managed by channels
* format
* Merge pull request #152 from specklesystems/new-json-test
Uses a new objects test in Revit for serialization tests
* add skip
* add new roundtrip test
* fix finish
* clean up tests
* check happens in serialize...don't do it twice
* better progress reporting
* fix progress reporting
* only use detached properties when children gathering
* move detached tests
* add detached tests
* fix merge
* Fix progress change
* fix more tests
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
Co-authored-by: Claire Kuang <kuang.claire@gmail.com>
* removes unused classes and gh schema constructors
* additional cleanup of backwards compatibility (v2)
* Update Arc.cs
* updates unit tests
* re-adds bbox to box
* updates tests
* pr fixes for backwards compatibility
* Uses a new objects test in Revit for serialization tests
* format
* updates revit model curve class to inherit from curve geometry, and adds deprecated v2 classes
* fixes transform unit tests
* fixes deprecated speckle type
* removes unnecessary new revit curve classes
---------
Co-authored-by: Adam Hathcock <adam@hathcock.uk>
Co-authored-by: Alan Rynne <alan@rynne.es>
* Added explicit nullability to GqlModels
* data and alignment
* ModelsWithVersions
* Models
* active user
* Invites and active user fixes
* Invite changes
* Subscriptions
* Fixed subscription tests
* corrected nullability of projectinput
* removed unused mutation responses
* format
---------
Co-authored-by: Alan Rynne <alan@rynne.es>
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* Hides ObjectPool dependency
* fmt
* Use the 1.0 BCL async to try to be more compatible
* rename to dependencies
* Move Polly to internal dependencies
* format
* remove more old references
* remove stackchannel
* fixes for registration
* remove console writeline
* add cache check shortcut for root object
* recevie2 benchmark
* add test for deserialize new
* Use same asyncinterfaces as Dynamo. Merge fixes
* clean up
* fix download object progress
* add channels
* Use net48, netstandard2.1 and net8
* need AsyncInterfaces for net48 :(
* options changes
* revert to netstandard2.0 and net8.0
* fix totals
* revert httpcontext changes
* format
* add active tasks collection
* format
* remove more changes and remove unused method
* remove more comment changes
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* Hides ObjectPool dependency
* fmt
* Use the 1.0 BCL async to try to be more compatible
* rename to dependencies
* Move Polly to internal dependencies
* format
* remove more old references
* remove stackchannel
* fixes for registration
* remove console writeline
* add cache check shortcut for root object
* recevie2 benchmark
* add test for deserialize new
* Use same asyncinterfaces as Dynamo. Merge fixes
* clean up
* fix download object progress
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
* Use a stack channel for deserialization
* multi-threaded
* add object dictionary pool
* more pooling
* adjust sqlite transport
* format
* Optimize IsPropNameValid
* object loader first pass
* save test
* add cache pre check
* save better deserialize
* mostly works
* uses tasks but slower at end
* rework to make more sense
* add check to avoid multi-deserialize
* modify max parallelism
* async enqueuing of tasks
* switch to more asyncenumerable
* fmt
* fmt
* cleanup sqlite
* make ServerObjectManager
* revert change
* add ability to skip cache check
* cache json to know what is loaded
* testing
* clean up usage
* clean up and added new op
* Fix exception handling
* fixing progress
* remove codejam
* remove stackchannel
* remove console writeline
* add cache check shortcut for root object
* recevie2 benchmark
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
* initial burn
* fix: Minor fixes, some pending
* fix: Minor fix + DeepClean target
* setup things to be injected
* things compile and activites are instanced
* compiles except tests
* tests compile
* fmt
* fix merge
* Activities are now an interface
* fmt
* fully remove logging DLL
* clean up
* fix tests
* more cleanup
* Fix integration tests
* clean up hash tests
* clean up path provider
* more cleanup for path
* merge fixes
* Merge fixes
* remove some extra classes
---------
Co-authored-by: Alan Rynne <alan@speckle.systems>
* Sdk
* Objects
* Supressed IDE warnings via editor config instead of nowarn
* Nullability and other warnings
* using
* Required keyword on lines and meshes
* Fixed test project
* fixed tests
* Proxies
* Fixed equality of Point
* IEquatable
* Fixed issue with serialization of detached lists
* Added tests for jsonIgnore affecting id calc
* removed comments
* Fixed issue with fallback to double on large values
* Fixed undocumented large number support
* Fixed issue with serialization of detached lists
* Added tests for jsonIgnore affecting id calc
* use extra writer and pass tests
* avoid returning extra object
* fix tests
* Add span overload back
* fmt
---------
Co-authored-by: Jedd Morgan <45512892+JR-Morgan@users.noreply.github.com>
* Sha256 hash with spans
* HashData
* NumericFormat
* Tests
* md5 test
* xml
* use utf16 encoding rather than utf8
---------
Co-authored-by: Alan Rynne <alan@rynne.es>
* Use Concurrent Dictionaries and ignore case on them to avoid ToLower
* remove single array allocation
* allocate GetClosures differently
* Use JsonReader for closures
* add comment
* use isdefined
* more readonly with less allocations
* sorts
* fmt
* use element type when making an array
* first pass
* Fix reading for object and array
* serialization works?
* Fix closure parsing
* things are way faster
* Deserialize is async
* fmt
* renames
* remove deserialize threads
* fmt
* faster to use ordinal compare
* serialization looks okay
* fix closure writing
* fixes
* use possibly different values for compute id
* use closure parser on download
* memory test for blobs
* decompose serialization
* fmt
* fmt
* for decomposing, values should be used instead of original
* set id after computing it
* redo more closure parsing
* fix memory test
* don't throw on try get deserialized
* fmt
* fix integration tests
* fix tests
* disable memory blob storage by default
* put back ?
* merge fixes and delete worker threads
* fmt
* serialization of old floats pass
* serialization of old floats pass
* rename class
* Use async/await on GetObject
* await deserialization
* fmt
* uncomment and fix tests
* don't allow things to exist in the closure table that doesn't exist
* detach blob tests
* rename serializer
* async more correct
* revert
* fix merge
* fix blob tests again
* more fixes
* Fix building
* async fixes
* more async fixes
* fix tests?
* rename GetId to GetIdAsync
* clean up
* more cleanup
* fmt
* fix test
* fix analyzer errors
* use ConcurrentDictionary to be thread safe
* Sdk
* Objects
* Supressed IDE warnings via editor config instead of nowarn
* Nullability and other warnings
* using
* Fixed warnings
* Important fix
* More fixes
* Use Concurrent Dictionaries and ignore case on them to avoid ToLower
* remove single array allocation
* allocate GetClosures differently
* Use JsonReader for closures
* add comment
* use isdefined
* more readonly with less allocations
* sorts
* fmt
* use element type when making an array
* first pass
* Fix reading for object and array
* serialization works?
* Fix closure parsing
* things are way faster
* Deserialize is async
* fmt
* renames
* remove deserialize threads
* fmt
* faster to use ordinal compare
* serialization looks okay
* fix closure writing
* fixes
* use possibly different values for compute id
* use closure parser on download
* memory test for blobs
* decompose serialization
* fmt
* fmt
* for decomposing, values should be used instead of original
* set id after computing it
* redo more closure parsing
* fix memory test
* don't throw on try get deserialized
* fmt
* fix integration tests
* fix tests
* disable memory blob storage by default
* put back ?
* merge fixes and delete worker threads
* fmt
* serialization of old floats pass
* serialization of old floats pass
* rename class
* uncomment and fix tests
* don't allow things to exist in the closure table that doesn't exist
* detach blob tests
* rename serializer
* revert
* fix blob tests again
* progress intermediate commit
* add progress for download
* remove unused code
* remove batch sent callbacks
* multi-threaded deserialize works
* Progress for download and deserialization
* Fix tests
* Have less indeterminate deserialization
* fix deserialization
* make download faster with buffered stream
* put local receive back
* remove unused callback
* fmt
* Progress for serialization and upload
* fix uploading
* clean up from progress
* merge fixes and fmt
* LongSendTest
* Moved to separate project
* Server transport throws early
* raised timeouts
* Use poly for timeout
* Cleaned up some of the AsyncPolicy construction
* GraphQL Client back to 30 second timeout
Adam Hathcock