* chore(frontend): use bitnami/openresty as base image for frontend Dockerfile
openresty/openresty was not being patched as frequently as we would like, resulting in numerous
vulnerabilities without resolution. bitnami/openresty is being patched more frequently.
Some additional changes were necessary when porting our frontend between these distributions:
- html files are in /app
- nginx.conf is in /opt/bitnami/openresty/nginx/conf/nginx.conf
- envsubst is not available by default in bitnami/openresty and needs to be copied in
- Nginx.conf - we wrap the server block in http block and overwrite root nginx.conf
- using the existing bitnami/openresty nginx.conf as a server block alone causes issues with bitnami/openresty, as bitnami/openresty provides a root nginx.conf which conflicts with directives in Speckle's server block
- we copy the directives from openresty/openresty (which are known to work with Speckle's server block), and apply them alongside Speckle's server block. This creates a new root nginx.conf which we can overwrite the default on the image.
- nginx should use a port available to non sudo/root user, we have selected 8080 instead of previous 80
- need to explicitly output nginx logs to stderr / stdout
Created a readonly root file system on Kubernetes. This requires the following changes:
- emptyDir volumes are mounted in kubernetes to allow bitnami/openresty to write to specific locations
- explicitly include and copy mime.types file to nginx configuration directory
Due to the change to non-privileged port number (8080), the following subsequent changes were required:
- Update 1-click deployment script to match frontend at port 8080
- Updates docker-compose-speckle.yaml file
Co-authored-by: Gergő Jedlicska <gergo@jedlicska.com>
* Added the concept of queries with a minimalistic implementation. Implemented PointQuerySolver which handles occlusion, projection and unprojection of points
* Added and tested the 'Pick' PointQuery operations which works just like an onclick viewer event
* Small fixes and changes to query and point query.
* Better approach on the occlusion query solving by using our universal scene intersection routine
* Tested and fixed occlusion testing for points
* Added optional custom width and height to NDC<->Screen helper functions
* Integrated queries in the frontend. Projection queries replace projecting by hand, and also added occlusion queries as a demonstration
* Added refactor comment
* fix(ifc parser): make sure the commit root object is a Speckle Base
* feat(ifc parser): rename ifc node children prop key to elements to match with connectors
* Some messing around with a virtual plane
* WIP on virtual plane vertex baking
* Added a pass for generating the shadowcatcher texture. Implementation WIP
* PoC for the baked ray traced AO for the shadowcatcher
* WIP on shadowcatcher proper implementation. Removed the shadocatcher pass from the pipeline, and added it as standalone. Implemented the Shadowcatcher class which handles the entire generation process in a centralized way. Added real time parameters in the sandbox so we can see how different configurations work
* Added some more debug funationality. Working on improving vertex level ao calculation
* Dynamic max hit distance calculation for the shadowcatcher
* Added proper AO contribution value calculation and in the process removed the need for specifying a max hit distance
* Implemented explicit materials and shaders for shadowcatcher generation and display
* Proper materials, shaders and blending so that any backround will work correctly
* Added auto corection for texture size for situations where the AO was overly/under saturated.
* Fixed an issue where batches were incorrectly tested. Fixed an issue where blending for existing overlapping transparent surfaces was incorrect
* WIP for render based ao generation
* First draft of detail preserving shadowcatcher
* Improvement that removes over dakened areas
* Weigthed color0 and color1 evenly when extracting color3 from their sum
* Formalized the shadowcatcher and integrated it better with the speckle renderer or anything else it might use it
* Pipeline needs reset after shadowcatcher update
* Added RTE to the virtual plane and shadowcatcher AO generation material. Removed unused library
* Shadowcather now updated with the clipping planes as well as any filters apply, such that only opaque and non clipped scene objects contribute to the shadowcatcher's AO
* Fixed an old issue which makes extended three materials not get their custom uniforms properly updated when they are being used as scene material overrides. Tested shadowcatcher with multiple streams and it works as expected
* Improved plane fringing on streams that manifest it
* Added enabling/disabling shadowcatcher via the light configuration
* Removed unused material and shader. Fixed an issue where pow of negative value would return undefined on some platforms, messing up the final shadowcatcher result
* WIP on better blending for other scene transparent materials
* Changed the way shadowcatcher levels are blended together. Now they are initially added on top of another, then a sigmoid function is used to tone map the final value. This comes as a solution to reducing the very low darks signaled in some streams. On top of data, it also improves general contrast to streams with little surface contact.
* Removed the third shadowcatcher level from blending. It doesn't bring much value and it over-darkens most of the time
* Shadowcatcher is updated when streams are unloaded
* Enabled on-demand rendering of shadowcatcher levels
Co-authored-by: Alex <alex@192-168-0-157.rdsnet.ro>
* Some messing around with a virtual plane
* WIP on virtual plane vertex baking
* Added a pass for generating the shadowcatcher texture. Implementation WIP
* PoC for the baked ray traced AO for the shadowcatcher
* WIP on shadowcatcher proper implementation. Removed the shadocatcher pass from the pipeline, and added it as standalone. Implemented the Shadowcatcher class which handles the entire generation process in a centralized way. Added real time parameters in the sandbox so we can see how different configurations work
* Added some more debug funationality. Working on improving vertex level ao calculation
* Dynamic max hit distance calculation for the shadowcatcher
* Added proper AO contribution value calculation and in the process removed the need for specifying a max hit distance
* Implemented explicit materials and shaders for shadowcatcher generation and display
* Proper materials, shaders and blending so that any backround will work correctly
* Added auto corection for texture size for situations where the AO was overly/under saturated.
* Fixed an issue where batches were incorrectly tested. Fixed an issue where blending for existing overlapping transparent surfaces was incorrect
* WIP for render based ao generation
* First draft of detail preserving shadowcatcher
* Improvement that removes over dakened areas
* Weigthed color0 and color1 evenly when extracting color3 from their sum
* Formalized the shadowcatcher and integrated it better with the speckle renderer or anything else it might use it
* Pipeline needs reset after shadowcatcher update
* Added RTE to the virtual plane and shadowcatcher AO generation material. Removed unused library
* Shadowcather now updated with the clipping planes as well as any filters apply, such that only opaque and non clipped scene objects contribute to the shadowcatcher's AO
* Fixed an old issue which makes extended three materials not get their custom uniforms properly updated when they are being used as scene material overrides. Tested shadowcatcher with multiple streams and it works as expected
* Improved plane fringing on streams that manifest it
* Added enabling/disabling shadowcatcher via the light configuration
Co-authored-by: Alex <alex@192-168-0-157.rdsnet.ro>
* Added a verbose flag in the viewer params. Default is false and it's equivalent to the ERROR level
* Piggybacked the original pointer event into the SelectionEvent
* style(server): fix formatting
* fix(preview-service): fix chromium deps in Dockerfile
* feat(helm chart): expose file uploads disable flag in the helm chart
* fix(helm chart): value name fix
* fix(helm): its values
* style(server): fix formatting
* fix(preview-service): fix chromium deps in Dockerfile
* feat(helm chart): expose file uploads disable flag in the helm chart
* fix(helm chart): value name fix
* Improves error logging
- use pino error logger correctly by passing in error as first argument
* monitor deployment: Filter logging at INFO level and above
* Use structured logging to create parameters for monitoring results
* Add structured logging to obj fileimport service
* Fileimport service, fix and improve logging
- use child logger with additional context where possible
- select appropriate logging level
- fix duplicated context in log statement
* REST endpoints, add context to structured logging and remove same context from message
* Webhook service provides context to bound logger to properly use structured logging
- Pass bound logger containing context to `makeNetworkRequest`
- do not log url, as it may contain a secret (like Discord's webhook urls), instead log the webhook Id
- log error message when network call fails
* upload: make better use of structured logging when recording data
* pino-pretty when in dev or test mode
- pino-pretty configured to send to stderr
* LOG_PRETTY env var
* Silence structured logging during testing
- can not rely on determining the port number by reading from stdout/stderr
- instead we determine which port is free, then create our server on that port
- we then poll that port until the server is ready before commencing tests
* Allow puppeteer to install chromium
* Do not need to install chromium separately
Iain Sproat