* - Refactor MVTProvider, to support subclassing
- Added provider for MVT Tippecanoe
* - fixed test configuration for the MVT tippecanoe provider
* - added MVT elastic provider
* - added documentation for mvt providers
- fixed formatting
* - removed tiles publishing from elastic provider example
- updated gitignore to ignore data folder from elastic example
* - added docker example for MVT-elastic backend provider
* - Added docker example for tippecanoe MVT provider
* - updated README of the docker examples section, to catch up with the provided examples.
* - renamed mvt-elastic and mvt-tippecanoe docker example folders.
* - renamed elastic and tippecanoe folders to lower case
* - fixed formatting issue
* - s/Mabox/Mapbox/
* - put plugin provider names in single line
* - renamed MVT provider base class to BaseMVTProvider.
* - added MVT base class
* - reviwed uppercase on .gitignore
- add folder to .gitignore
* - removed new line and brackets
* - removed redundant line with base class
---------
Co-authored-by: doublebyte1 <info@doublebyte.net>
* commented elastic ports in example docker-compose and added warning about opening ports in production
* commented elastic ports in example docker-compose and added warning about opening ports in production
* Update README (issue #1374): Add descriptions for configuration files and fix broken links
* Fix README based on feedback #1376 from issue #1374
* Update README title for better clarity.
* Update the README title while addressing the suggestion.
ERROR: The Compose file './docker-compose.yml' is invalid because:
services.elastic_search.environment contains an invalid type, it should be an object, or
an array
(pygeoapi)
Co-authored-by: doublebyte1 <info@doublebyte.net>
* OGC API - Features Part 2 (groundwork+CRS-BBOX) from PR #1155 - contributes to issue #1128
* #1128 provide conformance class for OAPIF Part 2 in /conformance page
* #1128 bitten by flake8...
* #1128 configurability CRS Feature Providers with syntax, defaults and tests
* #1128 configurability CRS Feature Providers refine for default values
* #1128 display supported CRSs in HTML Collection template
* #1128 config, mmetadata and tests for storageCRS and storageCrsCoordinateEpoch
* #1128 WIP for bbox-crs parameter support
* #1128 utility function and tests for default/mandatory supprted CRS list
* #1128 default supported CRS adaptation to OAPIF Part 2 standard
* #1128 grr flake8 whitespace
* #1128 start adding full API tests OGR for bbox-crs and crs parms
* #1128 fix flake8
* #1128 fix flake8 - install GDAL in workflow main for OGR tests
* #1128 fix flake8 - install GDAL in workflow main for OGR tests - need pip package?
* #1128 fix flake8 - install GDAL in workflow main for OGR tests - using libgdal-dev gdal-bin
* #1128 fix SensorThings test for main.yml Workflow
* #1128 fix SensorThings test for main.yml Workflow nr 2
* #1128 make all OGR tests working again
* #1128 make all OGR tests working again - flake8
* #1128 make all OGR tests working again - GeoSolutions WFS bbox
* #1128#1155 add documentation for OGC OAPIF Part 2 CRS CRS BBOX support
* #1128#1155 refine documentation for OGC OAPIF Part 2 CRS CRS BBOX support
* #1128#1155 refine documentation to align with #1149
* #1128#1155 rework from review OAS and pygeoapi config schema
* #1128#1155 minor: compile Re for CRS URI only once as global var
* #1128 merge in changes from PR #1173 - fix missing import
* WIP Ogcapi features part 2 - Support for crs query parameter (#1149)
* feat(ogcapi_features_crs): start implementing crs support from ogcapi features part2
* Pass input and output CRSs WKT instead of crs transformation object
* fix longs lines and blank lines
* fix typo
* fix import for type annotation not supported by python version
* fix variable visibility in local scope
* fix tabs/spaces indentations
* Add support for the crs parameter to OGRProvider
* make flake8 happy
* Make crs transformation mechanism more consistent between PostgreSQL and OGR providers
* test(util): add two test functions in util.py
New functions: test_get_crs_from_uri and test_get_transform_from_crs
* fix too long lines...
* Update get_crs_from_uri and corresponding test function
* fix(get_crs_from_uri): make the error more explicit in if wrong crs uri format
* flake8 again...
* Keep support for source_srs/target_srs in config for OGRProvider
* revert changes made to pygeoapi-config-0.x.yml, overlap with PR 1155
* test: add test data and update test config file
* Extract 'crs' and 'storage_crs' and provider level instead of collection level
* feat(crs): new decorator to support coordinates transformation of feature collections
* feat(crs): 'crs' query parameter for CSVProvider
* test(crs): add tests for 'crs' query parameter
* test: update number of collections in test_describe_collections
* test: update number of collections in test_filter_dict_by_key_value
* fix(crs_transform): change the crs transformation decorator
Change the logic of the decorator so that it works for both functions that
return FeatureCollections and for functions tha return single Features.
* test: add tests for get_collection_item end-point with 'crs' parameter
* fix(test_get_collection_item_crs): id as path parameter, not query parameter
* test: unpack coordinates to create point geometry
* feat(crs): add suuport for crs query parameter for all providers of type 'feature'
* docs(crs): add documentation to illustrate use of 'crs' query parameters
* docs(crs): more data access examples
* fix typo and add new line
* refactor: specify None as default value for crs_transform_out parameter in _sqlalchemy_to_feature method
* changes for PR 1149, test_api and style formatting
* CRS84 as default crs also for test_get_collection_items_crs
* test(crs): test coordinates transformation implementation of PostgreSQLProvider
* test(crs): move tests to test_postgresql_provider
* fix test function calls
* change test to ensure returned features are the same
* add json format to request object
* test(crs): test coordinates transformation implementation of OGRProvider
* refactor(crs): make more compact get_collection_item and get_collection_items
Define two new static methods in API class, to create crs_transform_wkt and
setting content-crs header. These methods can be re-used in both
get_collection_item and get_collection_items methods and removes code
duplication.
---------
Co-authored-by: Just van den Broecke <just@justobjects.nl>
* #1178 fix flake8 error
* #1178 use EPSG:28992 i.s.o. 32631 - fix unit test OGR Shapefile
* #1174 use CRS-compliant Axis ordering for crs support
* #1174 fix and honour CRS 4258disable native CRS Transform in OGR Provider - Axis ordering not honoured...
* #1174 remove ADR tests rom test_util.py
* #1174 enable native CRS transform again in OGR Provider
* #1174 enable native CRS transform again in OGR Provider - fix config
* #1174 remove support for source/target_srs in OGRProvider - enforce transforms always based on storageCRS
* #1174 fix tests Postgresql Provider for Transforms
* #1174 fix tests Postgresql Provider for Transforms
* #1174 add tests for OGR Transformation and Axis Order
* #1174 Suppress potential axis-swapping in OGR ExportToJSON
* #1174 minor fix test - unassign spatialref before setgeom infeat
* #1174 minor fix test - unassign spatialref before setgeom infeat - flake8
* #1174 solve CI WFS test failures with GDAL HTTP config options
* #1174 bbox and bbox-crs defs local in openapi.py for CITE validators
* #1174 merge master - #1152#1203 etc
* #1174 small doc changes
* #1174 move GeomObject typedef to beginning of util.py
* #1174 added debug logging in transform Decorator func
---------
Co-authored-by: Mathieu Tachon <92298764+MTachon@users.noreply.github.com>
* Render template if specified in config and provide example config
Update linked_data.py
Merge branch 'geopython:master' into jsonld
Rended from json-ld output
Render jinja2 json-ld template from json-ld output instead of json output
Merge branch 'geopython:master' into jsonld
Add documentation
- Add documentation
- Add test to workflow
Update pygeoapi-test-config.yml
Update test_api.py
Update api.py
Update linked_data.py
Move template declaration in configuration
Update docs
Update configuration.rst
Update configuration.rst
* Updates per requested changes
* Fix spelling
* Fix json-ld template pathing
* Remove root path for the templating
* Move json-ld template from api.py
- Move single item json-ld templating to inside geojson2jsonld
- Reformat json-ld configuration for context and item_template to children of json-ld block
- Update docs and example configurations
* Fix ref
* Use FileSystemLoader to control template search path
search for templates is in order of `template_paths` list
* s/json-ld/linked-data/ig
rename json-ld to more generic name
* docker: upgrade ubuntu version
Upgrade rhe ubuntu version used in the main Dockerfile to latest stable version `20.04`
* Update Dockerfile
amended ubuntu version 20 -> 22
but then the following error:
```
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
Processing triggers for dbus (1.12.20-2ubuntu4.1) ...
gpg: error running '/usr/bin/gpg-agent': probably not installed
gpg: failed to start agent '/usr/bin/gpg-agent': Configuration error
gpg: can't connect to the agent: Configuration error
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/softwareproperties/shortcuthandler.py", line 423, in add_key
PPA publishes dbgsym, you may need to include 'main/debug' component
Repository: 'deb https://ppa.launchpadcontent.net/ubuntugis/ubuntugis-unstable/ubuntu/ jammy main'
Description:
Unstable releases of Ubuntu GIS packages. These releases are more bleeding edge and while generally they should work well, they dont receive the same amount of quality assurance as our stable releases do.
More info: https://launchpad.net/~ubuntugis/+archive/ubuntu/ubuntugis-unstable
Adding repository.
Adding deb entry to /etc/apt/sources.list.d/ubuntugis-ubuntu-ubuntugis-unstable-jammy.list
Adding disabled deb-src entry to /etc/apt/sources.list.d/ubuntugis-ubuntu-ubuntugis-unstable-jammy.list
Adding key to /etc/apt/trusted.gpg.d/ubuntugis-ubuntu-ubuntugis-unstable.gpg with fingerprint 6B827C12C2D425E227EDCA75089EBE08314DF160
subprocess.run(cmd.split(), check=True, input=keys)
File "/usr/lib/python3.10/subprocess.py", line 524, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['gpg', '-q', '--no-options', '--no-default-keyring', '--batch', '--keyring', '/etc/apt/trusted.gpg.d/ubuntugis-ubuntu-ubuntugis-unstable.gpg', '--homedir', '/tmp/tmpjlr98185', '--import']' returned non-zero exit status 2.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/add-apt-repository", line 364, in <module>
sys.exit(0 if addaptrepo.main() else 1)
File "/usr/bin/add-apt-repository", line 357, in main
shortcut.add()
File "/usr/lib/python3/dist-packages/softwareproperties/shortcuthandler.py", line 222, in add
self.add_key()
File "/usr/lib/python3/dist-packages/softwareproperties/shortcuthandler.py", line 425, in add_key
raise ShortcutException(e)
softwareproperties.shortcuthandler.ShortcutException: Command '['gpg', '-q', '--no-options', '--no-default-keyring', '--batch', '--keyring', '/etc/apt/trusted.gpg.d/ubuntugis-ubuntu-ubuntugis-unstable.gpg', '--homedir', '/tmp/tmpjlr98185', '--import']' returned non-zero exit status 2.
````
Removing the ubuntugis PPA build without error - is ubuntugis a requirements? probably Jammy has up-to-date packages for pygeoapi dependencies
* Update Dockerfile
removing ubuntugis PPA
* Update Dockerfile
adding `python3-pytest` and `python3-pyld` dependencies
* Update Dockerfile
* Update Dockerfile
* fixing docker environment with suggested changes
* replace ubuntu version with codename
* Update .dockerignore
* Update Dockerfile
* Update Dockerfile
* Update Dockerfile
* Update entrypoint.sh
skip the SensorThings and other tests that require a local server
Co-authored-by: Just van den Broecke <just@justobjects.nl>
* - Added support to read from a generic url template as vector tile backend.
* - Add support for not rendering the tileset metadata
* - added support for z/y/x vector tile layers
* - fixed formatting issues
* - refactored code to use get_layer function, everywhere we need to parse username
- added a couple of debug statements, to make sure we are getting the layer name
correctly
- added an error for url templates that follow a schema, which is not supported yet
* - Added documentation for tiles provider, to show how to read a generic url
* - fixed formatting issues
* - added example of ES vector tiles in the docker-config of elasticsearch
Co-authored-by: doublebyte1 <info@doublebyte.net>
* fix for issue 989 - get Docker build/push working - try 1
* fix for issue 989 - get Docker build/push working - try 2 - remove tests - new WFS GeoSolutions
* - added missing curl on pygeoapi container (which was triggering errors)
* - upgraded ES to version 8
Co-authored-by: doublebyte1 <info@doublebyte.net>
* - Added missing parameters on the openapi definition of get an observations tile request
* - changed default background map to osm
* Revert "- changed default background map to osm"
This reverts commit 554c065c6699ad6c0585f5c09ce34e746d5b3dc2.
* - Added example with docker containers, for MongoDB data provider
* - attempts
* - switched to use ne_110m_populated_places_simple.geojson as data source
* - updated README
* - updated README
* - added missing mongo-entrypoint.sh
Co-authored-by: doublebyte1 <info@doublebyte.net>
* Add gzip to API.py
* pytest for gzip
* fix pytest
* Update test_api.py
* Add gzip to server block of configuration files
* Update api.py to include gzip opts from config
Update logic behind gzip compression such that compression will only happen when gzip in the Accept-Encoding request header and config.server.gzip is True. Use server charset for encoding/decoding and include charset in Content-Type when compressed.
* Update pytest to use gzip config options
Update pytest to test with (gzip in Accept-Encoding & server.gzip = False), (gzip in Accept-Encoding & server.gzip = True), (gzip not in Accept-Encoding & server.gzip = True)
* Better Content Negotiation (#7)
* Change content negotiation in _get_format()
* Add to pytest and force h to always be string
* Force F_JSON to default response
* Update test_api.py for utf-16 encoding
* better content negotiation pytest.
* Add comments to pytest
* Fix flake 8
* Improve docstring for gzip decorator function
* - Added missing parameters on the openapi definition of get an observations tile request
* - changed default background map to osm
* Revert "- changed default background map to osm"
This reverts commit 554c065c6699ad6c0585f5c09ce34e746d5b3dc2.
* - Added example with docker containers, for MongoDB data provider
* - attempts
* - switched to use ne_110m_populated_places_simple.geojson as data source
* - updated README
* - updated README
Co-authored-by: doublebyte1 <info@doublebyte.net>
* - Added missing parameters on the openapi definition of get an observations tile request
* - changed default background map to osm
* Revert "- changed default background map to osm"
This reverts commit 554c065c6699ad6c0585f5c09ce34e746d5b3dc2.
* - added discovery.type to elasticsearch configuration, to prevent failed bootstrap checks
Co-authored-by: doublebyte1 <info@doublebyte.net>
* - updating ES dockerfile, by adding missing packages and switching to python3
* - joined commands to reduce layers on the docker image
- fixed formatting
- added elasticsearch-dsl
Co-authored-by: doublebyte1 <info@doublebyte.net>
Currently gunicorn is started in the entrypoint as subprocess. This
means that the entrypoint stays as process with PID 1 and eats the
signals that e.g. kubernetes sends to it. Thus when trying to update
the container, kubernetes must terminate the process ungracefully.
See e.g. this resources for a more detailed explanation:
https://hynek.me/articles/docker-signals/
This change replaces the entrypoint-shellscript with gunicorn, such that
signals are directly forwarded to gunicorn, where they are then handled.
One drawback of this approach is that lines after `exec gunicorn` are
not executed anymore. This currently affects `echo "END /entrypoint.sh"`.
A different approach would be to use `tini` to handle the system (see
link above). To do this, we would need to install tini.
* Bump gdal to v3
* Fix query duplicates with bbox for PG
* Add backward compatibility for axis order
* Move travis to bionic dist
Fix gdal version 3 on travis by pinning latest ubuntu unstable release
Fix ubuntugis sources on travis
Remove pinned python gdal version
Add mongodb start
Enable mongod service
Fix package name
Install mongo from official community repos
Add mongo enable and start commands
* Fix wrong axis mapping strategy
Add author
* Move base image to bullseye for docker build
* Fix remaining unchanged places for #364
* Make image size smaller
* Add docker build and cite tests
Fix python version
Move steps after docker build elsewhere
Fix uppercase characters
Fix internal port
Daemonize the run process
* Check logs and run test command from the entrypoint
* Remove the execution of mongo tests for test command
Remove the execution of mongo tests for test command
Fix failed command
* Add delay and move build to install step
Remove grep command for now
Use single quote
Tom Kralidis