7c6993719d
* OGC API - Features Part 2 (groundwork+CRS-BBOX) from PR #1155 - contributes to issue #1128 * #1128 provide conformance class for OAPIF Part 2 in /conformance page * #1128 bitten by flake8... * #1128 configurability CRS Feature Providers with syntax, defaults and tests * #1128 configurability CRS Feature Providers refine for default values * #1128 display supported CRSs in HTML Collection template * #1128 config, mmetadata and tests for storageCRS and storageCrsCoordinateEpoch * #1128 WIP for bbox-crs parameter support * #1128 utility function and tests for default/mandatory supprted CRS list * #1128 default supported CRS adaptation to OAPIF Part 2 standard * #1128 grr flake8 whitespace * #1128 start adding full API tests OGR for bbox-crs and crs parms * #1128 fix flake8 * #1128 fix flake8 - install GDAL in workflow main for OGR tests * #1128 fix flake8 - install GDAL in workflow main for OGR tests - need pip package? * #1128 fix flake8 - install GDAL in workflow main for OGR tests - using libgdal-dev gdal-bin * #1128 fix SensorThings test for main.yml Workflow * #1128 fix SensorThings test for main.yml Workflow nr 2 * #1128 make all OGR tests working again * #1128 make all OGR tests working again - flake8 * #1128 make all OGR tests working again - GeoSolutions WFS bbox * #1128 #1155 add documentation for OGC OAPIF Part 2 CRS CRS BBOX support * #1128 #1155 refine documentation for OGC OAPIF Part 2 CRS CRS BBOX support * #1128 #1155 refine documentation to align with #1149 * #1128 #1155 rework from review OAS and pygeoapi config schema * #1128 #1155 minor: compile Re for CRS URI only once as global var * #1128 merge in changes from PR #1173 - fix missing import * WIP Ogcapi features part 2 - Support for crs query parameter (#1149) * feat(ogcapi_features_crs): start implementing crs support from ogcapi features part2 * Pass input and output CRSs WKT instead of crs transformation object * fix longs lines and blank lines * fix typo * fix import for type annotation not supported by python version * fix variable visibility in local scope * fix tabs/spaces indentations * Add support for the crs parameter to OGRProvider * make flake8 happy * Make crs transformation mechanism more consistent between PostgreSQL and OGR providers * test(util): add two test functions in util.py New functions: test_get_crs_from_uri and test_get_transform_from_crs * fix too long lines... * Update get_crs_from_uri and corresponding test function * fix(get_crs_from_uri): make the error more explicit in if wrong crs uri format * flake8 again... * Keep support for source_srs/target_srs in config for OGRProvider * revert changes made to pygeoapi-config-0.x.yml, overlap with PR 1155 * test: add test data and update test config file * Extract 'crs' and 'storage_crs' and provider level instead of collection level * feat(crs): new decorator to support coordinates transformation of feature collections * feat(crs): 'crs' query parameter for CSVProvider * test(crs): add tests for 'crs' query parameter * test: update number of collections in test_describe_collections * test: update number of collections in test_filter_dict_by_key_value * fix(crs_transform): change the crs transformation decorator Change the logic of the decorator so that it works for both functions that return FeatureCollections and for functions tha return single Features. * test: add tests for get_collection_item end-point with 'crs' parameter * fix(test_get_collection_item_crs): id as path parameter, not query parameter * test: unpack coordinates to create point geometry * feat(crs): add suuport for crs query parameter for all providers of type 'feature' * docs(crs): add documentation to illustrate use of 'crs' query parameters * docs(crs): more data access examples * fix typo and add new line * refactor: specify None as default value for crs_transform_out parameter in _sqlalchemy_to_feature method * changes for PR 1149, test_api and style formatting * CRS84 as default crs also for test_get_collection_items_crs * test(crs): test coordinates transformation implementation of PostgreSQLProvider * test(crs): move tests to test_postgresql_provider * fix test function calls * change test to ensure returned features are the same * add json format to request object * test(crs): test coordinates transformation implementation of OGRProvider * refactor(crs): make more compact get_collection_item and get_collection_items Define two new static methods in API class, to create crs_transform_wkt and setting content-crs header. These methods can be re-used in both get_collection_item and get_collection_items methods and removes code duplication. --------- Co-authored-by: Just van den Broecke <just@justobjects.nl> * #1178 fix flake8 error * #1178 use EPSG:28992 i.s.o. 32631 - fix unit test OGR Shapefile * #1174 use CRS-compliant Axis ordering for crs support * #1174 fix and honour CRS 4258disable native CRS Transform in OGR Provider - Axis ordering not honoured... * #1174 remove ADR tests rom test_util.py * #1174 enable native CRS transform again in OGR Provider * #1174 enable native CRS transform again in OGR Provider - fix config * #1174 remove support for source/target_srs in OGRProvider - enforce transforms always based on storageCRS * #1174 fix tests Postgresql Provider for Transforms * #1174 fix tests Postgresql Provider for Transforms * #1174 add tests for OGR Transformation and Axis Order * #1174 Suppress potential axis-swapping in OGR ExportToJSON * #1174 minor fix test - unassign spatialref before setgeom infeat * #1174 minor fix test - unassign spatialref before setgeom infeat - flake8 * #1174 solve CI WFS test failures with GDAL HTTP config options * #1174 bbox and bbox-crs defs local in openapi.py for CITE validators * #1174 merge master - #1152 #1203 etc * #1174 small doc changes * #1174 move GeomObject typedef to beginning of util.py * #1174 added debug logging in transform Decorator func --------- Co-authored-by: Mathieu Tachon <92298764+MTachon@users.noreply.github.com>
Test Data
This directory provides test data to demonstrate functionality.
Sources
ne_110m_lakes.geojson and tiles/ne_110m_lakes
- source: Natural Earth Lakes + Reservoirs
- URL: https:/naturalearthdata.com/downloads/110m-physical-vectors/110mlakes-reservoirs/
- Shapefile converted to GeoJSON. Tiles created with tippecanoe
- Made with Natural Earth. Free vector and raster map data @ naturalearthdata.com
ne_110m_admin_0_countries.sqlite
- source: Natural Earth Admin 0 - Countries
- URL: https://naturalearthdata.com/downloads/110m-cultural-vectors/110m-admin-0-countries/
- Shapefile converted to SQLite
- Made with Natural Earth. Free vector and raster map data @ naturalearthdata.com
ne_110m_populated_places_simple.geojson
- source: Natural Earth Populated Places
- URL: https://naturalearthdata.com/downloads/110m-cultural-vectors/110m-populated-places/
- Shapefile converted to GeoJSON
- Made with Natural Earth. Free vector and raster map data @ naturalearthdata.com
obs.csv
- source: MapServer msautotest suite
- URL: https://github.com/mapserver/mapserver/blob/branch-7-0/msautotest/wxs/data/obs.csv
- Copyright (c) 2008-2018 Open Source Geospatial Foundation
- Copyright (c) 1996-2008 Regents of the University of Minnesota
station_list.csv
- source: wis2box test data
- URL: https://github.com/wmo-im/wis2box/blob/main/tests/data/metadata/station/station_list.csv
- License: https://github.com/wmo-im/wis2box/blob/main/LICENSE
poi_portugal.gpkg
- source: OpenStreetMap - Natural GIS
- URL: https://naturalgis.pt/cgi-bin/opendata/mapserv?service=WFS&request=GetCapabilities
- Data obtained from WFS instance of NaturalGIS company (https://naturalgis.pt/en/) and converted to geopackage
- Upstream data from OpenStreetMap extract for Portugal
hotosm_bdi_waterways.sql.gz
- source: OpenStreetMap - Humanitarian OpenStreetMap Team (HOT)
- URL: hotosm_bdi_waterways
- Waterways of Burundi
- Date of dataset: Sep 01, 2018
- Location: Burundi, Africa
CMC_glb_*.grib2
- source: Meteorological Service of Canada Datamrt
- URL: https://dd.weather.gc.ca/model_gem_global/15km/grib2/lat_lon/00/000
- License: https://eccc-msc.github.io/open-data/licence/readme_en
CMIP5_rcp8.5_annual_abs_latlon1x1_PCP_pctl25_P1Y.nc
- source: Canadian Centre for Climate Services
- URL: https://dd.weather.gc.ca/climate/cmip5/netcdf/scenarios/RCP8.5/annual/absolute/CMIP5_rcp8.5_annual_abs_latlon1x1_PCP_pctl25_P1Y.nc
- License: https://eccc-msc.github.io/open-data/licence/readme_en
coads_sst.nc
- source: NOAA Physical Sciences Library
- URL: https://psl.noaa.gov/data/gridded/data.coads.1deg.html
- License: ICOADS data provided by the NOAA/OAR/ESRL PSL, Boulder, Colorado, USA, from their Web site at https://psl.noaa.gov.
analysed_sst.nc
- source: NASA Physical Oceanography Distributed Active Archive Center
- URL: https://registry.opendata.aws/mur
- License: https://registry.opendata.aws/mur/#License
open.canada.ca/sample-records.tinydb
- source: Open Data Canada
- URL: https://csw.open.canada.ca/geonetwork/srv/csw?service=CSW&version=2.0.2&request=GetRecords&outputschema=http://www.isotc211.org/2005/gmd&resulttype=results (2021-02-18)
- License: https://www.canada.ca/en/transparency/terms.html
- Notes
- ISO records transformed to OGC API - Records GeoJSONs with
tests/load_tinydb_records.py
- ISO records transformed to OGC API - Records GeoJSONs with
dutch_addresses_*
- source: Dutch Kadaster
- URL: https://geodata.nationaalgeoregister.nl/inspireadressen/wfs?request=GetCapabilities&service=wfs (discontinued, see below)
- License: CC0 1.0 https://creativecommons.org/publicdomain/zero/1.0/deed.nl
- Notes
- above WFS was switched off in June 2022
- address-records derived by Kadaster from the Dutch "Buildings and Addresses" key registry (BAG)
- WMS is still available: https://service.pdok.nl/kadaster/adressen/wms/v1_0?request=GetCapabilities&service=WMS
- raw dataset BAG (GML, about 2GB) can always be downloaded via the Atom Feed
items.geojson
- source: Wikipedia
- URL: https://en.wikipedia.org/wiki/GeoJSON#Geometries
- License: CC0 3.0 https://creativecommons.org/licenses/by-sa/3.0/
- Notes
items.geojsontests pygeoapi's capability to serialize all geometry types for individual collection items in JSON-LD formats, including GeoSPARQL WKT and schema.org/geo- The features represent the range of GeoJSON geometry types, instead of real locations. Additionally, each feature has a uri defined in the properties block