Commit Graph

200 Commits

Author SHA1 Message Date
Tom Kralidis 1c87e0005b move items startindex to offset 2022-03-08 14:51:53 -05:00
Tom Kralidis 76fd56a671 fix OAProc relation types (#846)
* [OAProc]: fix relation types (#845)

* [OAProc]: fix relation types (#845)
2022-01-25 06:42:09 -05:00
Tom Kralidis 5d072f4efa OAProc updates (#840)
* update OAProc jobs as a top-level resource (#838)

* update config

* update copyright year
2022-01-04 08:43:39 -05:00
Tom Kralidis 3e6ac1eea9 fix off by one error in ES provider (#839)
* fix off by one error in ES provider

* fix tests
2022-01-03 09:57:49 -05:00
Tom Kralidis 1b508c77cd support antimeridian bbox cases (#837) 2022-01-03 08:25:37 -05:00
Tom Kralidis aa8eee662c fix float detection for ES provider (#836)
* fix float detection for ES provider

* fix float detection for ES provider

* fix typo
2021-12-26 20:14:43 -05:00
James Robinson eb891010b7 Add support for materialised views to postgres provider (#827) 2021-12-07 18:00:08 -05:00
James Robinson 3969fc0b19 Add support for config file properties to PostgreSQL provider (#829)
* 🐛 Add support for the properties keyword from the config file

* 🚨 Fixed flake8 errors

*  Added a test for config properties
2021-12-06 07:58:39 -05:00
Tom Kralidis 0ae95cb554 fix OACov subset parsing (#818) 2021-11-22 07:04:58 -05:00
Tom Kralidis fca8974432 [OACov] rename rangeSubset to range-subset for coverage queries (#816) 2021-11-19 09:25:13 -05:00
Tom Kralidis 91abdb9f8d update OACov content models (#809) (#813) 2021-11-11 08:35:58 -05:00
Benjamin Webb 205ff3002c Add Gzip to response types (#795)
* Add gzip to API.py

* pytest for gzip

* fix pytest

* Update test_api.py

* Add gzip to server block of configuration files

* Update api.py to include gzip opts from config

Update logic behind gzip compression  such that compression will only happen when gzip in the Accept-Encoding request header and config.server.gzip is True. Use server charset for encoding/decoding and include charset in Content-Type when compressed.

* Update pytest to use gzip config options

Update pytest to test with (gzip in Accept-Encoding & server.gzip = False), (gzip in Accept-Encoding & server.gzip = True), (gzip not in Accept-Encoding & server.gzip = True)

* Better Content Negotiation (#7)

* Change content negotiation in _get_format()

* Add to pytest and force h to always be string

* Force F_JSON to default response

* Update test_api.py for utf-16 encoding

* better content negotiation pytest.

* Add comments to pytest

* Fix flake 8

* Improve docstring for gzip decorator function
2021-10-27 20:17:02 -04:00
Tom Kralidis 4b85a6a8eb detect exact match for ES property queries (#793)
* detect exact match for ES property queries

* detect exact match for ES property queries

* update tests
2021-10-11 20:21:44 -04:00
Tom Kralidis 7b34101b7a make TinyDB q= queries case-insensitive (#792)
* make TinyDB q= queries case-insensitive

* make TinyDB q= queries case-insensitive

* optimize nocase tests

* optimize nocase tests
2021-10-06 08:39:11 -04:00
Benjamin Webb 361d28c6ac Sensorthings API Provider Patch (#789)
* return correct limits & faster hits query

* Fix hits behavior (and break pytest)

* fix pytest for sensorthings provider

* check before unpacking properties

* add q string

* enclose id in single quotes for entities with non-literal id values

* Undo accidental branch merging

* Undo other part of accident branch merging

* add uri_field to config schema

* Remove uri_field from schema for config file
2021-10-04 11:05:16 -04:00
Tom Kralidis 16648ecb48 add queryable support for CSV and GeoJSON providers (#555) (#786) 2021-09-26 20:25:27 -04:00
Benjamin Webb a54fd6a908 Add postgres provider query parameters (#784)
* Add sortby, skip_geometry, and select_properties

* some pytest fixes

* Update main.yml

* Update main.yml

* fix geom in response feature

* more pytest fixes

* Update postgresql.py

* Update test_postgresql_provider.py

* Update test_postgresql_provider.py

* Add to docs, fix pytest

* fix for when when 'name' = None

* Update test_postgresql_provider.py

* Update test_postgresql_provider.py

* Remove optional comparator

* use secrets with default password

* Add secret to load postgres data
2021-09-25 07:03:38 -04:00
Sander Schaminee d2d5ce794a Language structs (dicts) must consist of valid locale keys only (#769) 2021-09-19 00:30:20 +02:00
Tom Kralidis 13926977a2 Merge pull request #774 from webb-ben/sta-patch
small SensorThings provider patches
2021-09-13 18:24:45 -04:00
Tom Kralidis 56411f7327 update to latest OARec metadata model updates 2021-09-13 13:36:53 -04:00
Benjamin Webb 07a23928ff Update test_sensorthings_provider.py 2021-09-09 13:52:21 -04:00
Tom Kralidis 70edc3c0f2 update TinyDB q= support for multiple terms (#765) 2021-08-26 16:30:46 -04:00
Tom Kralidis 6dcd10b10a test for item prev and next links on item queries (#752) (#757) 2021-08-25 06:34:39 -04:00
Tom Kralidis bc97ed480a add geometry to queryables (#755) 2021-08-22 08:28:56 -04:00
Tom Kralidis 9d920901b5 update OAProc execute handling (#754)
* fix OAProc default output to raw

* control outputs list from api machinery

* fix tests
2021-08-18 15:28:55 -04:00
Francesco Bartoli c5942f7a13 Fix time format in cite configuration (#748) 2021-08-02 07:27:48 -04:00
Tom Kralidis 5359789f13 fix OARec test data (#745)
* fix OARec test data

* fix TinyDB bbox handling

* add missing OACov conformance test
2021-07-23 14:50:34 -04:00
Tom Kralidis 914756666c OARec bbox should be two arrays, not three (#744) 2021-07-23 13:39:39 -04:00
Benjamin Webb 3efa041c54 Patch SensorThings API Tests (#737) 2021-07-22 19:11:25 -04:00
Jo cf4517c1c2 - update the script that loads data to ES, to support data encoded with utf8 (#742) 2021-07-22 19:10:38 -04:00
Tom Kralidis 00a08e05ba update OAProc content models (#735) 2021-07-22 15:13:09 +02:00
Francesco Bartoli cdc4f98090 Fix OAProc conformance classes (#736)
* Fix OAProc conformance classes

* Fix conformance test
2021-07-22 09:06:47 -04:00
Francesco Bartoli bb4cd0bf69 Add cql-json support for ES (#723)
Fix starlette event loop


Fix starlette event loop


Fix starlette event loop


Fix starlette event loop


Fix provider regression


Make method public


Make method public


Move function to the helpers utility


Add the CQL lifecycle for development


Add CQL docs


Fix flake8


Isolate import for starlette codepath
2021-07-21 21:00:14 -04:00
Tom Kralidis f01dfd38a7 fix response for non-existent collections (#722) (#730) 2021-07-20 09:41:59 +02:00
Ari Pollak d4f2b74505 Make FileSystem tests a bit more detailed (#727) 2021-07-19 22:08:44 -04:00
Benjamin Webb 8f8d19c5f8 Sensorthings API Provider (#721)
* Create sensorthings.py

* Update plugin.py

* Add files via upload

* Update sensorthings.py

* Add files via upload

* Update sensorthings.py

* Update sensorthings.py

* Update sensorthings.py

* Update sensorthings.py

* Update sensorthings BRGM Endpoint

* Clean Examples

* Cleaned sensorthings config

* add bbox and datetime query params

Added optional intralinking between STA entities

* add pytest for sta provider

* add sta pytest to workflow

* improve versatility of intralink and uri

* Update Datastreams geometry provider

* Update iow.sta.pygeoapi.config.yml

* faster hits using sta $count

* fix flake8

* added sta provider for github actions

* type in main.yml

* Update main.yml

* Update main.yml

* rename tests/data/datastreams.json

* Update main.yml

* Update load_sta_data.py

* Update load_sta_data.py

* Update load_sta_data.py

* Update load_sta_data.py

* Update load_sta_data.py

* Fix sta pytest

* fix flake8

* Update docs

* Update test_sensorthings__provider.py

* Merge various fixes from sta-patch-1

* force sorting

* Move STA data to remote host

* Clarify use of the intralink field

* rename test_sensorthings_provider.py

* Add Readme.md and switch to docker-compose

* Sensorthings -> SensorThings
2021-07-06 17:04:45 -04:00
Tom Kralidis 89eff49ce0 add support for configuration schema and validation (#553) (#719)
* add support for configuration schema and validation (#553)

* rename types

* minor doc fix

* update i18n regexes

* make openapi click options required arguments
2021-07-06 17:01:05 -04:00
Tom Kralidis 167281ee83 add support for OpenAPI rendering via ReDoc (#414) (#720)
* add support for OpenAPI rendering via ReDoc (#414)

* add support for OpenAPI rendering via ReDoc (#414)
2021-06-30 11:11:57 -04:00
Tom Kralidis 7ecac02693 add support for OpenAPI validation (#717) (#718)
* add support for OpenAPI validation (#717)

* update copyright years

* fix ES ref

* update CLI
2021-06-29 08:48:22 -04:00
Kyle Onda 37b1e9553b add geometry representations for json-ld output format (#689)
* Update linked_data.py

* Update linked_data.py

Added schema:geoShape to geojsonld = false

* Update linked_data.py

* Update linked_data.py for rebasing

* Update linked_data.py

* Update configuration.rst

* Update linked_data.py for geosparql geometry

* Add files via upload

* Update test_api.py

* Update test_api.py

* Update linked_data.py logic

* Add pytest for more geometry types

* Update test_util.py

* rename geojson2geojsonld, separated geom2schemageo

* Add pytest for polygon and linestring

* Update expanation of uri_field

Co-authored-by: Benjamin Webb <40066515+webb-ben@users.noreply.github.com>
Co-authored-by: Benjamin Webb <bmwebb20@colby.edu>
2021-06-17 19:00:35 -04:00
Tom Kralidis 989dfb6d30 fix Coverage output and format exception MIME type (#712)
* fix Coverage output and format exception MIME type

* Minor tweaks, added test to assert that a text/html header (without 'f' query param) returns JSON for get_collection_coverage()

Co-authored-by: Sander Schaminee <sander.schaminee@geocat.net>
2021-06-10 19:47:21 -04:00
Sander Schaminee 8f3e5c2ad7 Simplify API tests (#707) 2021-06-09 06:10:10 -04:00
Sander Schaminee 023f24d26b Multilingual support (alternative) (#664)
* Created localization (l10n) module + tests. Added l10n support to API and plugins (wip).

* Big refactor:

* All routed API methods are now decorated by @pre_process (consistency) and no longer have a headers+format argument but a request argument (**kwargs also removed)
* The pre_process decorator turns an incoming Flask/Starlette request into a generic APIRequest instance
* The new APIRequest class extracts all relevant info (params, data, locale, etc.) from the request and exposes them as properties
* Removed a lot of boilerplate (i.e. format checking) and wrapped that into methods
* Updated server-specific API calls in each route method (pass entire request object, not headers and query params)

* Several improvements and fixes:

* Updated OpenAPI page with "l" query param
* Added example translations (metadata)
* Changed plugin signature: added explicit locale attribute (instead of **kwargs)
* Moved locale processing to get_plugin_locale() function in l10n module
* API should pass raw requested locale to plugins, locale should always be set
* Fixed API tests and added APIRequest tests
* Prepared utils.py for Jinja2 i18n extension
* Rebased on commit b40297a8 and fixed compatibility with #661 and #662

* Updated documentation for language support

* Rebased and fixed compatibility with PR #658:

* Fixed EDR provider signature (added locale)
* Fixed EDR API routes and query function (and improved parameter-name handling)
* Fixed EDR tests

* Translate entire config in render_j2_template for requested locale:

* Added new translate_dict function to l10n module (+ tests)
* Updated all render_j2_template calls with locale parameter
* Updated pygeoapi-test-config.yml with some language structs

* Minor improvements

* support both 'language' and 'languages' property in server config and provider definitions
* renamed and modified translate_dict() to more generic translate_struct() function (l10n module)
* remove Content-Language header from provider responses if provider has no language support and format is json(ld)
* updated tests

* Leave provider locale handling to API

* Moved code to determine locale from providers to API class (and remove for formatters and processes)
* Removed locale parameter from plugin __init__ signatures
* Removed locale parameter from load_plugin()
* Added **kwargs to provider implementations for get, query, get_metadata, get_coverage_domainset and get_coverage_rangetype method signatures
* Added language=<locale> to all API calls to provider get, query, get_metadata, get_coverage_domainset and get_coverage_rangetype methods

* Use 'lang' instead of 'l' as language query parameter

* Updated Open API
* Updated documentation
* Fixed tests

* Implemented requested PR changes:

* Added usage examples to the APIRequest docstring
* Removed language support from coverage functions
* Updated plugins.rst and language.rst to match new behavior
* Removed language struct from resource links in pygeoapi-config.yml
* Rebased on latest master (fixed test_api.py)

* Rebased and applied fixes:

* Data property in APIRequest now is an awaitable attribute (fixed for Starlette compatibility)
* Named references to 'l' parameter to 'lang'

* Final changes/improvements:

* Make sure that Content-Language is always set;
* Added more tests to ensure that the default language returned is the first configured language (if no language was requested by the user);
* Updated docs;
* Replaced re-occuring strings with constants in api.py;
* Fixed Flake8 checks.

* add missing async to starlette routes (#704)

Co-authored-by: Tom Kralidis <tomkralidis@gmail.com>
2021-06-08 18:46:35 -04:00
Tom Kralidis d92f8012d1 update OARec metadata models per spec changes (#701) 2021-05-31 18:27:53 -04:00
Tom Kralidis ac7098aab5 update OATiles conformance classes (#692) 2021-05-27 08:38:06 -04:00
Tom Kralidis a4bf35d310 implement STAC 1.0.0-rc.2 improvements (#679) 2021-04-27 19:52:28 -04:00
Tom Kralidis 3f248a5c42 fix datetime window validation (#666) (#671) 2021-03-30 06:21:11 -04:00
Tom Kralidis 43b6165fa9 EDR: s/parameters/parameter-names/ (#667) 2021-03-26 09:58:46 -04:00
Tom Kralidis b40297a864 handle datetime errors in config (#659) (#661) 2021-03-18 06:25:39 -04:00
Tom Kralidis 951a1fb486 implement OGC EDR API (#658)
* implement OGC EDR API
* add docs/tests
* fix tests
2021-03-15 17:37:40 +02:00