Commit Graph

208 Commits

Author SHA1 Message Date
David Bitner 15e7deabed Fix SQL injection vulnerability. Fix bug with schema prefixed tables. (#889)
* Do not use str.format() for database queries. Ensure that pg columns returned respect schema prefix.

* quotes not needed with %s

* use sorted on test array comparison

* linting
2022-04-25 20:37:02 -04:00
Tom Kralidis b132882513 display conformance based on configuration (#888) 2022-04-19 21:37:21 +02:00
Tom Kralidis 356fe1280c add skip_geometry to remaining feature providers (#887)
* skip geometry for SQLite/GPKG backends (#886)

* simplify GKPG

* add for remaining providers, add to doc
2022-04-19 13:44:56 -04:00
Tom Kralidis 36b88e0719 fix map ref for CITE setup 2022-04-16 18:34:23 -04:00
Tom Kralidis 09ad6f8fce Hierarchical collections (#885)
* add support for hierarchical collections

* fix JSON rendering in docs

* fix JSON rendering in docs

* fix tests

* update docs

* update HTML templates with collections path

* fix template error

* add test
2022-04-16 18:26:55 -04:00
Tom Kralidis 7e8496d999 fix ES GeoJSON response when properties= is detected (#878)
* fix ES GeoJSON response when properties= is detected

* ES: use keywords arguments

* fix tests

* fix

* fix
2022-03-31 03:54:52 -04:00
Martin Pontius 12abb81227 Add unit test for tinydb job manager with parallel requests (#872)
* Add unit test for tinydb job manager with parallel requests

* Add source code header

* Fix flake8 issues
2022-03-14 06:25:03 -04:00
Tom Kralidis f17c6936a0 OACov: change coverage range-subset to properties, update conformance classes (#870)
* OACov: change coverage range-subset to properties, update conformance classes

* fix conformance tests
2022-03-10 16:23:49 -05:00
Tom Kralidis 1c87e0005b move items startindex to offset 2022-03-08 14:51:53 -05:00
Tom Kralidis 76fd56a671 fix OAProc relation types (#846)
* [OAProc]: fix relation types (#845)

* [OAProc]: fix relation types (#845)
2022-01-25 06:42:09 -05:00
Tom Kralidis 5d072f4efa OAProc updates (#840)
* update OAProc jobs as a top-level resource (#838)

* update config

* update copyright year
2022-01-04 08:43:39 -05:00
Tom Kralidis 3e6ac1eea9 fix off by one error in ES provider (#839)
* fix off by one error in ES provider

* fix tests
2022-01-03 09:57:49 -05:00
Tom Kralidis 1b508c77cd support antimeridian bbox cases (#837) 2022-01-03 08:25:37 -05:00
Tom Kralidis aa8eee662c fix float detection for ES provider (#836)
* fix float detection for ES provider

* fix float detection for ES provider

* fix typo
2021-12-26 20:14:43 -05:00
James Robinson eb891010b7 Add support for materialised views to postgres provider (#827) 2021-12-07 18:00:08 -05:00
James Robinson 3969fc0b19 Add support for config file properties to PostgreSQL provider (#829)
* 🐛 Add support for the properties keyword from the config file

* 🚨 Fixed flake8 errors

*  Added a test for config properties
2021-12-06 07:58:39 -05:00
Tom Kralidis 0ae95cb554 fix OACov subset parsing (#818) 2021-11-22 07:04:58 -05:00
Tom Kralidis fca8974432 [OACov] rename rangeSubset to range-subset for coverage queries (#816) 2021-11-19 09:25:13 -05:00
Tom Kralidis 91abdb9f8d update OACov content models (#809) (#813) 2021-11-11 08:35:58 -05:00
Benjamin Webb 205ff3002c Add Gzip to response types (#795)
* Add gzip to API.py

* pytest for gzip

* fix pytest

* Update test_api.py

* Add gzip to server block of configuration files

* Update api.py to include gzip opts from config

Update logic behind gzip compression  such that compression will only happen when gzip in the Accept-Encoding request header and config.server.gzip is True. Use server charset for encoding/decoding and include charset in Content-Type when compressed.

* Update pytest to use gzip config options

Update pytest to test with (gzip in Accept-Encoding & server.gzip = False), (gzip in Accept-Encoding & server.gzip = True), (gzip not in Accept-Encoding & server.gzip = True)

* Better Content Negotiation (#7)

* Change content negotiation in _get_format()

* Add to pytest and force h to always be string

* Force F_JSON to default response

* Update test_api.py for utf-16 encoding

* better content negotiation pytest.

* Add comments to pytest

* Fix flake 8

* Improve docstring for gzip decorator function
2021-10-27 20:17:02 -04:00
Tom Kralidis 4b85a6a8eb detect exact match for ES property queries (#793)
* detect exact match for ES property queries

* detect exact match for ES property queries

* update tests
2021-10-11 20:21:44 -04:00
Tom Kralidis 7b34101b7a make TinyDB q= queries case-insensitive (#792)
* make TinyDB q= queries case-insensitive

* make TinyDB q= queries case-insensitive

* optimize nocase tests

* optimize nocase tests
2021-10-06 08:39:11 -04:00
Benjamin Webb 361d28c6ac Sensorthings API Provider Patch (#789)
* return correct limits & faster hits query

* Fix hits behavior (and break pytest)

* fix pytest for sensorthings provider

* check before unpacking properties

* add q string

* enclose id in single quotes for entities with non-literal id values

* Undo accidental branch merging

* Undo other part of accident branch merging

* add uri_field to config schema

* Remove uri_field from schema for config file
2021-10-04 11:05:16 -04:00
Tom Kralidis 16648ecb48 add queryable support for CSV and GeoJSON providers (#555) (#786) 2021-09-26 20:25:27 -04:00
Benjamin Webb a54fd6a908 Add postgres provider query parameters (#784)
* Add sortby, skip_geometry, and select_properties

* some pytest fixes

* Update main.yml

* Update main.yml

* fix geom in response feature

* more pytest fixes

* Update postgresql.py

* Update test_postgresql_provider.py

* Update test_postgresql_provider.py

* Add to docs, fix pytest

* fix for when when 'name' = None

* Update test_postgresql_provider.py

* Update test_postgresql_provider.py

* Remove optional comparator

* use secrets with default password

* Add secret to load postgres data
2021-09-25 07:03:38 -04:00
Sander Schaminee d2d5ce794a Language structs (dicts) must consist of valid locale keys only (#769) 2021-09-19 00:30:20 +02:00
Tom Kralidis 13926977a2 Merge pull request #774 from webb-ben/sta-patch
small SensorThings provider patches
2021-09-13 18:24:45 -04:00
Tom Kralidis 56411f7327 update to latest OARec metadata model updates 2021-09-13 13:36:53 -04:00
Benjamin Webb 07a23928ff Update test_sensorthings_provider.py 2021-09-09 13:52:21 -04:00
Tom Kralidis 70edc3c0f2 update TinyDB q= support for multiple terms (#765) 2021-08-26 16:30:46 -04:00
Tom Kralidis 6dcd10b10a test for item prev and next links on item queries (#752) (#757) 2021-08-25 06:34:39 -04:00
Tom Kralidis bc97ed480a add geometry to queryables (#755) 2021-08-22 08:28:56 -04:00
Tom Kralidis 9d920901b5 update OAProc execute handling (#754)
* fix OAProc default output to raw

* control outputs list from api machinery

* fix tests
2021-08-18 15:28:55 -04:00
Francesco Bartoli c5942f7a13 Fix time format in cite configuration (#748) 2021-08-02 07:27:48 -04:00
Tom Kralidis 5359789f13 fix OARec test data (#745)
* fix OARec test data

* fix TinyDB bbox handling

* add missing OACov conformance test
2021-07-23 14:50:34 -04:00
Tom Kralidis 914756666c OARec bbox should be two arrays, not three (#744) 2021-07-23 13:39:39 -04:00
Benjamin Webb 3efa041c54 Patch SensorThings API Tests (#737) 2021-07-22 19:11:25 -04:00
Jo cf4517c1c2 - update the script that loads data to ES, to support data encoded with utf8 (#742) 2021-07-22 19:10:38 -04:00
Tom Kralidis 00a08e05ba update OAProc content models (#735) 2021-07-22 15:13:09 +02:00
Francesco Bartoli cdc4f98090 Fix OAProc conformance classes (#736)
* Fix OAProc conformance classes

* Fix conformance test
2021-07-22 09:06:47 -04:00
Francesco Bartoli bb4cd0bf69 Add cql-json support for ES (#723)
Fix starlette event loop


Fix starlette event loop


Fix starlette event loop


Fix starlette event loop


Fix provider regression


Make method public


Make method public


Move function to the helpers utility


Add the CQL lifecycle for development


Add CQL docs


Fix flake8


Isolate import for starlette codepath
2021-07-21 21:00:14 -04:00
Tom Kralidis f01dfd38a7 fix response for non-existent collections (#722) (#730) 2021-07-20 09:41:59 +02:00
Ari Pollak d4f2b74505 Make FileSystem tests a bit more detailed (#727) 2021-07-19 22:08:44 -04:00
Benjamin Webb 8f8d19c5f8 Sensorthings API Provider (#721)
* Create sensorthings.py

* Update plugin.py

* Add files via upload

* Update sensorthings.py

* Add files via upload

* Update sensorthings.py

* Update sensorthings.py

* Update sensorthings.py

* Update sensorthings.py

* Update sensorthings BRGM Endpoint

* Clean Examples

* Cleaned sensorthings config

* add bbox and datetime query params

Added optional intralinking between STA entities

* add pytest for sta provider

* add sta pytest to workflow

* improve versatility of intralink and uri

* Update Datastreams geometry provider

* Update iow.sta.pygeoapi.config.yml

* faster hits using sta $count

* fix flake8

* added sta provider for github actions

* type in main.yml

* Update main.yml

* Update main.yml

* rename tests/data/datastreams.json

* Update main.yml

* Update load_sta_data.py

* Update load_sta_data.py

* Update load_sta_data.py

* Update load_sta_data.py

* Update load_sta_data.py

* Fix sta pytest

* fix flake8

* Update docs

* Update test_sensorthings__provider.py

* Merge various fixes from sta-patch-1

* force sorting

* Move STA data to remote host

* Clarify use of the intralink field

* rename test_sensorthings_provider.py

* Add Readme.md and switch to docker-compose

* Sensorthings -> SensorThings
2021-07-06 17:04:45 -04:00
Tom Kralidis 89eff49ce0 add support for configuration schema and validation (#553) (#719)
* add support for configuration schema and validation (#553)

* rename types

* minor doc fix

* update i18n regexes

* make openapi click options required arguments
2021-07-06 17:01:05 -04:00
Tom Kralidis 167281ee83 add support for OpenAPI rendering via ReDoc (#414) (#720)
* add support for OpenAPI rendering via ReDoc (#414)

* add support for OpenAPI rendering via ReDoc (#414)
2021-06-30 11:11:57 -04:00
Tom Kralidis 7ecac02693 add support for OpenAPI validation (#717) (#718)
* add support for OpenAPI validation (#717)

* update copyright years

* fix ES ref

* update CLI
2021-06-29 08:48:22 -04:00
Kyle Onda 37b1e9553b add geometry representations for json-ld output format (#689)
* Update linked_data.py

* Update linked_data.py

Added schema:geoShape to geojsonld = false

* Update linked_data.py

* Update linked_data.py for rebasing

* Update linked_data.py

* Update configuration.rst

* Update linked_data.py for geosparql geometry

* Add files via upload

* Update test_api.py

* Update test_api.py

* Update linked_data.py logic

* Add pytest for more geometry types

* Update test_util.py

* rename geojson2geojsonld, separated geom2schemageo

* Add pytest for polygon and linestring

* Update expanation of uri_field

Co-authored-by: Benjamin Webb <40066515+webb-ben@users.noreply.github.com>
Co-authored-by: Benjamin Webb <bmwebb20@colby.edu>
2021-06-17 19:00:35 -04:00
Tom Kralidis 989dfb6d30 fix Coverage output and format exception MIME type (#712)
* fix Coverage output and format exception MIME type

* Minor tweaks, added test to assert that a text/html header (without 'f' query param) returns JSON for get_collection_coverage()

Co-authored-by: Sander Schaminee <sander.schaminee@geocat.net>
2021-06-10 19:47:21 -04:00
Sander Schaminee 8f3e5c2ad7 Simplify API tests (#707) 2021-06-09 06:10:10 -04:00