Commit Graph

144 Commits

Author SHA1 Message Date
Tom Kralidis f26582e4ce add examples in docs 2023-01-23 09:28:05 -05:00
Tom Kralidis 30e1adeb79 Happy New Year! 🥳 2023-01-01 12:57:56 -05:00
Tom Kralidis 82c432794e various updates (#1082) 2022-12-27 07:26:21 -05:00
Francesco Bartoli c209022a46 Add provider properties configuration (#1079) 2022-12-27 07:03:54 -05:00
Francesco Frassinelli 64e63ac4c0 Fix typo in plugins.rst example (#1063) 2022-12-07 16:51:44 -05:00
Jo 111cfa5a98 - update docs with example of configuration for rendering pg_tileserv vector tiles (#1058) 2022-12-04 07:06:22 -05:00
Tom Kralidis c3b0e7868e minor updates to #1040 (#1054)
* minor updates to #1040
* s/crs/bbox-crs
* write status to stdout if --output-file is used
2022-12-02 09:58:45 +02:00
Tom Kralidis ccb94e132d Update introduction.rst 2022-12-01 09:16:45 -05:00
Jo 85a4984bbe Add Support for a generic url template, for publishing vector tiles as OGC API Tiles (#1050)
* - Added support to read from a generic url template as vector tile backend.

* - Add support for not rendering the tileset metadata

* - added support for z/y/x vector tile layers

* - fixed formatting issues

* - refactored code to use get_layer function, everywhere we need to parse username
- added a couple of debug statements, to make sure we are getting the layer name
correctly
- added an error for url templates that follow a schema, which is not supported yet

* - Added documentation for tiles provider, to show how to read a generic url

* - fixed formatting issues

* - added example of ES vector tiles in the docker-config of elasticsearch

Co-authored-by: doublebyte1 <info@doublebyte.net>
2022-12-01 08:34:16 -05:00
Tom Kralidis 608fba5664 add support for OAMaps 🗺️ (#668) 2022-12-01 11:55:46 +02:00
Tom Kralidis af72c79267 add requirements note for providers (#1040) (#1041) 2022-11-23 08:03:44 -05:00
Angelos Tzotsos 09f2eff771 back to dev 2022-11-15 16:08:53 +02:00
Angelos Tzotsos 5e7015c2c7 update release version 2022-11-15 15:38:29 +02:00
Tom Kralidis 5ed6fb3170 add OGC RI for EDR (#1036) 2022-11-10 14:43:39 -05:00
Tom Kralidis db8fae61eb minor fixes following #964 (#1030) 2022-10-29 02:41:45 -04:00
John A Stevenson 644281359a Add CQL to PostgreSQL provider (via pygeofilter and sqlalchemy) (#964)
* Add pygeofilter, unpin psycopg2

* Add pygeofilter SQLAlchemy query demo

* Add note about primary key

* Add todos to script

* Make script generic

* Add (commented out) PostgreSQL provider hotosm_bdi_waterways to config

* Update to use local test database

* Return result as dictionary

* Pass GEOM_FIELD as variable

* Add offset and limt, fix two names

* Implement order by

* Use function for cql query

* Add cql query block to query and test

* Link up to db engine

* Convert WKB geometry to GeoJSON

* Add shapely as explicit dependency

* Add tests for CQL queries

* Add test using CROSSES with LINESTRING

* Uncomment Docker PostGIS test layer

* First pass at wiring up API

The CQL is read from the request but the parser fails to convert to
AST.

* Turn logging to DEBUG

Example query
http://localhost:5000/collections/hot_osm_waterways/items?cql=%27osm_id%20BETWEEN%2080800000%20AND%2080900000%20AND%20name%20IS%20NULL%27

* Create dedicated pygeoapi-config.yml for testing PostgreSQL

* Add test for PostgreSQL CQL

* Return 400 for bad CQL

* Tidy up old files

* Bring API error type tests together

* Only reflect the table of interest

* Add pygeofilter to requirements

* Remove local setup_env.sh from .gitignore

* Remove lark exception handling

* Remove lark codes from tests, docstring change

* Split cql test into good and error

* Rename cql parameter to filter

* Add optional filter-lang parameter with test

* Initial changes

* Rename cql text parser

* Use CQL-JSON POST for PostgreSQL query

* Refactor to get data early and handle errors

* Add error tests for CQL-JSON PostgreSQL

* Add tests for prev/next and provider instantiation

* As filter-lang is set the block in not needed

* Clarify test fixtures

* Use filterq only in all CQL calls

* Make engine and table_model attributes of provider

* Handle different instantiation failures

* Use SQLAlchemy for get_fields()

* Minor doc edits

* Use SQLAlchemy for get()

* Simplify _sqlalchemy_to_feature

* Store database parameters in dedicated function

* Strip out non-SQLAlchemy code

* Add draft query() based on CQL filters

* Add property filtering to query()

* Implement select_properties and skip_geometry

* Implement bbox filter

* Implement properties subset defined in config

* Clean up materialized view test

We only need to test the fields that are present to be sure that the
view has been accessed, so other checks have been removed.

* Flake8 fixes and tidy up

* Add combined test for CQL with bbox and properties

* Create sessions directly where required

* Add Engine store to allow connection reuse

* Replace cql_ast with filterq

* Tidy up tests by using fixture for api

* Add authors

* Use Session() as context manager

A session requires a connection to the database, as provided by the
SQLAlchemy engine.  When the session goes out of scope, e.g. at exit
from the function when it was used, it should be garbage collected and
the connection freed.  However, during load testing it was found that
this wasn't happening.  This commit uses a context manager pattern to
start the session, which ensures that the session is closed at the end
of the `with` block.

* Return fields type as {'type': ...}

* Cache the table_model with the engine

Generating the table_model by "reflecting" the database is expensive but
the resulting model doesn't change.  If we cache the table_model with
the engine we save on a round-trip to the database and speed up response
time.

* Use separate stores for Engine and table_models

Using a combined store based on both engine and table_model meant that
a pygeoapi serving multiple tables on the same database would maintain
a connection pool for each table.  This could eventually saturate the
number of available connections.  This commit separates the store into
two parts.

* Update documentation with example

* Manage or post items based on POST content type

* ghcr build action

* only ghcr job

* run criteria edit

* Update README.md

* job = main

* remove success requirememt

* add tag

* tags: bgs-cql

* Update main.yml

* Update README.md

* remove binary

* update

* Update actions to latest versions

* Dockerfile refactor

* Dockerfile refactor

* restore dockerhub

* fix pygeoif version

* # 3.6 test & dockerhub ref

* Pin pygeoif version to less than 1

* Replace psycopg-binary with psycopg

* Split Docker build into sections

* Pin click version >7,<=8

* Add further cql examples

* Update workflows to match GeoPython repo

* update flake python version

* Unquote PostgreSQL column names

* Update container workflow uses versions

* flake8 use python version 3.7

* Use pre ping to get db connection

* Test that properties are set in provider

* Amendments as requested by @tomkralidis

* Correction

* Fix reviewed changes in api code

Co-authored-by: Colin Blackburn <colb@bgs.ac.uk>
Co-authored-by: KoalaGeo <eddlewis85@gmail.com>
Co-authored-by: Edd <edlew@bgs.ac.uk>
Co-authored-by: Colin Blackburn <ximenesuk@users.noreply.github.com>
2022-10-29 02:15:31 -04:00
vvmruder dd379d20cc Update administration.rst (#1026)
Fix typo in doc
2022-10-25 08:28:04 -04:00
Tom Kralidis 6447493a76 add support for provider plugin schemas (#1022) 2022-10-19 15:43:57 -04:00
Tom Kralidis 66f2d86e83 update refs, add doc 2022-10-14 19:02:16 -04:00
Tom Kralidis 87cfa59e31 add pygeometa plugin to docs 2022-09-30 09:08:52 -04:00
KoalaGeo 8cd1e737f2 PR #801 for #989: GH Workflow - Docker Build+Push to DockerHub and GH Container Registry
* Create ghcr.yml

Create and publish a Docker image to GitHub Container Registry

* Update installation.rst

Add reference to GitHub Container registry

* Update running-with-docker.rst

Add ghcr references

* Make ghcr conditional on main.yml

Updated main.yml run conditions & add on-success condition to ghcr.yml

* Miss aligned

* change workflow name

GHCR

* Update build to Build

Names didn't match GHCR condition

* Remove cog symbol from Build name

* Add paths-ignore

**.md

* Added build & push to DockerHub

* Add authorship & update header

* Tidy yml, add on-success condition

* Add on failure condition

* Remove GHC Tests and Conditional Push

* DockerHub Test - koalageo/pygeoapi

* DockerHub - Revert to geopython/pygeoapi

* Use SECRET for DockerHub repo

* Combined Build & Push

* Update tag function

* Fix tags for latest

* Lastest tag only on `master`

* Use tag on push tag event

* Add latest tag on default branch

* Add unit tests step

* Add separate build & test steps

* Typo in docs

* Move flake8 to before tests - catch errors early

* Add further tags

Co-authored-by: Benjamin Webb <40066515+webb-ben@users.noreply.github.com>

Co-authored-by: Benjamin Webb <40066515+webb-ben@users.noreply.github.com>
2022-09-26 23:38:34 +02:00
Tom Kralidis faa00e7c92 add support for API transactions (#984)
* add support for API transactions (#107)

* update Django views

* fix Starlette refs

* isolate  metadata fields

* fix flake8

* add root link relations to collection and item endpoints

* fix tests

* fix tests

* fix tests

* fix tests
2022-09-15 11:59:06 -04:00
Jakob Miksch 0da02695af Docs: Add missing comment (#983)
* Add missing comment

* Update installation.rst

Co-authored-by: Tom Kralidis <tomkralidis@gmail.com>
2022-09-15 05:24:24 -04:00
Tom Kralidis da3ce7a988 add link to workshop [skip ci] 2022-09-06 01:07:52 -04:00
Tom Kralidis 199a1fc612 update Django integration (#971)
* update Django integration

* address PR comments
2022-08-30 22:41:48 +02:00
Francesco Bartoli 98bfdd5cf2 Add support for the django framework (#630)
* Add initial support with a django skeleton project

* Start the django server from pygeoapi configuration and push to settings

* Add views to django routes

* fixed flake8 problems

* added jobs endpoints

* added EDR endpoints

* renamed jobs endpoints and functions

* fixed flake8

* Bump django version to support 3 and 4

* Fix api request instance


Fix api request instance

* fixed stac catalog path request

* fixed problem with static

* get parameters from django requests

* Add sample project for django application

* Fix flake8 errors

* added documentation for Django downstream project

Co-authored-by: Luca Delucchi <lucadeluge@gmail.com>
Co-authored-by: Krishna Lodha <krishnaglodha@gmail.com>
2022-08-27 18:01:32 +02:00
ColinAsheGIS c7cc788e46 Corrects 'pip install guvicorn' to 'pip install uvicorn' (#963) 2022-08-27 06:04:02 -04:00
Jorge Martínez Gómez 1e3e50995e Update installation docs to make sure pip is upgraded (#966) 2022-08-27 05:56:30 -04:00
Tom Kralidis b640217900 update OSGeo project status 2022-08-20 22:37:35 -04:00
Tom Kralidis 1adc0cfa56 fix C4 diagram arrows [skip ci] 2022-08-15 10:17:18 -04:00
Benjamin Webb 46f213bff5 Add Socrata provider for OGC API - Features (#955) 2022-08-15 09:44:25 -04:00
Benjamin Webb 5a6fdd2bed Add ESRI Service provider for OGC API - Features (#954) 2022-08-15 09:44:13 -04:00
Tom Kralidis eaf11ef7ad update architecture diagram and HTML tables (#962) 2022-08-15 09:26:27 -04:00
Sylvain Brunato 262562022e docs: fixed configuration validation command (#945) 2022-07-27 20:24:33 -04:00
Jo b6bf67b8c8 - Added overview for mongo provider in the documentation (#940) 2022-07-21 20:29:39 -04:00
Tom Kralidis 08f3380b6f update hidden resources concept (#934) 2022-07-11 07:45:10 -04:00
Tom Kralidis 2d85eb2ac6 add support for non-advertised resources (#927) 2022-07-07 06:32:43 -04:00
Tom Kralidis 3b231c5fea add OpenAPI generate option to write to file (#919) (#925) 2022-06-21 21:03:19 -04:00
Paul van Genuchten d17f9ec526 rename fieldnames as suggested by @geosander 2022-06-13 09:18:23 +02:00
Paul van Genuchten be5efadc90 when title-field has a multilingual configuration, use it
resolves #921
2022-06-13 09:18:23 +02:00
Tom Kralidis 3ebdbded9a fix JSON MIME types 2022-05-13 13:48:15 +00:00
Tom Kralidis 356fe1280c add skip_geometry to remaining feature providers (#887)
* skip geometry for SQLite/GPKG backends (#886)

* simplify GKPG

* add for remaining providers, add to doc
2022-04-19 13:44:56 -04:00
Tom Kralidis 09ad6f8fce Hierarchical collections (#885)
* add support for hierarchical collections

* fix JSON rendering in docs

* fix JSON rendering in docs

* fix tests

* update docs

* update HTML templates with collections path

* fix template error

* add test
2022-04-16 18:26:55 -04:00
Tom Kralidis f17c6936a0 OACov: change coverage range-subset to properties, update conformance classes (#870)
* OACov: change coverage range-subset to properties, update conformance classes

* fix conformance tests
2022-03-10 16:23:49 -05:00
Tom Kralidis 5d0dbd0857 fix docs 2022-03-08 16:05:08 -05:00
Tom Kralidis 1c87e0005b move items startindex to offset 2022-03-08 14:51:53 -05:00
ychoquet bd2177674c Creation of a STAC HATEOAS Provider. (#857) 2022-02-23 17:27:43 -05:00
Tom Kralidis c0a1d56f99 add latex engine/url footer settings (#856) 2022-02-11 13:14:33 -05:00
Angelos Tzotsos e28d0cbd47 back to dev 2022-02-07 22:10:53 +02:00
Angelos Tzotsos 2989756a21 update release version 2022-02-07 22:05:13 +02:00