Update Meeting_29_01_2025 authored by Stephan Kindermann's avatar Stephan Kindermann
# Agenda # Agenda
- short catch up since last meeting(s) - short catch up since last meeting(s)
- status and next steps with respect to (meta-)data ingest developments -
- ESGF (CEDA ingest tool, and ESGF publisher) *
* ESGF (CEDA ingest tool, and ESGF publisher)
* [stac-generator](https://github.com/cedadev/stac-generator) * [stac-generator](https://github.com/cedadev/stac-generator)
* crawl --\> extract --\> elastic_search ingest * crawl --\> extract --\> elastic_search ingest
* [esg-publisher](https://github.com/ESGF/esg-publisher) * [esg-publisher](https://github.com/ESGF/esg-publisher)
* (crawled) --\> extract --\> publish (on kafka) --\> remote stac ingest * (crawled) --\> extract --\> publish (on kafka) --\> remote stac ingest
* (both: kerchunk/sidecar file generation .. tool??) * (both: kerchunk/sidecar file generation .. tool??)
- Warmworld * Warmworld
* static / ad hoc tool generate --\> ?static catalog gen? / ?test stac ingest? * static / ad hoc tool generate --\> ?static catalog gen? / ?test stac ingest?
- Expect (cross catalog and non-ESGF catalogs) * Expect (cross catalog and non-ESGF catalogs)
* static cross catalog overlay ?? * static cross catalog overlay ??
- EERIE * EERIE
* see [cloudify](https://gitlab.dkrz.de/data-infrastructure-services/cloudify/-/tree/main/workshop?ref_type=heads) * see [cloudify](https://gitlab.dkrz.de/data-infrastructure-services/cloudify/-/tree/main/workshop?ref_type=heads)
- NextGems etc: intake * NextGems etc: intake
* (intake --\> stac) !? * (intake --\> stac) !?
- (Freva: tbd. in February meeting) * (Freva: tbd. in February meeting)
* crawler --\> direct solr ingest --\> (stac gen?) * crawler --\> direct solr ingest --\> (stac gen?)
- status test servers, prototyping setup etc. - status test servers, prototyping setup etc.
- -
# Discussion # Discussion
discussion figure:
![stac-ing1](uploads/0956b11e3638e119bd7f621611484d44/stac-ing1.jpg)
# Action Items # Action Items
\ No newline at end of file