intake-esm_support issueshttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues2020-12-01T10:23:28Zhttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/10Recent Intake-version loads datasets without bounds2020-12-01T10:23:28ZFabian WachsmannRecent Intake-version loads datasets without bounds@k204212 Hopefully I get that done sometimes...@k204212 Hopefully I get that done sometimes...https://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/9creating a catalog for ESGF data holdings2020-11-28T10:22:49ZAaron Springaaron.spring@mpimet.mpg.decreating a catalog for ESGF data holdingsHi Fabi, would it be possible to create a catalog with all the files hosted by DKRZ's ESGF node?
Then it would be quite easy to access the data via opendap:
Now using the existing catalog from the replica:
`url = col.search(experiment...Hi Fabi, would it be possible to create a catalog with all the files hosted by DKRZ's ESGF node?
Then it would be quite easy to access the data via opendap:
Now using the existing catalog from the replica:
`url = col.search(experiment_id='dcppA-hindcast', source_id='CanESM5', table_id='Omon', variable_id='fgco2').df.head().iloc[0].opendap_url`
`ds_m = xr.open_dataset(url, chunks={})`
If we had such a catalog for the ESGF node itself with this `opendap_url` column (thanks for adding this), users could easily access non-replica files from the node.https://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/8intake-esm on jupyterhub2020-10-05T08:31:20ZAaron Springaaron.spring@mpimet.mpg.deintake-esm on jupyterhubstarted via email with @k204210 and @m300524
Problem: memory issues are an often occurring issue.
Solutions:
- should we find a good configuration how to use `intake-esm` on `jupyterhub.dkrz.de` and put an example here?
- `jupyter-sta...started via email with @k204210 and @m300524
Problem: memory issues are an often occurring issue.
Solutions:
- should we find a good configuration how to use `intake-esm` on `jupyterhub.dkrz.de` and put an example here?
- `jupyter-start` script from DKRZ and compute nodehttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/5CORDEX data pool needs to be cleaned up2020-04-08T10:37:18ZFabian WachsmannCORDEX data pool needs to be cleaned upReference: a2c3f001
Some unvalid data was available in the CORDEX pool:
/work/kd0956/CORDEX/data
This has been put in the catalog.Reference: a2c3f001
Some unvalid data was available in the CORDEX pool:
/work/kd0956/CORDEX/data
This has been put in the catalog.Fabian WachsmannFabian Wachsmannhttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/1CMIP3 catalog2020-04-02T14:57:32ZAaron Springaaron.spring@mpimet.mpg.deCMIP3 catalogNice to have. CMIP3 has a different folder structure than CMIP5,6 but in principle this should be also possible.Nice to have. CMIP3 has a different folder structure than CMIP5,6 but in principle this should be also possible.