data-infrastructure-services issueshttps://gitlab.dkrz.de/groups/data-infrastructure-services/-/issues2023-06-14T11:53:43Zhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/23Climate Station Data Notenbook Draft2023-06-14T11:53:43ZMarco KulükeClimate Station Data Notenbook DraftHow to Access Climate Station DataMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/21edit the Readme file for users2020-12-09T12:52:29ZGhost Useredit the Readme file for userssummer_days_cmip62020-12-09https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/19Zarr Notebook Draft2023-06-14T11:53:52ZMarco KulükeZarr Notebook DraftHow to use Zarr in your Data Processing WorkflowMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/18Contact Felix about Dask2021-02-08T08:55:04ZMarco KulükeContact Felix about DaskDask for Climate DataMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/15Plotting CMIP6 data on unstructured grids with psyplot2021-08-25T15:26:39ZFabian WachsmannPlotting CMIP6 data on unstructured grids with psyplotTaking advantage of my work for ICON standardization and use it as well in this repo.
Introducing basic psyplot methods for ICON and AWI-FESOM.Taking advantage of my work for ICON standardization and use it as well in this repo.
Introducing basic psyplot methods for ICON and AWI-FESOM.Fabian WachsmannFabian Wachsmannhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/6Dask for Climate Data - Draft Notebook2023-06-14T11:53:57ZMarco KulükeDask for Climate Data - Draft NotebookDask for Climate DataMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/7Integrate Cloud upload of catalog into cronjob2020-10-14T10:24:45ZFabian WachsmannIntegrate Cloud upload of catalog into cronjobhttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/6Subest Catalog(s) for CMIP62020-05-07T07:44:23ZFabian WachsmannSubest Catalog(s) for CMIP6The entire CMIP6 catalog requires at least 10GB memory so that 2 options of the jupyterhub server of dkrz cannot be used.
We therefore think about having subsets of the Catalogs to simplify its application.
Any suggestions?The entire CMIP6 catalog requires at least 10GB memory so that 2 options of the jupyterhub server of dkrz cannot be used.
We therefore think about having subsets of the Catalogs to simplify its application.
Any suggestions?https://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/4/work/ik1017/Catalogs structure2020-04-02T09:47:46ZAaron Springaaron.spring@mpimet.mpg.de/work/ik1017/Catalogs structureich merke grad dass ich da schreibrechte habe...
I think this folder should contain:
- builder folder? or do you want to hide this
- cataloging files for mistral: json and csv, the most current should always have the same filename for c...ich merke grad dass ich da schreibrechte habe...
I think this folder should contain:
- builder folder? or do you want to hide this
- cataloging files for mistral: json and csv, the most current should always have the same filename for compatibility
- pangeo-cmip.json is not too useful, rather a link to the pangeo catalogs in general for reference (maybe in small demo?)
- short demo of intake-esm in use
- environment to run intake-esm, we could even just take the default anaconda bleeding_edge, they have intake-esm installed from december 2019
- backup folder for older catalogs, to not overwrite older ones. rename and move.https://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/3Build CMIP6 catalogs regularly with cron job2020-10-29T15:24:07ZAaron Springaaron.spring@mpimet.mpg.deBuild CMIP6 catalogs regularly with cron jobhow:
```python
#convert notebook to build.py
source activate intake-esm-dev
python build.py
```
afterwards:
- adapt all notebooks to new location
- share with LunchBytes usershow:
```python
#convert notebook to build.py
source activate intake-esm-dev
python build.py
```
afterwards:
- adapt all notebooks to new location
- share with LunchBytes usershttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/2Catalogs dont build2020-03-31T09:25:02ZAaron Springaaron.spring@mpimet.mpg.deCatalogs dont buildsome files are now hidden. currently doesnt get further than DAMIP. Last entry in CMIP6_fileslist: /work/ik1017/CMIP6/data/CMIP6/DAMIP/CCCma/CanESM5/hist-GHG/r10i1p1f1/Omon/limirrmisc/gn/v20190429/limirrmisc_Omon_CanESM5_hist-GHG_r10i1p1...some files are now hidden. currently doesnt get further than DAMIP. Last entry in CMIP6_fileslist: /work/ik1017/CMIP6/data/CMIP6/DAMIP/CCCma/CanESM5/hist-GHG/r10i1p1f1/Omon/limirrmisc/gn/v20190429/limirrmisc_Omon_CanESM5_hist-GHG_r10i1p1f1_gn_185001-202012.nc
solution:
- somehow adapt builder. probably easier in notebook and in CLI.