data-infrastructure-services issueshttps://gitlab.dkrz.de/groups/data-infrastructure-services/-/issues2021-01-25T09:32:17Zhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/28Start Gitlab-pages for tauc repo - sphinx2021-01-25T09:32:17ZGhost UserStart Gitlab-pages for tauc repo - sphinxCreate a blog for tauc, probably using Sphinx, coordinated with the development of gitlab-pages for the Zarr repoCreate a blog for tauc, probably using Sphinx, coordinated with the development of gitlab-pages for the Zarr repo2021-01-22https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/27Add the cmip6 multimodel comparison notebook (is-enes3 demo) to the tauc repo2020-12-16T07:46:34ZGhost UserAdd the cmip6 multimodel comparison notebook (is-enes3 demo) to the tauc repoAdd to the taur repo the notebook used in the is-enes3 demo: https://portal.enes.org/data/data-metadata-service/analysis-platforms/example-of-how-to-run-server-side-data-near-multimodel-comparisons. From now on it will be updated here. F...Add to the taur repo the notebook used in the is-enes3 demo: https://portal.enes.org/data/data-metadata-service/analysis-platforms/example-of-how-to-run-server-side-data-near-multimodel-comparisons. From now on it will be updated here. First step: include intake. Second step: pre-process here (not in bash). Updates assigned to Maria but feel free to contribute :smile:2020-12-16https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/26Calculate Climate Extremes Indices according to the ETCCDI standard with CDOs2021-11-11T12:44:53ZFabian WachsmannCalculate Climate Extremes Indices according to the ETCCDI standard with CDOsFabian WachsmannFabian Wachsmannhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/25Analyse time series of a CMIP simulation with Xarray and Pandas2021-07-14T13:28:46ZFabian WachsmannAnalyse time series of a CMIP simulation with Xarray and Pandashttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/24How to access data with intake catalogs2021-04-12T08:03:52ZFabian WachsmannHow to access data with intake catalogshttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/15Plotting CMIP6 data on unstructured grids with psyplot2021-08-25T15:26:39ZFabian WachsmannPlotting CMIP6 data on unstructured grids with psyplotTaking advantage of my work for ICON standardization and use it as well in this repo.
Introducing basic psyplot methods for ICON and AWI-FESOM.Taking advantage of my work for ICON standardization and use it as well in this repo.
Introducing basic psyplot methods for ICON and AWI-FESOM.Fabian WachsmannFabian Wachsmannhttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/7Integrate Cloud upload of catalog into cronjob2020-10-14T10:24:45ZFabian WachsmannIntegrate Cloud upload of catalog into cronjobhttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/6Subest Catalog(s) for CMIP62020-05-07T07:44:23ZFabian WachsmannSubest Catalog(s) for CMIP6The entire CMIP6 catalog requires at least 10GB memory so that 2 options of the jupyterhub server of dkrz cannot be used.
We therefore think about having subsets of the Catalogs to simplify its application.
Any suggestions?The entire CMIP6 catalog requires at least 10GB memory so that 2 options of the jupyterhub server of dkrz cannot be used.
We therefore think about having subsets of the Catalogs to simplify its application.
Any suggestions?https://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/4/work/ik1017/Catalogs structure2020-04-02T09:47:46ZAaron Springaaron.spring@mpimet.mpg.de/work/ik1017/Catalogs structureich merke grad dass ich da schreibrechte habe...
I think this folder should contain:
- builder folder? or do you want to hide this
- cataloging files for mistral: json and csv, the most current should always have the same filename for c...ich merke grad dass ich da schreibrechte habe...
I think this folder should contain:
- builder folder? or do you want to hide this
- cataloging files for mistral: json and csv, the most current should always have the same filename for compatibility
- pangeo-cmip.json is not too useful, rather a link to the pangeo catalogs in general for reference (maybe in small demo?)
- short demo of intake-esm in use
- environment to run intake-esm, we could even just take the default anaconda bleeding_edge, they have intake-esm installed from december 2019
- backup folder for older catalogs, to not overwrite older ones. rename and move.https://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/3Build CMIP6 catalogs regularly with cron job2020-10-29T15:24:07ZAaron Springaaron.spring@mpimet.mpg.deBuild CMIP6 catalogs regularly with cron jobhow:
```python
#convert notebook to build.py
source activate intake-esm-dev
python build.py
```
afterwards:
- adapt all notebooks to new location
- share with LunchBytes usershow:
```python
#convert notebook to build.py
source activate intake-esm-dev
python build.py
```
afterwards:
- adapt all notebooks to new location
- share with LunchBytes usershttps://gitlab.dkrz.de/data-infrastructure-services/intake-esm/-/issues/2Catalogs dont build2020-03-31T09:25:02ZAaron Springaaron.spring@mpimet.mpg.deCatalogs dont buildsome files are now hidden. currently doesnt get further than DAMIP. Last entry in CMIP6_fileslist: /work/ik1017/CMIP6/data/CMIP6/DAMIP/CCCma/CanESM5/hist-GHG/r10i1p1f1/Omon/limirrmisc/gn/v20190429/limirrmisc_Omon_CanESM5_hist-GHG_r10i1p1...some files are now hidden. currently doesnt get further than DAMIP. Last entry in CMIP6_fileslist: /work/ik1017/CMIP6/data/CMIP6/DAMIP/CCCma/CanESM5/hist-GHG/r10i1p1f1/Omon/limirrmisc/gn/v20190429/limirrmisc_Omon_CanESM5_hist-GHG_r10i1p1f1_gn_185001-202012.nc
solution:
- somehow adapt builder. probably easier in notebook and in CLI.