tutorials-and-use-cases issueshttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues2021-09-27T08:33:25Zhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/39datetime64 vs CFtime2021-09-27T08:33:25ZFabian Wachsmanndatetime64 vs CFtimeFor long term simulations, users run into issues because of the nanosecond resolution of datatime64 in pandas which only allows a time coverage of about 600 years. They need to switch to datetim64 then. It should be shown in the notebook...For long term simulations, users run into issues because of the nanosecond resolution of datatime64 in pandas which only allows a time coverage of about 600 years. They need to switch to datetim64 then. It should be shown in the notebook for some cmip6 simulations like piControl or PMIP experiments
See also dm-rt 50086https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/38Add Lars Buntemeyer's contribution2021-07-14T13:31:08ZFabian WachsmannAdd Lars Buntemeyer's contribution> Thanks for pushing this forward! I created a notebook concerning CMIP6 data access and analysis with intake, xarray and pandas for some colleagues, maybe you are interested in that?
https://nbviewer.jupyter.org/github/larsbuntemeyer/n...> Thanks for pushing this forward! I created a notebook concerning CMIP6 data access and analysis with intake, xarray and pandas for some colleagues, maybe you are interested in that?
https://nbviewer.jupyter.org/github/larsbuntemeyer/notebooks/blob/main/CMIP6-access-dkrz.ipynb
https://nbviewer.jupyter.org/github/larsbuntemeyer/notebooks/blob/main/CMIP6-global-warming.ipynbhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/37Update tauc Gitlab repo with IS-ENES3 Github repo content2021-04-01T09:22:54ZGhost UserUpdate tauc Gitlab repo with IS-ENES3 Github repo contentnew folder hierarchy, spec, make_kernel.sh,...new folder hierarchy, spec, make_kernel.sh,...https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/36Model skills notebook with ERA52021-03-29T07:54:29ZGhost UserModel skills notebook with ERA5It was a nice idea, but I will not champion it.
Research question (thanks Iuliia Polkova!) **"Evaluation of prediction skill for surface air temperature and precipitation from the CMIP6 models using ERA5"**
**STEP 1**. DONE find ERA in...It was a nice idea, but I will not champion it.
Research question (thanks Iuliia Polkova!) **"Evaluation of prediction skill for surface air temperature and precipitation from the CMIP6 models using ERA5"**
**STEP 1**. DONE find ERA in dkrz data pool --> /pool/data/ERA5/ (thanks Fabi! also for the docs: https://confluence.ecmwf.int/display/CKB/ERA5%3A+data+documentation#ERA5:datadocumentation-Introduction)
**STEP 2**. DONE how to load ERA5 --> no problem with GRIB: http://xarray.pydata.org/en/stable/examples/ERA5-GRIB-example.html (thanks Marco!)
**STEP 3**. DONE load model data --Y intake and xarray, just copy-paste from the summer days nb's
**STEP 4**. TODO how to compare ERA-model: Iuliia's answer:
"load the data, calculate ensemble mean, calculate anomalies with respect to the long-term mean, calculate RMSE or CORR for different lead times et voila. If you have problems just let me know, I will help. The skill is usually calculated for anomalies and for lead times, so for prediction year 1, and multi-year averages such as years 2-5. Depending on the research problem, we calculate skill for each grid-point or for the anomalies averaged over a certain region. Here is one of my papers with the examples of skill calculation https://doi.org/10.1029/2018MS001439"https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/35Store Data Selection by Intake as csv/json - Notebook Example2021-02-19T12:35:47ZMarco KulükeStore Data Selection by Intake as csv/json - Notebook ExampleMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/34Create Lighweight Notebook which explains Data Pool/Intake for Webinar2021-03-11T14:05:19ZMarco KulükeCreate Lighweight Notebook which explains Data Pool/Intake for WebinarMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/33Update the cmip6 multimodel comparison nb to include intake2021-03-11T11:23:17ZGhost UserUpdate the cmip6 multimodel comparison nb to include intakeThe current cmip6 multimodel comparison nb points to the path where the datasets (directly, without intake). As the notebook calculations uses pre-processed data (the global means were calculated apart), the update also must rewrite the ...The current cmip6 multimodel comparison nb points to the path where the datasets (directly, without intake). As the notebook calculations uses pre-processed data (the global means were calculated apart), the update also must rewrite the calculations to include not only the annual means calculations but also the global means calculations in the notebook, so the intake call points to the "raw" cmip6 data.2021-02-08https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/32Populate gitlab pages (sphinx) with "how-to-log-in" animations2021-07-14T14:04:30ZGhost UserPopulate gitlab pages (sphinx) with "how-to-log-in" animationsTo include animations as the ones in enes.org https://portal.enes.org/data/data-metadata-service/analysis-platforms/example-of-how-to-run-server-side-data-near-multimodel-comparisonsTo include animations as the ones in enes.org https://portal.enes.org/data/data-metadata-service/analysis-platforms/example-of-how-to-run-server-side-data-near-multimodel-comparisonshttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/31Set-up Gitlab-pages for tauc repo2021-07-14T13:55:37ZGhost UserSet-up Gitlab-pages for tauc repoLets try a config where all notebooks are executed and hosted. That has the advantage of having tests run at the same time.
Original comment:
> We already have gitlab pages build with Sphinx, which makes documentation-like pages (boring...Lets try a config where all notebooks are executed and hosted. That has the advantage of having tests run at the same time.
Original comment:
> We already have gitlab pages build with Sphinx, which makes documentation-like pages (boring :worried:) so we will set new gitlab pages with Jekyll for a more blog-like style.Fabian WachsmannFabian Wachsmannhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/30Re-Write Notebooks Climate-data-analysis-service from PyOphidia to xarray2021-02-19T12:35:02ZMarco KulükeRe-Write Notebooks Climate-data-analysis-service from PyOphidia to xarrayOld PyOphidia Notebooks https://github.com/ECAS-Lab/ecas-notebooks
New xarray Notebooks https://github.com/IS-ENES-Data/Climate-data-analysis-serviceOld PyOphidia Notebooks https://github.com/ECAS-Lab/ecas-notebooks
New xarray Notebooks https://github.com/IS-ENES-Data/Climate-data-analysis-serviceMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/29Upload Summer Day Notebook to iRODS2021-03-11T14:05:27ZMarco KulükeUpload Summer Day Notebook to iRODSGather more information on iRODSGather more information on iRODSMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/28Start Gitlab-pages for tauc repo - sphinx2021-01-25T09:32:17ZGhost UserStart Gitlab-pages for tauc repo - sphinxCreate a blog for tauc, probably using Sphinx, coordinated with the development of gitlab-pages for the Zarr repoCreate a blog for tauc, probably using Sphinx, coordinated with the development of gitlab-pages for the Zarr repo2021-01-22https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/27Add the cmip6 multimodel comparison notebook (is-enes3 demo) to the tauc repo2020-12-16T07:46:34ZGhost UserAdd the cmip6 multimodel comparison notebook (is-enes3 demo) to the tauc repoAdd to the taur repo the notebook used in the is-enes3 demo: https://portal.enes.org/data/data-metadata-service/analysis-platforms/example-of-how-to-run-server-side-data-near-multimodel-comparisons. From now on it will be updated here. F...Add to the taur repo the notebook used in the is-enes3 demo: https://portal.enes.org/data/data-metadata-service/analysis-platforms/example-of-how-to-run-server-side-data-near-multimodel-comparisons. From now on it will be updated here. First step: include intake. Second step: pre-process here (not in bash). Updates assigned to Maria but feel free to contribute :smile:2020-12-16https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/26Calculate Climate Extremes Indices according to the ETCCDI standard with CDOs2021-11-11T12:44:53ZFabian WachsmannCalculate Climate Extremes Indices according to the ETCCDI standard with CDOsFabian WachsmannFabian Wachsmannhttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/25Analyse time series of a CMIP simulation with Xarray and Pandas2021-07-14T13:28:46ZFabian WachsmannAnalyse time series of a CMIP simulation with Xarray and Pandashttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/24How to access data with intake catalogs2021-04-12T08:03:52ZFabian WachsmannHow to access data with intake catalogshttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/23Climate Station Data Notenbook Draft2023-06-14T11:53:43ZMarco KulükeClimate Station Data Notenbook DraftHow to Access Climate Station DataMarco KulükeMarco Kulükehttps://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/22Add "how to reach us" in the readme2021-04-07T15:53:44ZGhost UserAdd "how to reach us" in the readmeExploring chat options: mattermost (gitlab documentation), glitter (as in Birdhouse github pages), ...Exploring chat options: mattermost (gitlab documentation), glitter (as in Birdhouse github pages), ...https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/21edit the Readme file for users2020-12-09T12:52:29ZGhost Useredit the Readme file for userssummer_days_cmip62020-12-09https://gitlab.dkrz.de/data-infrastructure-services/tutorials-and-use-cases/-/issues/19Zarr Notebook Draft2023-06-14T11:53:52ZMarco KulükeZarr Notebook DraftHow to use Zarr in your Data Processing WorkflowMarco KulükeMarco Kulüke