Skip to content
Snippets Groups Projects
New look: Off

Scale PET for other projects

    • Closed Issue created by Bianca Wentzel @k202206
    1. If you want to select data from e.g. CMIP5 the plugin alows to select data where not all the required varibales exists.

    See: https://www-regiklim.dkrz.de/history/6403/results/

    1. Since we need to have orog variable for calculation, we have to make this work only for the projects listed here: https://www-regiklim.dkrz.de/databrowser/?start=0&variable=orog

    2. We need to also handle datasets in nukleus where no altitude is present for the selected experiment: https://www-regiklim.dkrz.de/databrowser/?experiment=ssp370-gwl2k&institute=clmcom-hereon&product=ceu-3&project=nukleus&start=0&time_frequency=1day&variable=tasmin

    Edited

    Designs

      Child items ...

      2. Activity

      • Bianca Wentzel added Priority | High 🐞 Bug labels

        added Priority | High 🐞 Bug labels

      • Mostafa Hadizadeh changed title from incorrect application of necessary variables for data selection to Scale PET for other projects

        changed title from incorrect application of necessary variables for data selection to Scale PET for other projects

      • Mostafa Hadizadeh removed 🐞 Bug label

        removed 🐞 Bug label

      • Mostafa Hadizadeh added 🆕 Feature 👥 User Story labels

        added 🆕 Feature 👥 User Story labels

      • Mostafa Hadizadeh changed the description

        changed the description

      • Bianca Wentzel changed the description

        changed the description

      • Bianca Wentzel mentioned in merge request !6 (merged)

        mentioned in merge request !6 (merged)

        • Mostafa Hadizadeh
          Mostafa Hadizadeh @k202187 ·
          Owner

          @k202206 one other issue that has been observed, is about the finding the proper start and end time! What do u think of getting the date time from the searched files instead of using the one user is given? As I did here the datetime interval that I chose is so big, so it has to do the loop on all years to find the ones which have data. And it takes so long. I think this way is not efficient. We can keep the user free to choose whatever they want but on the other hand, we restrict the time based on what we have on files in a function.

          https://www-regiklim.dkrz.de/history/6450/results/

          and look at the config file:

          {
    "product": "ceu-3",
    "institute": "clmcom-btu",
    "model": "ec-earth-consortium-ec-earth3-veg-clmcom-btu-icon-2-6-5-rc-nukleus-x2yn2-v1",
    "experiment": "historical",
    "ensemble": "r1i1p1f1",
    "start_date": "1900-01-01",
    "end_date": "2999-01-01",
    "region": "5,15,47,55",
    "output_dir": "/work/ch1187/regiklim-work/k202187/regiklim-ces/output/pet/6450",
    "debug": false,
    "files": {
        "tasmax": [
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmax/v20240201/tasmax_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19860101-19901231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmax/v20240201/tasmax_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19810101-19851231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmax/v20240201/tasmax_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19760101-19801231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmax/v20240201/tasmax_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19710101-19751231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmax/v20240201/tasmax_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19660101-19701231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmax/v20240201/tasmax_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19610101-19651231.nc"
        ],
        "tasmin": [
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmin/v20240201/tasmin_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19860101-19901231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmin/v20240201/tasmin_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19810101-19851231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmin/v20240201/tasmin_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19760101-19801231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmin/v20240201/tasmin_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19710101-19751231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmin/v20240201/tasmin_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19660101-19701231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/tasmin/v20240201/tasmin_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19610101-19651231.nc"
        ],
        "sfcWind": [
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/sfcWind/v20240201/sfcWind_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19860101-19901231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/sfcWind/v20240201/sfcWind_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19810101-19851231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/sfcWind/v20240201/sfcWind_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19760101-19801231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/sfcWind/v20240201/sfcWind_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19710101-19751231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/sfcWind/v20240201/sfcWind_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19660101-19701231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/sfcWind/v20240201/sfcWind_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19610101-19651231.nc"
        ],
        "pvap": [
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/pvap/v20240201/pvap_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19860101-19901231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/pvap/v20240201/pvap_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19810101-19851231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/pvap/v20240201/pvap_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19760101-19801231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/pvap/v20240201/pvap_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19710101-19751231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/pvap/v20240201/pvap_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19660101-19701231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/pvap/v20240201/pvap_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19610101-19651231.nc"
        ],
        "rsds": [
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/rsds/v20240201/rsds_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19860101-19901231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/rsds/v20240201/rsds_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19810101-19851231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/rsds/v20240201/rsds_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19760101-19801231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/rsds/v20240201/rsds_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19710101-19751231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/rsds/v20240201/rsds_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19660101-19701231.nc",
            "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r1i1p1f1/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/day/rsds/v20240201/rsds_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r1i1p1f1_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_day_19610101-19651231.nc"
        ]
    },
    "alti_file": "/work/ch1187/freva-regiklim/data/model/regional/nukleus-btu/NUKLEUS/output/CEU-3/CLMcom-BTU/EC-Earth-Consortium-EC-Earth3-Veg/historical/r0i0p0/CLMcom-BTU-ICON-2-6-5-rc/nukleus-x2yn2-v1/fx/orog/v20240201/orog_CEU-3_EC-Earth-Consortium-EC-Earth3-Veg_historical_r0i0p0_CLMcom-BTU-ICON-2-6-5-rc_nukleus-x2yn2-v1_fx.nc",
    "cache_dir": "/scratch/k/k202187/pet/6450"
}

          and now this is the out directories:

          $ ls -la /scratch/k/k202187/pet/6450/
total 20796692
drwxr-xr-x 302 k202187 k20200      20480 Jan 20 17:42 .
drwxr-xr-x  27 k202187 k20200       4096 Jan 20 17:31 ..
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1900
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1901
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1902
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1903
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1904
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1905
drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:38 1906

.

.

.

drwxr-xr-x   2 k202187 k20200       4096 Jan 20 17:42 2199
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1961.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1962.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1963.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1964.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1965.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1966.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1967.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1968.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1969.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1970.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1971.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1972.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1973.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1974.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1975.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1976.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1977.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1978.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1979.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1980.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1981.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1982.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1983.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1984.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1985.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1986.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1987.nc
-rw-r--r--   1 k202187 k20200  119630744 Jan 20 17:39 APOTEVAP_S_1988.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:39 APOTEVAP_S_1989.nc
-rw-r--r--   1 k202187 k20200  119307728 Jan 20 17:40 APOTEVAP_S_1990.nc
-rw-r--r--   1 k202187 k20200    1202158 Jan 20 17:42 error.log
-rw-r--r--   1 k202187 k20200    1646415 Jan 20 17:38 orog_1900-2999.nc
-rw-r--r--   1 k202187 k20200      11659 Jan 20 17:31 out.json
-rw-r--r--   1 k202187 k20200 3542021986 Jan 20 17:36 pvap_1900-2999.nc
-rw-r--r--   1 k202187 k20200 3542021997 Jan 20 17:36 rsds_1900-2999.nc
-rw-r--r--   1 k202187 k20200 3542021990 Jan 20 17:37 sfcWind_1900-2999.nc
-rw-r--r--   1 k202187 k20200 3542021990 Jan 20 17:37 tasmax_1900-2999.nc
-rw-r--r--   1 k202187 k20200 3542021990 Jan 20 17:38 tasmin_1900-2999.nc
          Edited by Mostafa Hadizadeh
        • Bianca Wentzel
          Bianca Wentzel @k202206 ·
          Author Owner

          I will work an that and include it into the pvap-MR together with the orog-handling

        • Mostafa Hadizadeh
          Mostafa Hadizadeh @k202187 ·
          Owner

          Since it‘s creating the final data correctly at the end, could you please run the plugin for the correct datatime interval and not the big interval, to compare the elapsed times together and to see if the elapsed time decreases or not in comparison? If it decreases noteworthy then work on it, otherwise let‘s don’t invest time here.

        • Bianca Wentzel
          Bianca Wentzel @k202206 ·
          Author Owner

          Excellent suggestion! I will do that and depending on the result work on it.

        • Mostafa Hadizadeh
          Mostafa Hadizadeh @k202187 ·
          Owner

          And do u think, other out data regardless of APOTEVAP_S_*.nc are necessary to keep here? If no please add a functionality to remove them. Because it only increase the size of out.zip and also clutter the ch1187 storage space. Thanks

        • Mostafa Hadizadeh
          Mostafa Hadizadeh @k202187 ·
          Owner

          I think I was wrong, it’s cache stuff

        • Mostafa Hadizadeh
          Mostafa Hadizadeh @k202187 ·
          Owner

          No worries about the scratch. It automatically will be removed after a while

        • Bianca Wentzel
          Bianca Wentzel @k202206 ·
          Author Owner

          Okay. Yeah the other data is located in scratch so we will ignore it

        • Mostafa Hadizadeh
          Mostafa Hadizadeh @k202187 ·
          Owner

          please try the following configuration out and evaluate the result:

              __parameters__ = ParameterDictionary(
        SolrField(
            name="project",
            facet="project",
            mandatory=True,
            help="Product facet for input data search.",
            predefined_facets={
                "variable": ["hurs","sfcwind",],
                "time_frequency": ["1day"],
                "project": ["cmip6", "cordex", "nukleus", "reanalysis"]

            }),
        SolrField(
            name="product",
            facet="product",
            mandatory=True,
            help="Product facet for input data search.",
            predefined_facets={
                "variable": ["hurs"],
                "time_frequency": ["1day"],
            }),
        SolrField(
            name="institute",
            facet="institute",
            mandatory=True,
            help="Institute facet for input data search.",
            predefined_facets={

                "variable": ["hurs","sfcwind"],
                "time_frequency": ["1day"],
            }),
        SolrField(
            name="model",
            facet="model",
            mandatory=True,
            help="Model facet for input data search.",
            predefined_facets={

                "variable": ["hurs","sfcwind"],
                "time_frequency": ["1day"],
            }),
        SolrField(
            name="experiment",
            facet="experiment",
            mandatory=True,
            help="Experiment facet for input data search.",
            predefined_facets={

                "variable": ["hurs","sfcwind"],
                "time_frequency": ["1day"],
            }),
        SolrField(
            name="ensemble",
            facet="ensemble",
            mandatory=True,
            help="ensemble facet for input data search.",
            predefined_facets={

                "variable": ["hurs","sfcwind"],
                "time_frequency": ["1day"],
            }),
        Date(
            name="start_date",
            mandatory=False,
            default="1900-01-01",
            help="Insert start date you want to select (YYYY-MM-DD)"
        ),
        Date(
            name="end_date",
            mandatory=False,
            default="2999-01-01",
            help="Insert end date you want to select (YYYY-MM-DD)"
            ),
        String(
            name="region",
            default=None,
            help="Region box to be processed. The format have to be W,E,S,N (e.g. -180,180,0,90 for NH).\nLeave empty to select the region from input grid."
        ),
        Directory(
            name="output_dir",
            default="$USER_OUTPUT_DIR",
            help="Directory where output will be stored.",
        ),
        Bool(
            name="debug",
            default=False,
            help="Turn on to get better detailed debug information in case you face any issue."
        ),
    )
        • Please register or sign in to reply
      • Mostafa Hadizadeh mentioned in merge request !8 (merged)

        mentioned in merge request !8 (merged)

      • Bianca Wentzel mentioned in commit 3bb973ca

        mentioned in commit 3bb973ca

      • Bianca Wentzel closed with merge request !8 (merged)

        closed with merge request !8 (merged)

      Please register or sign in to reply

      Imprint | Privacy Policy