Skip to content

GitLab

Closed
Created by Aaron Spring@m300524

empty 0-size files: nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1

I found files of size 0, which cannot be opened with CDO or xarray. Should I report such files also somewhere else? @k204210

Can we add a check avoid such files when creating in the catalogs?

ls -all /mnt/lustre02/work/ik1017/CMIP6/data/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/piControl/r1i1p1f1/Lmon/nbp/gr/v20210114

total 8
drwxr-sr-x 2 k204210 esgf 4096 Mar 16 16:20 ./
drwxr-sr-x 3 k204210 esgf 4096 Mar 16 16:20 ../
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_191401-191412.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_199301-199312.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_200201-200212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_201801-201812.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_202501-202512.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_205001-205012.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_208401-208412.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_216701-216712.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_218801-218812.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_221701-221712.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_224201-224212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_226201-226212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_226301-226312.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_229401-229412.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_233201-233212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_234101-234112.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_234301-234312.nc

also opendap does seem to work:

xarray.open_dataset('http://esgf3.dkrz.de/thredds/dodsC/cmip6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/piControl/r1i1p1f1/Lmon/nbp/gr/v20210114/nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_191401-191412.nc')
...
    file, cached = self._acquire_with_cache_info(needs_lock)
  File "/work/mh0727/m300524/conda-envs/s2s-ai/lib/python3.7/site-packages/xarray/backends/file_manager.py", line 205, in _acquire_with_cache_info
    file = self._opener(*self._args, **kwargs)
  File "netCDF4/_netCDF4.pyx", line 2291, in netCDF4._netCDF4.Dataset.__init__
  File "netCDF4/_netCDF4.pyx", line 1855, in netCDF4._netCDF4._ensure_nc_success
OSError: [Errno -70] NetCDF: DAP server error: b'http://esgf3.dkrz.de/thredds/dodsC/cmip6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/piControl/r1i1p1f1/Lmon/nbp/gr/v20210114/nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_191401-191412.nc'

Imprint | Privacy Policy