Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • I intake-esm_support
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 5
    • Issues 5
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • data-infrastructure-services
  • intake-esm_support
  • Issues
  • #11
Closed
Open
Issue created Apr 09, 2021 by Aaron Spring@m300524

empty 0-size files: nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1

I found files of size 0, which cannot be opened with CDO or xarray. Should I report such files also somewhere else? @k204210

Can we add a check avoid such files when creating in the catalogs?

ls -all /mnt/lustre02/work/ik1017/CMIP6/data/CMIP6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/piControl/r1i1p1f1/Lmon/nbp/gr/v20210114

total 8
drwxr-sr-x 2 k204210 esgf 4096 Mar 16 16:20 ./
drwxr-sr-x 3 k204210 esgf 4096 Mar 16 16:20 ../
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_191401-191412.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_199301-199312.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_200201-200212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_201801-201812.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_202501-202512.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_205001-205012.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_208401-208412.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_216701-216712.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_218801-218812.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_221701-221712.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_224201-224212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_226201-226212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_226301-226312.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_229401-229412.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_233201-233212.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_234101-234112.nc
-r--r--r-- 1 k204210 esgf    0 Feb 15 19:36 nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_234301-234312.nc

also opendap does seem to work:

xarray.open_dataset('http://esgf3.dkrz.de/thredds/dodsC/cmip6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/piControl/r1i1p1f1/Lmon/nbp/gr/v20210114/nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_191401-191412.nc')
...
    file, cached = self._acquire_with_cache_info(needs_lock)
  File "/work/mh0727/m300524/conda-envs/s2s-ai/lib/python3.7/site-packages/xarray/backends/file_manager.py", line 205, in _acquire_with_cache_info
    file = self._opener(*self._args, **kwargs)
  File "netCDF4/_netCDF4.pyx", line 2291, in netCDF4._netCDF4.Dataset.__init__
  File "netCDF4/_netCDF4.pyx", line 1855, in netCDF4._netCDF4._ensure_nc_success
OSError: [Errno -70] NetCDF: DAP server error: b'http://esgf3.dkrz.de/thredds/dodsC/cmip6/CMIP/EC-Earth-Consortium/EC-Earth3-CC/piControl/r1i1p1f1/Lmon/nbp/gr/v20210114/nbp_Lmon_EC-Earth3-CC_piControl_r1i1p1f1_gr_191401-191412.nc'
Assignee
Assign to
Time tracking

Imprint | Privacy Policy