Skip to content

Handle data from different storage tiers

During global hackathon, zarr+healpix datasets were submitted by different data providers across the globe on different object stores at their locations. To perform quality checks on those datasets without actually downloading the data, implementations are needed to interface with those respective object stores, for example even at DKRZ s3, swift object stores need different interface.