-
-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Closed
Labels
topic-DataTreeRelated to the implementation of a DataTree classRelated to the implementation of a DataTree classtopic-performancetopic-zarrRelated to zarr storage libraryRelated to zarr storage library
Description
What is your issue?
Hi all,
I was trying to open a datatree stored in a s3 bucket but it is taking too long.
from xarray.backends.api import open_datatree
URL = 'https://js2.jetstream-cloud.org:8001/'
path = f'pythia/radar/erad2024'
fs = s3fs.S3FileSystem(anon=True, client_kwargs=dict(endpoint_url=URL))
file = s3fs.S3Map(f"{path}/zarr_radar/erad_2024.zarr", s3=fs)
dt = open_datatree(file, engine='zarr', consolidated=True)
When digging around, I discovered some parameters/arguments such as mode
, consolidated
, ..., were not being passed to ZarrStore.open_store
function here.
xarray/xarray/backends/zarr.py
Line 1236 in da9e7ec
stores = ZarrStore.open_store(filename_or_obj, group=parent) |
Metadata
Metadata
Assignees
Labels
topic-DataTreeRelated to the implementation of a DataTree classRelated to the implementation of a DataTree classtopic-performancetopic-zarrRelated to zarr storage libraryRelated to zarr storage library