How to parallel write zarr file on dask? #2959
Replies: 2 comments
Since you mentioned NetCDF, I'm going to guess you're using Xarray import xarray as xr
ds = xr.open_mfdataset(list_of_netcdf_files)
ds.to_zarr("out.zarr") |
0 replies
|
Yes, I am using xarray, Thank you very much. It's simple and efficient. I try write these files one by one. So it's complex and difficult. I have succeed by write them once. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
I want to writea a lot of netcdf files into one zarr file on dask. But I met something wrong. It seems like the metadata confliction. I try a lots methods. But there are always some problems. What's the best way to write zarr file in parallel on dask? Any suggestion is helpful. Thanks.
All reactions