Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
R
rechunk-data
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package registry
Container Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ch1187
rechunk-data
Merge requests
!10
Increase test coverage
Code
Review changes
Check out branch
Download
Patches
Plain diff
Merged
Increase test coverage
test_coverage
into
main
Overview
0
Commits
2
Pipelines
2
Changes
1
Merged
Martin Bergemann
requested to merge
test_coverage
into
main
2 years ago
Overview
0
Commits
2
Pipelines
2
Changes
1
Expand
0
0
Merge request reports
Viewing commit
fe0d10d1
Prev
Next
Show latest version
1 file
+
7
−
2
Inline
Compare changes
Side-by-side
Inline
Show whitespace changes
Show one file at a time
fe0d10d1
Reformat with black
· fe0d10d1
Martin Bergemann
authored
2 years ago
src/rechunk_data/_rechunk.py
+
7
−
2
Options
@@ -44,7 +44,9 @@ def _save_dataset(
logger
.
debug
(
"
Saving file ot %s
"
,
str
(
file_name
))
try
:
dset
.
to_netcdf
(
file_name
,
engine
=
engine
,
encoding
=
encoding
,
file_name
,
engine
=
engine
,
encoding
=
encoding
,
)
except
Exception
as
error
:
logger
.
error
(
"
Saving to file failed: %s
"
,
str
(
error
))
@@ -70,7 +72,10 @@ def _rechunk_dataset(dset: xr.Dataset) -> Tuple[xr.Dataset, Dict[str, Any]]:
continue
dset
[
var
]
=
dset
[
var
].
chunk
(
dict
(
zip
(
dset
[
var
].
dims
,
new_chunks
)))
logger
.
debug
(
"
%s: old chunk size: %s, new chunk size: %s
"
,
var
,
old_chunks
,
new_chunks
,
"
%s: old chunk size: %s, new chunk size: %s
"
,
var
,
old_chunks
,
new_chunks
,
)
logger
.
debug
(
"
Settings encoding of variable %s
"
,
var
)
encoding
[
var
]
=
{
str
(
k
):
v
for
k
,
v
in
dset
[
var
].
encoding
.
items
()}
Loading