Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
C
climatedt-request
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Deploy
Releases
Package registry
Model registry
Operate
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
lkluft
climatedt-request
Compare revisions
5ec1674bc917e21ee813e3f1351c052dcd02720f to ba70ebb61f447137077fbfd253e4da61db2c7402
Compare revisions
Changes are shown as if the
source
revision was being merged into the
target
revision.
Learn more about comparing revisions.
Source
lkluft/climatedt-request
Select target project
No results found
ba70ebb61f447137077fbfd253e4da61db2c7402
Select Git revision
Swap
Target
lkluft/climatedt-request
Select target project
lkluft/climatedt-request
1 result
5ec1674bc917e21ee813e3f1351c052dcd02720f
Select Git revision
Show changes
Only incoming changes from source
Include changes to target since source was created
Compare
Commits on Source (3)
Flush python output for correct log order
· 904eca19
Lukas Kluft
authored
10 months ago
904eca19
Only create non-existing weights
· 4d84fd8e
Lukas Kluft
authored
10 months ago
4d84fd8e
Process GRIB data per month for better performance
· ba70ebb6
Lukas Kluft
authored
10 months ago
ba70ebb6
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
postprocess.sh
+11
-7
11 additions, 7 deletions
postprocess.sh
request.py
+2
-2
2 additions, 2 deletions
request.py
with
13 additions
and
9 deletions
postprocess.sh
View file @
ba70ebb6
...
...
@@ -7,11 +7,15 @@ set -o errexit -o nounset -o xtrace
weights_file
=
'weights/weights_hpz10_global_1x1.nc'
cdo
\
-f
nc4
\
-gennn
,global_1x1
\
-const
,1,hpz7
\
"
${
weights_file
}
"
if
[[
!
-f
$weights_file
]]
;
then
cdo
\
-f
nc4
\
-gennn
,global_1x1
\
-const
,1,hpz7
\
"
${
weights_file
}
"
fi
year
=
$1
cdo
\
-f
nc4
\
...
...
@@ -20,5 +24,5 @@ cdo \
-hpdegrade
,nside
=
128
\
-monmean
\
-mergetime
\
data/icon_historical_
*
.grib2
\
data/icon_historical_
1992
.nc
data/icon_historical_
${
year
}
*
.grib2
\
data/icon_historical_
monmean_1x1_
${
year
}
.nc
This diff is collapsed.
Click to expand it.
request.py
View file @
ba70ebb6
...
...
@@ -52,7 +52,7 @@ def download(year=1992):
outfile
=
f
"
data/icon_historical_
{
year
}{
month
:
02
d
}
.grib2
"
if
Path
(
outfile
).
is_file
():
print
(
f
"
{
outfile
}
already exists.
"
)
print
(
f
"
{
outfile
}
already exists.
"
,
flush
=
True
)
continue
files
=
client
.
retrieve
(
...
...
@@ -62,7 +62,7 @@ def download(year=1992):
append
=
False
,
)
except
HTTPResponseError
as
err
:
print
(
err
)
print
(
err
,
flush
=
True
)
def
main
():
...
...
This diff is collapsed.
Click to expand it.