Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
99 commits
Select commit Hold shift + click to select a range
d3a2245
resolved conflict
mariusaurus Dec 1, 2025
0189d52
update changelog
dallasfoster Sep 19, 2025
f11b18b
move seed initialization and fix dxwrapper tests
dallasfoster Sep 19, 2025
d063760
tempest extremes diagnostic model
mariusaurus Sep 15, 2025
a4d2544
error message
mariusaurus Sep 25, 2025
c1cdca0
testing if TE is available and works
mariusaurus Sep 25, 2025
016f16b
started working on support for batch sizes >1, currently works for bs 1
mariusaurus Sep 25, 2025
68e33b5
halfway to larger batch support
mariusaurus Sep 25, 2025
7bd60e1
enabling TE for batch sizes of >1. async version seems to work as wel…
mariusaurus Sep 26, 2025
3b0c00e
option to pass file names to TE connector
mariusaurus Sep 29, 2025
1e9bbe8
array equal test
mariusaurus Sep 29, 2025
d6be6dd
first stable try
mariusaurus Oct 7, 2025
1e9b275
support for per-member parallel execution and lets user controll max …
mariusaurus Oct 7, 2025
b5f5c18
precommit hooks
mariusaurus Oct 7, 2025
af8bc71
vibe-coded some tests, need to be hand-tested and selected
mariusaurus Oct 7, 2025
a9fd2bc
vibe-coded some tests, need to be hand-tested and selected
mariusaurus Oct 7, 2025
526e6bf
passing all pre-commit tests, still need to sub-select tests as there…
mariusaurus Oct 7, 2025
c3258d9
subselected tests
mariusaurus Oct 7, 2025
3fd145d
install doc
mariusaurus Oct 8, 2025
c26f453
throwing an error in case cleanup is not called before object goes ou…
mariusaurus Oct 8, 2025
d2a8e4a
custom depenmdency failure message for TE
mariusaurus Oct 8, 2025
0ab6d67
moved tensor tiling and concatenation to utils
mariusaurus Oct 8, 2025
8ca3fae
enable setting fcn3 random seed
dallasfoster Sep 19, 2025
e93932e
add proper noise handling for fcn3
dallasfoster Sep 19, 2025
bc9e3ac
fix linting and test issues
dallasfoster Sep 19, 2025
2685f90
update lockfile
dallasfoster Sep 19, 2025
e3a4e3d
move seed initialization and fix dxwrapper tests
dallasfoster Sep 19, 2025
1dec990
tc tracking pipeline
mariusaurus Oct 13, 2025
02945f1
update
mariusaurus Oct 13, 2025
f89efe3
updated uv.lock
mariusaurus Oct 13, 2025
92896eb
seems to work now
mariusaurus Oct 13, 2025
9e0e106
wind gust from HRRR analysis
mariusaurus Oct 14, 2025
5550ad9
minor updates
mariusaurus Oct 14, 2025
869b8fe
stability test
mariusaurus Oct 24, 2025
343d035
version check for torch-harmonics import
mariusaurus Oct 24, 2025
037a5a7
addressed greptile comments
mariusaurus Oct 30, 2025
608315b
time import
mariusaurus Oct 30, 2025
3f55702
comma
mariusaurus Oct 30, 2025
7fefe5b
merged main
mariusaurus Jan 9, 2026
dc0cd79
updated env
mariusaurus Jan 9, 2026
70361a7
moved tempest_extremes
mariusaurus Jan 9, 2026
e172e50
wip
mariusaurus Jan 9, 2026
edb1978
exploring aifs ensemble capability
mariusaurus Jan 13, 2026
e3b2ed0
Merge branch 'main' into mkoch/tc_tracking
mariusaurus Jan 13, 2026
8c3c848
thread issue with writing to netcdf in threads
mariusaurus Jan 13, 2026
d41351e
automated testing of writing TE files and their reproducibility. bug …
mariusaurus Jan 14, 2026
780e458
README for tc_hunt test
mariusaurus Jan 14, 2026
4360ea4
second test for extracting historic data
mariusaurus Jan 14, 2026
8f766f5
added aux data for tests
mariusaurus Jan 14, 2026
5bd90c6
merged main
mariusaurus Jan 15, 2026
f3286fb
test for reference track extraction
mariusaurus Jan 15, 2026
3638bcc
wip
mariusaurus Jan 16, 2026
5b7ae87
track plotting notebook
mariusaurus Jan 16, 2026
3002fd0
field and track notebook
mariusaurus Jan 16, 2026
0b968b3
plotting tracks and fields notebook
mariusaurus Jan 19, 2026
67f7fc6
case study notebook
mariusaurus Jan 20, 2026
2df89f7
Merge branch 'main' into mkoch/tc_tracking
mariusaurus Jan 20, 2026
0f046a1
REAMEs and markdowns in notebooks
mariusaurus Jan 20, 2026
fbdbc9f
drafted readme
mariusaurus Jan 21, 2026
b495b31
first iteration over readme
mariusaurus Jan 22, 2026
ad4717c
final touches README
mariusaurus Jan 22, 2026
34fda29
...gif
mariusaurus Jan 22, 2026
78dc346
wip
mariusaurus Jan 23, 2026
b76a7d3
Merge branch 'main' into mkoch/tc_tracking
mariusaurus Jan 23, 2026
fb7f207
verified plotting for west-pacific
mariusaurus Jan 23, 2026
d4926cf
final touches
mariusaurus Jan 23, 2026
f0fcff0
removed some configs
mariusaurus Jan 23, 2026
2c8eaf3
pyproject project name
mariusaurus Jan 23, 2026
b4af03e
README comment about conainer build time
mariusaurus Jan 23, 2026
1bf9850
removed TE from models/dx/__init__
mariusaurus Jan 23, 2026
99ae8ba
moving a bracket around
mariusaurus Jan 23, 2026
6048522
Merge branch 'main' into mkoch/tc_tracking
mariusaurus Feb 10, 2026
5da7854
updated base container
mariusaurus Feb 18, 2026
ff5dcba
Merge branch 'main' into mkoch/tc_tracking
mariusaurus Feb 19, 2026
acd0354
Merge branch 'mkoch/tc_tracking' of github.com:mariusaurus/earth2stud…
mariusaurus Feb 19, 2026
f067969
merged main, might be broken
mariusaurus Mar 10, 2026
6c85a95
Merge branch 'mkoch/tc_tracking' of github.com:mariusaurus/earth2stud…
mariusaurus Mar 10, 2026
2f4b495
fixed some bugs to be in line with new main
mariusaurus Mar 11, 2026
84609e3
split plan
mariusaurus Mar 11, 2026
b53a3eb
first round of LLM reduction
mariusaurus Mar 11, 2026
8032f20
doc strings and type hints for generate_ensembles.py
mariusaurus Mar 11, 2026
5edac8b
doc strings and type hints for tempest_extremes.py
mariusaurus Mar 11, 2026
41c3248
doc strings and type hints for src/utils.py
mariusaurus Mar 11, 2026
9c2104d
doc strings and type hints for data
mariusaurus Mar 11, 2026
6f8c3d5
orography from HF
mariusaurus Mar 18, 2026
3167014
git lfs in dockerfile
mariusaurus Mar 18, 2026
16d18fe
final touches
mariusaurus Mar 18, 2026
aa360b2
final touches
mariusaurus Mar 18, 2026
6d58f4f
Merge branch 'main' into mkoch/tc_hunt_1
mariusaurus Mar 18, 2026
6bcbb5a
reverted fcn3 changes
mariusaurus Mar 18, 2026
3a9a5cf
updated dockerfile to latest physics nemo container and reduced numbe…
mariusaurus Mar 18, 2026
342caf5
first round of pre-commit hooks
mariusaurus Mar 18, 2026
731231b
licenses
mariusaurus Mar 18, 2026
e0b01b2
renamed some files and removed tempest_extremes testing
mariusaurus Mar 18, 2026
cecdcb7
TE list files unique by time stamp
mariusaurus Mar 19, 2026
a2c7510
Te timeouts
mariusaurus Mar 19, 2026
82fa33c
improved catching of TE failures
mariusaurus Mar 19, 2026
98b80c8
satisfying the greptile
mariusaurus Mar 19, 2026
a897748
TE workers
mariusaurus Mar 19, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0

### Added

- Added tropical cyclone tracking recipe with async TempestExtremes integration
- Added NOAA UFS observation dataframe sources for satellite and conventional data
- Added Earth2Studio base schema for dataframe sources
- Added Planetary Computer data source for ECMWF IFS analysis data
Expand Down
14 changes: 12 additions & 2 deletions docs/userguide/about/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -522,8 +522,8 @@ uv add earth2studio --extra corrdiff
::::
:::::
:::::{tab-item} Cyclone Trackers
Notes: Additional dependencies for all cyclone tracking models. Only Python 3.12 and
below support.
Notes: Additional dependencies for cyclone tracking models `TCTrackerVitart` and `TCTrackerWuDuan`.
Only Python 3.12 and below support.

::::{tab-set}
:::{tab-item} uv
Expand All @@ -539,6 +539,16 @@ uv pip install earth2studio --extra cyclone
pip install earth2studio[cyclone]
```

`TempestExtremes` is not provided as a Python library and must be installed
separately by the user. Installation instructions can be found on the
[TempestExtremes GitHub page](https://github.com/ClimateGlobalChange/tempestextremes?tab=readme-ov-file#installation-via-cmake-recommended).

By default, `TempestExtremes` binaries are installed to the bin folder of the
`TempestExtremes` repository. Users can specify paths to executables by passing
the detect and stitch commands to the initialisation of the `TempestExtremes`
class in earth2studio. Examples for both commands are provided in the docstring
of this class.

:::
::::
:::::
Expand Down
15 changes: 15 additions & 0 deletions recipes/tc_tracking/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# Python-generated files
__pycache__/
*.py[oc]
build/
dist/
wheels/
*.egg-info
outputs*/
*.zarr
*.nc
*.gif
.python-version

# Virtual environments
.venv
27 changes: 27 additions & 0 deletions recipes/tc_tracking/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
FROM nvcr.io/nvidia/physicsnemo/physicsnemo:26.03

ENV PATH="/root/.local/bin:$PATH" \
CC=/usr/bin/gcc \
CXX=/usr/bin/g++ \
FORCE_CUDA_EXTENSION=1 \
TORCH_CUDA_ARCH_LIST="8.0 8.6 9.0 10.0 12.0+PTX"

RUN apt update -y && \
apt install -y libibmad5 unixodbc git-lfs netcdf-bin libnetcdf-dev && \
git lfs install && \
apt remove cmake -y && \
pip install cmake --upgrade && \
wget -qO- https://astral.sh/uv/install.sh | sh && \
cd / && \
git clone https://github.com/ClimateGlobalChange/tempestextremes.git && \
mkdir -p /tempestextremes/build && \
cd /tempestextremes/build && \
cmake .. && \
make -j && \
cp ./bin/DetectNodes /usr/local/bin && \
cp ./bin/StitchNodes /usr/local/bin

COPY . /tc_tracking_src

RUN cd /tc_tracking_src && \
uv pip install --system --break-system-packages --no-cache-dir .
Loading