Sovereign 8s.is mirror of standardgalactic/gupta_etal_2025_scientific_data
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2026-01-29 09:28:47 -05:00
code Add files via upload 2025-09-11 12:00:39 -04:00
data Add files via upload 2025-09-11 12:01:18 -04:00
figures Add files via upload 2025-09-11 12:01:04 -04:00
README.md Update README.md 2026-01-29 09:28:47 -05:00

DOI

Gupta-etal_2025_nature_scientific_data

Rohini S. Gupta 1*, Sungwook Wi 1*, Scott Steinschneider1
1 Department of Biological and Environmental Engineering, Cornell University, Ithaca, NY
Corresponding author: rg727@cornell.edu


Abstract

High-quality regional streamflow datasets are necessary to support local water resources planning and management. However, observed streamflow records are often limited by the availability of surface water gauges, which frequently go in and out of service over time. Long-term reconstruction products that fill in missing data are not consistently available. This challenge is prevalent across the United States, including in the Great Lakes region, which contains 20% of the world’s freshwater and serves as a critical resource for both the United States and Canada. In the Great Lakes, there is also a specific interest in estimating aggregate runoff into the lakes to better understand the regional water balance and lake level variability. Existing aggregate runoff data products are typically derived from runoff area ratios or process-based models, but these approaches are hindered by model parameter uncertainty and a limited ability to capture the vast spatial heterogeneity of the basin. Furthermore, of the products that exist, most do not start until 1980. In this work, we develop a new, historical reconstruction of daily streamflow at over 650 gauged locations throughout the Great Lakes basin using a novel regional Long Short-Term Memory (LSTM) model that integrates local climate data, physical catchment characteristics, and runoff observations from nearby gauged sites. We also estimate monthly runoff into the lakes for the period of 1951–2013. The daily reconstruction product will equip water managers with information to understand emerging hydroclimate trends and provide a basis to support local water resources analyses. The aggregate runoff product shows strong potential for improving estimates of monthly lake-wide runoff, which can ultimately help resolve the complete water balance of the Great Lakes and provide critical context for lake level shifts under a changing climate.


Journal reference

Gupta, R. S., Wi, S., Steinschneider, S. (In Review). Machine Learning-Based Reconstructions of Historical Daily and Monthly Runoff for the Laurentian Great Lakes Region. Nature: Scientific Data


Code reference

All code to reproduce the dataset and figures is found in this repository or is linked below.


Data reference

Output Data

Gupta, R.S., Wi, S., Steinschneider, S. (2025). Laurentian Great Lakes Daily and Monthly Runoff (1951-2013) (Version v1) [Data set]. Zenodo.
🔗 https://doi.org/10.5281/zenodo.16897689


Reproduce My Experiment

1. Produce Training Data

The training data for the LSTM models is a combination of US and Canada streamflow runoff, meteorology, and physical catchment characteristics.

Data Source Description
USGS Runoff for the US Gauges
Water Survey Canada Runoff for the Canada Gauges
Livneh Meterology
HYDROSHEDS Elevation and Slope Data
NALCMS Land Use Data
GSDE Soil Composition

The gauges that are active for each modeling subperiod are in listed in data/gauges/. The following scripts show the workflow for developing the training data.

Script Name Description
/code/pre_processing/identifyNewGauges.py Example script of how to download USGS/WSC runoff data
/code/pre_processing/makegeophysicaldatasets Example script of how to create the physical characteristic datasets
/code/pre_processing/createTrainingSets Example script of how to create the finalized training dataset with neighbors

An example of what a final training dataset looks like is shown in data/training_set/. If a users is in need of the comprehensive training sets, please reach out to Rohini (rg727@cornell.edu)


2. Train the LSTM models

In this study, we create two LSTM models: LSTMClim which is conditioned just on meteorology and physical characteristics, and LSTMClim+Dnr which includes neighboring donor gauges as an additional set of inputs. The code used to train these models needs PyTorch and was run on the Delta supercomputer at the University of Illinois at Urbana-Champaign. A different model is trained across all active gauges for each sub-period (see paper for more details)

Script Name Description
/code/training/train_LSTM_Clim.py Example script of LSTMClim training code
/code/training/train_LSTM_Clim_Dnr.py Example script of LSTMClim+Dnr training code

3. Prediction Across 656 Gauges (Daily Product)

Once the models are trained, we used them to predict streamflow for the corresponding sub-period across all 656 gauges.

Script Name Description
/code/prediction/predict_LSTM_Clim.py Example script of LSTMClim prediction code
/code/prediction/predict_LSTM_Clim_Dnr.py Example script of LSTMClim+Dnr prediction code

4. Prediction across 128 GLERL catchments (Monthly Product)

Using the trained LSTMClim+Dnr model, we also make predictions at the outlet of 128 catchments that drain directly into the Great Lakes. These daily predictions are then adjusted where upstream observed streamflow is available.

Script Name Description
/code/prediction/predict_GLERL.py Example script of using the LSTMClim+Dnr code to predict runoff at the outlet of the GLERL basins
/code/prediction/adjust_GLERL_predictions.py Example script that adjusts the GLERL predictions with observed streamflows

5. Make Figures

Script Name Description
/figures/makeFigure1.py Makes the maps of the active streamflow gauges for each modeling period
/figures/makeFigure3.py Makes NSE CDF plots to compare performance across the LSTM models
/figures/makeFigure4.py Calculates metrics (KGE, PBIAS, FLV, FHV) across the LSTM models
/figures/makeFigure5.py Makes NSE CDF plots to compare performance across the LSTM models, (natural vs regulated gauges)
/figures/makeFigure6.py Make spatial plots comparing LSTMClim and LSTMClim+Dnr
/figures/makeFigure7.py Make spatial plots comparing LSTMClim+Dnr out of sample in space and time
/figures/makeFigure8.py Make hydrographs for selected gauges
/figures/makeFigure9.py Plot monthly runoff comparison

6. Final Data Products

The final data products can be found at this Zenodo repository.