Technical note: An approach for handling multiple temporal frequencies with different input dimensions using a single LSTM cell

Another approach for handling multiple frequencies in a single LSTM based model.

Abstract

Long Short-Term Memory (LSTM) networks have demonstrated state-of-the-art performance for rainfall-runoff hydrological modeling. However, most studies focus on daily-scale predictions, limiting the benefits of sub-daily (e.g. hourly) predictions in applications like flood forecasting. Moreover, training an LSTM exclusively on sub-daily data is computationally expensive, and may lead to model-learning difficulties due to the extended sequence lengths. In this study, we introduce a new architecture, multi-frequency LSTM (MF-LSTM), designed to use input of various temporal frequencies to produce sub-daily (e.g. hourly) predictions at a moderate computational cost. Building on two existing methods previously proposed by coauthors of this study, the MF-LSTM processes older inputs at coarser temporal resolutions than more recent ones. The MF-LSTM gives the possibility to handle different temporal frequencies, with different number of input dimensions, in a single LSTM cell, enhancing generality and simplicity of use. Our experiments, conducted on 516 basins from the CAMELS-US dataset, demonstrate that MF-LSTM retains state-of-the-art performance while offering a simpler design. Moreover, the MF-LSTM architecture reported a 5x reduction in processing time, compared to models trained exclusively on hourly data.

Paper: Acuña Espinoza, E., Kratzert, F., Klotz, D., Gauch, M., Álvarez Chaves, M., Loritz, R., and Ehret, U.: Technical note: An approach for handling multiple temporal frequencies with different input dimensions using a single LSTM cell, EGUsphere [preprint], https://doi.org/10.5194/egusphere-2024-3355, 2024.

The code repository is available at https://github.com/eduardoAcunaEspinoza/.

Citation

@Article{espinoza2024multifreq,
author = {Acu\~na Espinoza, E. and Kratzert, F. and Klotz, D. and Gauch, M. and \'Alvarez Chaves, M. and Loritz, R. and Ehret, U.},
title = {Technical note: An approach for handling multiple temporal frequencies with different input dimensions using a single LSTM cell},
journal = {EGUsphere},
volume = {2024},
year = {2024},
pages = {1--12},
doi = {10.5194/egusphere-2024-3355}
}