TY - JOUR
T1 - An R package to partition observation data used for model development and evaluation to achieve model generalizability
AU - Ji, Yiran
AU - Zheng, Feifei
AU - Wen, Jinhua
AU - Li, Qifeng
AU - Chen, Junyi
AU - Maier, Holger R.
AU - Gupta, Hoshin V.
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2025/1
Y1 - 2025/1
N2 - Development of environmental models generally requires available data to be split into “development” and “evaluation” subsets. How this is done can significantly affect a model's outputs and performance. However, data splitting is generally done in a subjective, ad-hoc manner, with little justification, raising questions regarding the reliability of the findings of many modelling studies. To address this issue, we present and demonstrate the value of an R-package along with high-level guidelines for implementing many state-of-the-art data splitting methods in order to develop the model in a considered, defensible, consistent, repeatable and transparent fashion, thereby improving the generalizability of the resulting models. Results from two rainfall-runoff case studies show that models with high generalization ability can be achieved even when the available data contain rare, extreme events. Additionally, data splitting methods can be used to explicitly quantify the parameter uncertainty associated with data splitting and the resulting bounds on model predictions.
AB - Development of environmental models generally requires available data to be split into “development” and “evaluation” subsets. How this is done can significantly affect a model's outputs and performance. However, data splitting is generally done in a subjective, ad-hoc manner, with little justification, raising questions regarding the reliability of the findings of many modelling studies. To address this issue, we present and demonstrate the value of an R-package along with high-level guidelines for implementing many state-of-the-art data splitting methods in order to develop the model in a considered, defensible, consistent, repeatable and transparent fashion, thereby improving the generalizability of the resulting models. Results from two rainfall-runoff case studies show that models with high generalization ability can be achieved even when the available data contain rare, extreme events. Additionally, data splitting methods can be used to explicitly quantify the parameter uncertainty associated with data splitting and the resulting bounds on model predictions.
KW - Data partitioning
KW - Environmental models
KW - Model development
KW - R-package
UR - http://www.scopus.com/inward/record.url?scp=85207185370&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85207185370&partnerID=8YFLogxK
U2 - 10.1016/j.envsoft.2024.106238
DO - 10.1016/j.envsoft.2024.106238
M3 - Article
AN - SCOPUS:85207185370
SN - 1364-8152
VL - 183
JO - Environmental Modelling and Software
JF - Environmental Modelling and Software
M1 - 106238
ER -