Revisiting the Basis of Sensitivity Analysis for Dynamical Earth System Models

Hoshin V. Gupta, Saman Razavi

Research output: Contribution to journalArticlepeer-review

60 Scopus citations

Abstract

This paper investigates the problem of global sensitivity analysis (GSA) of Dynamical Earth System Models and proposes a basis for how such analyses should be performed. We argue that (a) performance metric-based approaches to parameter GSA are actually identifiability analyses, (b) the use of a performance metric to assess sensitivity unavoidably distorts the information provided by the model about relative parameter importance, and (c) it is a serious conceptual flaw to interpret the results of such an analysis as being consistent and accurate indications of the sensitivity of the model response to parameter perturbations. Further, because such approaches depend on availability of system state/output observational data, the analysis they provide is necessarily incomplete. Here we frame the GSA problem from first principles, using trajectories of the partial derivatives of model outputs with respect to controlling factors as the theoretical basis for sensitivity, and construct a global sensitivity matrix from which statistical indices of total period time-aggregate parameter importance, and time series of time-varying parameter importance, can be inferred. We demonstrate this framework using the HBV-SASK conceptual hydrologic model applied to the Oldman basin in Canada and show that it disagrees with performance metric-based methods regarding which parameters exert the strongest controls on model behavior. Further, it is highly efficient, requiring less than 1,000 base samples to obtain stable and robust parameter importance assessments for our 10-parameter example.

Original languageEnglish (US)
Pages (from-to)8692-8717
Number of pages26
JournalWater Resources Research
Volume54
Issue number11
DOIs
StatePublished - Nov 2018

Keywords

  • Parameter importance analysis
  • dynamical systems
  • efficiency and robustness
  • global sensitivity analysis
  • global sensitivity matrix
  • time-varying sensitivity

ASJC Scopus subject areas

  • Water Science and Technology

Fingerprint

Dive into the research topics of 'Revisiting the Basis of Sensitivity Analysis for Dynamical Earth System Models'. Together they form a unique fingerprint.

Cite this