Towards the systematic simplification of mechanistic models

Mechanistic models used for prediction should be parsimonious, as models which are over-parameterised may have poor predictive performance. Determining whether a model is parsimonious requires comparisons with alternative model formulations with differing levels of complexity. However, creating alte...

Full description

Bibliographic Details
Main Authors: Cox, G.M., Gibbons, J.M., Wood, A.T.A., Ramsden, S.J., Crout, Neil J.M.
Format: Article
Published: Elsevier 2006
Online Access:https://eprints.nottingham.ac.uk/847/
_version_ 1848790490314440704
author Cox, G.M.
Gibbons, J.M.
Wood, A.T.A.
Ramsden, S.J.
Crout, Neil J.M.
author_facet Cox, G.M.
Gibbons, J.M.
Wood, A.T.A.
Ramsden, S.J.
Crout, Neil J.M.
author_sort Cox, G.M.
building Nottingham Research Data Repository
collection Online Access
description Mechanistic models used for prediction should be parsimonious, as models which are over-parameterised may have poor predictive performance. Determining whether a model is parsimonious requires comparisons with alternative model formulations with differing levels of complexity. However, creating alternative formulations for large mechanistic models is often problematic, and usually time-consuming. Consequently, few are ever investigated. In this paper, we present an approach which rapidly generates reduced model formulations by replacing a model’s variables with constants. These reduced alternatives can be compared to the original model, using data based model selection criteria, to assist in the identification of potentially unnecessary model complexity, and thereby inform reformulation of the model. To illustrate the approach, we present its application to a published radiocaesium plant-uptake model, which predicts uptake on the basis of soil characteristics (e.g. pH, organic matter content, clay content). A total of 1024 reduced model formulations were generated, and ranked according to five model selection criteria: Residual Sum of Squares (RSS), AICc, BIC, MDL and ICOMP. The lowest scores for RSS and AICc occurred for the same reduced model in which pH dependent model components were replaced. The lowest scores for BIC, MDL and ICOMP occurred for a further reduced model in which model components related to the distinction between adsorption on clay and organic surfaces were replaced. Both these reduced models had a lower RSS for the parameterisation dataset than the original model. As a test of their predictive performance, the original model and the two reduced models outlined above were used to predict an independent dataset. The reduced models have lower prediction sums of squares than the original model, suggesting that the latter may be overfitted. The approach presented has the potential to inform model development by rapidly creating a class of alternative model formulations, which can be compared.
first_indexed 2025-11-14T18:13:26Z
format Article
id nottingham-847
institution University of Nottingham Malaysia Campus
institution_category Local University
last_indexed 2025-11-14T18:13:26Z
publishDate 2006
publisher Elsevier
recordtype eprints
repository_type Digital Repository
spelling nottingham-8472020-05-04T20:29:47Z https://eprints.nottingham.ac.uk/847/ Towards the systematic simplification of mechanistic models Cox, G.M. Gibbons, J.M. Wood, A.T.A. Ramsden, S.J. Crout, Neil J.M. Mechanistic models used for prediction should be parsimonious, as models which are over-parameterised may have poor predictive performance. Determining whether a model is parsimonious requires comparisons with alternative model formulations with differing levels of complexity. However, creating alternative formulations for large mechanistic models is often problematic, and usually time-consuming. Consequently, few are ever investigated. In this paper, we present an approach which rapidly generates reduced model formulations by replacing a model’s variables with constants. These reduced alternatives can be compared to the original model, using data based model selection criteria, to assist in the identification of potentially unnecessary model complexity, and thereby inform reformulation of the model. To illustrate the approach, we present its application to a published radiocaesium plant-uptake model, which predicts uptake on the basis of soil characteristics (e.g. pH, organic matter content, clay content). A total of 1024 reduced model formulations were generated, and ranked according to five model selection criteria: Residual Sum of Squares (RSS), AICc, BIC, MDL and ICOMP. The lowest scores for RSS and AICc occurred for the same reduced model in which pH dependent model components were replaced. The lowest scores for BIC, MDL and ICOMP occurred for a further reduced model in which model components related to the distinction between adsorption on clay and organic surfaces were replaced. Both these reduced models had a lower RSS for the parameterisation dataset than the original model. As a test of their predictive performance, the original model and the two reduced models outlined above were used to predict an independent dataset. The reduced models have lower prediction sums of squares than the original model, suggesting that the latter may be overfitted. The approach presented has the potential to inform model development by rapidly creating a class of alternative model formulations, which can be compared. Elsevier 2006 Article PeerReviewed Cox, G.M., Gibbons, J.M., Wood, A.T.A., Ramsden, S.J. and Crout, Neil J.M. (2006) Towards the systematic simplification of mechanistic models. Ecological Modelling, 198 . pp. 240-246. http://www.elsevier.com/wps/find/journaldescription.cws_home/503306/description#description
spellingShingle Cox, G.M.
Gibbons, J.M.
Wood, A.T.A.
Ramsden, S.J.
Crout, Neil J.M.
Towards the systematic simplification of mechanistic models
title Towards the systematic simplification of mechanistic models
title_full Towards the systematic simplification of mechanistic models
title_fullStr Towards the systematic simplification of mechanistic models
title_full_unstemmed Towards the systematic simplification of mechanistic models
title_short Towards the systematic simplification of mechanistic models
title_sort towards the systematic simplification of mechanistic models
url https://eprints.nottingham.ac.uk/847/
https://eprints.nottingham.ac.uk/847/