Information-theoretic and Bayesian model selection for physics-based modeling: Balancing fit, complexity, and generalization

•Review information-theoretic and Bayesian criteria for model selection.•Address the trade-off between model fit, complexity, and generalization.•Investigate the sensitivity of selection criteria to influential calibration factors.•Propose a heat transfer case study with a model hierarchy of increas...

Celý popis

Uloženo v:

Podrobná bibliografie
Vydáno v:	Information sciences Ročník 726; s. 122743
Hlavní autoři:	Xu, Xinyue, Wang, Julian
Médium:	Journal Article
Jazyk:	angličtina
Vydáno:	Elsevier Inc 01.02.2026
Témata:	Bayesian inference Information-theoretic criteria Model calibration Model selection Physics-based models Uncertainty quantification Uncertainty quantification Physics-based models Model calibration Bayesian inference Model selection Information-theoretic criteria
ISSN:	0020-0255
On-line přístup:	Získat plný text
Tagy:	Přidat tag Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!

Popis
Shrnutí:	•Review information-theoretic and Bayesian criteria for model selection.•Address the trade-off between model fit, complexity, and generalization.•Investigate the sensitivity of selection criteria to influential calibration factors.•Propose a heat transfer case study with a model hierarchy of increasing fidelity.•Identify effective complexity for thermal modeling in double-pane windows. Reliable model selection is a cornerstone of developing physics-based models of engineering systems. However, existing model selection criteria has not been investigated across a variety of calibration scenarios, where selection choices can be affected by (i) parameter dimensionality, (ii) model form, (iii) prior informativeness, (iv) reparameterization, and (v) data characteristics. Moreover, it remains unclear whether these criteria can reliably distinguish model fidelity that genuinely improves explanatory power. These limitations restrict the broader applicability of model selection criteria in physics-based modeling, where balancing goodness-of-fit, complexity, and generalization is critical. To address these gaps, this study systematically evaluates information-theoretic and Bayesian model selection criteria through two case studies. The first case study employs polynomial regression models to isolate the effects of calibration factors and investigate their influence on the selection behavior of criteria. The second case study extends the analysis to a hierarchy of thermal models for double-pane windows, examining the ability of selection criteria to differentiate effective complexity from superficial increases in model fidelity. Results indicate that classical information-theoretic criteria are sensitive to parameter dimensionality, while covariance-based criteria reflect changes in model form and data characteristics, and Bayesian criteria exhibit sensitivity to all examined calibration factors. Furthermore, both covariance-based and Bayesian criteria effectively identify secondary physical mechanisms as sources of ineffective complexity, penalizing redundant fidelity. These findings underscore that model selection is not a one-size-fits-all task, and the choice of model selection criteria should be informed by the calibration scenario and the modeling objective.
ISSN:	0020-0255
DOI:	10.1016/j.ins.2025.122743