English
Related papers

Related papers: Delineating Parameter Unidentifiabilities in Compl…

200 papers

Nonlinear dynamic models are widely used for characterizing functional forms of processes that govern complex biological pathway systems. Over the past decade, validation and further development of these models became possible due to data…

Methodology · Statistics 2019-08-13 Itai Dattner , Shota Gugushvili , Harold Ship , Eberhard O. Voit

In this work, we consider the problem of robust parameter estimation from observational data in the context of linear structural equation models (LSEMs). LSEMs are a popular and well-studied class of models for inferring causality in the…

Machine Learning · Computer Science 2020-07-15 Karthik Abinav Sankararaman , Anand Louis , Navin Goyal

ML models have errors when used for predictions. The errors are unknown but can be quantified by model uncertainty. When multiple ML models are trained using the same training points, their model uncertainties may be statistically…

Machine Learning · Statistics 2025-09-23 Xiaoping Du

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

Stochastic simulation is widely used to study complex systems composed of various interconnected subprocesses, such as input processes, routing and control logic, optimization routines, and data-driven decision modules. In practice, these…

Computation · Statistics 2026-02-19 Mohammadmahdi Ghasemloo , David J. Eckman , Yaxian Li

The bifactor model and its extensions are multidimensional latent variable models, under which each item measures up to one subdimension on top of the primary dimension(s). Despite their wide applications to educational and psychological…

Statistics Theory · Mathematics 2020-12-23 Guanhua Fang , Xin Xu , Jinxin Guo , Zhiliang Ying , Susu Zhang

In many problems of data-driven modeling for dynamical systems, the governing equations are not known a priori and must be selected phenomenologically from a large set of candidate interactions and basis functions. In such situations, point…

Applications · Statistics 2026-04-14 Shuhei Kashiwamura , Yusuke Kato , Hiroshi Kori , Masato Okada

Many systems in biology, physics and engineering can be described by systems of ordinary differential equation containing many parameters. When studying the dynamic behavior of these large, nonlinear systems, it is useful to identify and…

Molecular Networks · Quantitative Biology 2016-04-13 Heather A. Harrington , Dhagash Mehta , Helen M. Byrne , Jonathan D. Hauenstein

Physics-informed neural networks have emerged as a powerful tool in the scientific machine learning community, with applications to both forward and inverse problems. While they have shown considerable empirical success, significant…

Optimization and Control · Mathematics 2025-12-11 Federica Caforio , Martin Holler , Matthias Höfler

Deploying machine learning models in safety-critical domains poses a key challenge: ensuring reliable model performance on downstream user data without access to ground truth labels for direct validation. We propose the suitability filter,…

Machine Learning · Computer Science 2025-05-29 Angéline Pouget , Mohammad Yaghini , Stephan Rabanser , Nicolas Papernot

Researchers in explainable artificial intelligence have developed numerous methods for helping users understand the predictions of complex supervised learning models. By contrast, explaining the $\textit{uncertainty}$ of model outputs has…

Machine Learning · Statistics 2023-11-01 David S. Watson , Joshua O'Hara , Niek Tax , Richard Mudd , Ido Guy

Epistemic uncertainty is often viewed as a reducible uncertainty that vanishes with increasing data. This perspective implicitly assumes parameter identifiability and equates epistemic uncertainty with predictive variability. In…

Machine Learning · Computer Science 2026-05-26 David Rügamer

Fitting models to data is an important part of the practice of science. Advances in machine learning have made it possible to fit more -- and more complex -- models, but have also exacerbated a problem: when multiple models fit the data…

Methodology · Statistics 2025-10-27 Alexandre René , André Longtin

Estimating the effects of continuous-valued interventions from observational data is a critically important task for climate science, healthcare, and economics. Recent work focuses on designing neural network architectures and…

Machine Learning · Computer Science 2022-10-13 Andrew Jesson , Alyson Douglas , Peter Manshausen , Maëlys Solal , Nicolai Meinshausen , Philip Stier , Yarin Gal , Uri Shalit

We present a data-driven approach to characterizing nonidentifiability of a model's parameters and illustrate it through dynamic as well as steady kinetic models. By employing Diffusion Maps and their extensions, we discover the minimal…

Inverse Uncertainty Quantification (UQ), or Bayesian calibration, is the process to quantify the uncertainties of random input parameters based on experimental data. The introduction of model discrepancy term is significant because…

Applications · Statistics 2019-07-24 Xu Wu , Koroush Shirvan , Tomasz Kozlowski

Fitting model parameters to experimental data is a common yet often challenging task, especially if the model contains many parameters. Typically, algorithms get lost in regions of parameter space in which the model is unresponsive to…

Statistical Mechanics · Physics 2012-01-31 M. K. Transtrum , B. B. Machta , J. P. Sethna

Dynamical systems modeling is a core pillar of scientific inquiry across natural and life sciences. Increasingly, dynamical system models are learned from data, rendering identifiability a paramount concept. For systems that are not…

Machine Learning · Computer Science 2026-05-11 Cecilia Casolo , Sören Becker , Niki Kilbertus

This report addresses state inference for hidden Markov models. These models rely on unobserved states, which often have a meaningful interpretation. This makes it necessary to develop diagnostic tools for quantification of state…

Statistics Theory · Mathematics 2018-10-26 Jean-Baptiste Durand , Y. Guédon

Different aspects of the predictability problem in dynamical systems are reviewed. The deep relation among Lyapunov exponents, Kolmogorov-Sinai entropy, Shannon entropy and algorithmic complexity is discussed. In particular, we emphasize…

Chaotic Dynamics · Physics 2009-11-07 G. Boffetta , M. Cencini , M. Falcioni , A. Vulpiani