English
Related papers

Related papers: Stability of clinical prediction models developed …

200 papers

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties. While identifying all sources that account…

Machine Learning · Statistics 2019-11-22 Jayaraman J. Thiagarajan , Bindya Venkatesh , Prasanna Sattigeri , Peer-Timo Bremer

Clinical prediction models are estimated using a sample of limited size from the target population, leading to uncertainty in predictions, even when the model is correctly specified. Generally, not all patient profiles are observed…

Methodology · Statistics 2024-02-09 Doranne Thomassen , Saskia le Cessie , Hans van Houwelingen , Ewout Steyerberg

In health related machine learning applications, the training data often corresponds to a non-representative sample from the target populations where the learners will be deployed. In anticausal prediction tasks, selection biases often make…

Machine Learning · Statistics 2020-11-10 Elias Chaibub Neto , Phil Snyder , Solveig K Sieberts , Larsson Omberg

Modern machine learning methods including deep learning have achieved great success in predictive accuracy for supervised learning tasks, but may still fall short in giving useful estimates of their predictive {\em uncertainty}. Quantifying…

Falls affect a growing number of the population each year. Clinical methods to identify those at greatest risk for falls usually evaluate individuals while they perform specific motions such as balancing or Sit-to-Stand (STS). Unfortunately…

Quantitative Methods · Quantitative Biology 2019-08-07 Patrick D. Holmes , Shannon M. Danforth , Xiao-Yu Fu , Talia Y. Moore , Ram Vasudevan

Algorithmic stability is a central concept in statistics and learning theory that measures how sensitive an algorithm's output is to small changes in the training data. Stability plays a crucial role in understanding generalization,…

Statistics Theory · Mathematics 2026-01-21 Abhinav Chakraborty , Yuetian Luo , Rina Foygel Barber

Risk prediction models are increasingly used in healthcare to aid in clinical decision making. In most clinical contexts, model calibration (i.e., assessing the reliability of risk estimates) is critical. Data available for model…

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev

In statistical exercises where there are several candidate models, the traditional approach is to select one model using some data driven criterion and use that model for estimation, testing and other purposes, ignoring the variability of…

Statistics Theory · Mathematics 2008-12-18 Snigdhansu Chatterjee , Nitai D. Mukhopadhyay

Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and non-measurable parameters, which have to be…

Quantitative Methods · Quantitative Biology 2021-05-27 Alejandro F. Villaverde , Dilan Pathirana , Fabian Fröhlich , Jan Hasenauer , Julio R. Banga

When developing risk prediction models, shrinkage methods are recommended, especially when the sample size is limited. Several earlier studies have shown that the shrinkage of model coefficients can reduce overfitting of the prediction…

Methodology · Statistics 2019-07-29 Ben Van Calster , Maarten van Smeden , Ewout W. Steyerberg

This note extends a recently proposed algorithm for model identification and robust MPC of asymptotically stable, linear time-invariant systems subject to process and measurement disturbances. Independent output predictors for different…

Systems and Control · Electrical Eng. & Systems 2021-03-02 Enrico Terzi , Lorenzo Fagiano , Marcello Farina , Riccardo Scattolini

Knowing the uncertainty in a prediction is critical when making expensive investment decisions and when patient safety is paramount, but machine learning (ML) models in drug discovery typically provide only a single best estimate and ignore…

Machine Learning · Computer Science 2021-06-03 Stanley E. Lazic , Dominic P. Williams

We discuss recently developed methods that quantify the stability and generalizability of statistical findings under distributional changes. In many practical problems, the data is not drawn i.i.d. from the target population. For example,…

Methodology · Statistics 2023-10-05 Dominik Rothenhäusler , Peter Bühlmann

Robustness of linear systems with constant coefficients is considered. There exist methods and tools for analyzing the stability of systems with random or deterministic uncertainties. At the same time, there are no approaches for the…

Optimization and Control · Mathematics 2020-12-08 Andrey Tremba

Existing well investigated Predictive Process Monitoring techniques typically construct a predictive model based on past process executions, and then use it to predict the future of new ongoing cases, without the possibility of updating it…

Machine Learning · Computer Science 2023-10-26 Williams Rizzi , Chiara Di Francescomarino , Chiara Ghidini , Fabrizio Maria Maggi

Recent research reveals that machine learning (ML) models are highly sensitive to minor changes in their training procedure, such as the inclusion or exclusion of a single data point, leading to conflicting predictions on individual data…

Machine Learning · Computer Science 2025-07-15 Falaah Arif Khan , Denys Herasymuk , Nazar Protsiv , Julia Stoyanovich

Datasets typically contain inaccuracies due to human error and societal biases, and these inaccuracies can affect the outcomes of models trained on such datasets. We present a technique for certifying whether linear regression models are…

Machine Learning · Computer Science 2022-06-09 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

Recent advances in molecular simulations allow the evaluation of previously unattainable observables, such as rate constants for protein folding. However, these calculations are usually computationally expensive and even significant…

Applications · Statistics 2019-03-27 Barmak Mostofian , Daniel M. Zuckerman