English
Related papers

Related papers: Mind the Performance Gap: Examining Dataset Shift …

200 papers

Human decision-making differs due to variation in both incentives and available information. This constitutes a substantial challenge for the evaluation of whether and how machine learning predictions can improve decision outcomes. We…

General Economics · Economics 2020-11-24 Michael Allan Ribers , Hannes Ullrich

We sample aggravated cases following age-structured probabilities from confirmed cases and use ICU occupation data to find a subnotification factor. A logistic fit is then employed to project the progression of the COVID-19 epidemic with…

Physics and Society · Physics 2024-02-14 Rodrigo Veiga , Rodrigo Murta , Renato Vicente

Accurate estimates of the reproduction ratio are crucial to project infectious disease epidemic evolution and guide public health response. Here, we prove that estimates of the reproduction ratio based on inference from surveillance data…

Physics and Society · Physics 2025-01-08 Piero Birello , Michele Re Fiorentin , Boxuan Wang , Vittoria Colizza , Eugenio Valdano

Objective: The objective of this study is to develop a machine learning (ML)-based framework for early risk stratification of clinical trials (CTs) according to their likelihood of exhibiting a high rate of dosing errors, using information…

Machine Learning · Computer Science 2026-02-27 Félicien Hêche , Sohrab Ferdowsi , Anthony Yazdani , Sara Sansaloni-Pastor , Douglas Teodoro

Patient stratification identifying clinically meaningful subgroups is essential for advancing personalized medicine through improved diagnostics and treatment strategies. Electronic health records (EHRs), particularly those from intensive…

Machine Learning · Computer Science 2025-06-09 Dimitrios Proios , Alban Bornet , Anthony Yazdani , Jose F Rodrigues , Douglas Teodoro

Empirical work often uses treatment assigned following geographic boundaries. When the effects of treatment cross over borders, classical difference-in-differences estimation produces biased estimates for the average treatment effect. In…

Econometrics · Economics 2023-06-13 Kyle Butts

The management of chronic Heart Failure (HF) presents significant challenges in modern healthcare, requiring continuous monitoring, early detection of exacerbations, and personalized treatment strategies. In this paper, we present a…

Hospital readmissions have become one of the key measures of healthcare quality. Preventable readmissions have been identified as one of the primary targets for reducing costs and improving healthcare delivery. However, most data driven…

Machine Learning · Computer Science 2018-04-05 Jialiang Jiang , Sharon Hewner , Varun Chandola

Stratification in both the design and analysis of randomized clinical trials is common. Despite features in automated randomization systems to re-confirm the stratifying variables, incorrect values of these variables may be entered. These…

Methodology · Statistics 2023-07-24 Neal Thomas

Medical imaging is spearheading the AI transformation of healthcare. Performance reporting is key to determine which methods should be translated into clinical practice. Frequently, broad conclusions are simply derived from mean performance…

Deep learning models, particularly Long Short-Term Memory (LSTM) networks, are widely used in time series forecasting due to their ability to capture complex temporal dependencies. However, evaluation integrity is often compromised by data…

Machine Learning · Computer Science 2025-12-09 Salma Albelali , Moataz Ahmed

While most machine learning models can provide confidence in their predictions, confidence is insufficient to understand a prediction's reliability. For instance, the model may have a low confidence prediction if the input is not…

Machine Learning · Computer Science 2023-10-31 Mert Yuksekgonul , Linjun Zhang , James Zou , Carlos Guestrin

Machine learning models are typically deployed in a test setting that differs from the training setting, potentially leading to decreased model performance because of domain shift. If we could estimate the performance that a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Zeju Li , Konstantinos Kamnitsas , Mobarakol Islam , Chen Chen , Ben Glocker

With the increasingly widespread adoption of AI in healthcare, maintaining the accuracy and reliability of AI models in clinical practice has become crucial. In this context, we introduce novel methods for monitoring the performance of…

Artificial Intelligence · Computer Science 2023-11-27 Vasantha Kumar Venugopal , Abhishek Gupta , Rohit Takhar , Vidur Mahajan

Temporal context in medicine is valuable in assessing key changes in patient health over time. We developed a machine learning framework to integrate diverse context from prior visits to improve health monitoring, especially when prior…

Artificial Intelligence · Computer Science 2025-10-20 Lavanya Umapathy , Patricia M Johnson , Tarun Dutt , Angela Tong , Madhur Nayan , Hersh Chandarana , Daniel K Sodickson

During the COVID-19 pandemic, the behavioral response to reported case numbers changed drastically over time. While a few dozen cases were enough to trigger government-induced and voluntary contact reduction in early 2020, less than a year…

Physics and Society · Physics 2023-09-27 Bastian Heinlein , Manlio De Domenico

Domain gaps are among the most relevant roadblocks in the clinical translation of machine learning (ML)-based solutions for medical image analysis. While current research focuses on new training paradigms and network architectures, little…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Patrick Godau , Piotr Kalinowski , Evangelia Christodoulou , Annika Reinke , Minu Tizabi , Luciana Ferrer , Paul Jäger , Lena Maier-Hein

The COVID-19 pandemic has had worldwide devastating effects on human lives, highlighting the need for tools to predict its development. Dynamics of such public-health threats can often be efficiently analysed through simple models that help…

Populations and Evolution · Quantitative Biology 2021-06-04 Pedro L. de Andres , Lucia de Andres-Bragado , Linard D. Hoessly

In performative prediction, predictions guide decision-making and hence can influence the distribution of future data. To date, work on performative prediction has focused on finding performatively stable models, which are the fixed points…

Machine Learning · Computer Science 2021-06-17 John Miller , Juan C. Perdomo , Tijana Zrnic

Most clinical prediction studies are developed from retrospective cohorts and reported as if all patient information were observed at once. In practice, clinicians face a more consequential question: \emph{when is there already enough…

Methodology · Statistics 2026-04-27 Hui-Mean Foo , Yuan-chin Ivan Chang