English
Related papers

Related papers: Replica analysis of overfitting in regression mode…

200 papers

In epidemiological studies of time-to-event data, a quantity of interest to the clinician and the patient is the risk of an event given a covariate profile. However, methods relying on time matching or risk-set sampling (including Cox…

Methodology · Statistics 2020-09-23 Sahir Rai Bhatnagar , Maxime Turgeon , Jesse Islam , James A. Hanley , Olli Saarela

In the era of precision medicine, time-to-event outcomes such as time to death or progression are routinely collected, along with high-throughput covariates. These high-dimensional data defy classical survival regression models, which are…

Methodology · Statistics 2025-07-15 Stephen Salerno , Yi Li

The statistical machine learning community has demonstrated considerable resourcefulness over the years in developing highly expressive tools for estimation, prediction, and inference. The bedrock assumptions underlying these developments…

Methodology · Statistics 2022-02-10 Alnur Ali , Maxime Cauchois , John C. Duchi

Large-scale data are often characterized by some degree of inhomogeneity as data are either recorded in different time regimes or taken from multiple sources. We look at regression models and the effect of randomly changing coefficients,…

Methodology · Statistics 2016-08-11 Nicolai Meinshausen , Peter Bühlmann

New methods for time-to-event prediction are proposed by extending the Cox proportional hazards model with neural networks. Building on methodology from nested case-control studies, we propose a loss function that scales well to large data…

Machine Learning · Statistics 2019-09-16 Håvard Kvamme , Ørnulf Borgan , Ida Scheel

This article analyzes the problem of estimating the time until an event occurs, also known as survival modeling. We observe through substantial experiments on large real-world datasets and use-cases that populations are largely…

Machine Learning · Computer Science 2019-05-13 David Hubbard , Benoit Rostykus , Yves Raimond , Tony Jebara

Many applications involve reasoning about time durations before a critical event happens--also called time-to-event outcomes. When will a customer cancel a subscription, a coma patient wake up, or a convicted criminal reoffend?…

Machine Learning · Statistics 2024-10-03 George H. Chen

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

The phenomenon of benign overfitting is one of the key mysteries uncovered by deep learning methodology: deep neural networks seem to predict well, even with a perfect fit to noisy training data. Motivated by this phenomenon, we consider…

Machine Learning · Statistics 2022-06-08 Peter L. Bartlett , Philip M. Long , Gábor Lugosi , Alexander Tsigler

This study investigates the critical problem of overfitting in deep learning models applied to histopathology image analysis. We show that simply adopting and fine-tuning large-scale models designed for natural image analysis often leads to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Saghir Alfasly , Ghazal Alabtah , H. R. Tizhoosh

We consider the problem of model building for rare events prediction in longitudinal follow-up studies. In this paper, we compare several resampling methods to improve standard regression models on a real life example. We evaluate the…

Methodology · Statistics 2023-06-21 Pierre Druilhet , Mathieu Berthe , Stéphanie Léger

Models for predicting the time of a future event are crucial for risk assessment, across a diverse range of applications. Existing time-to-event (survival) models have focused primarily on preserving pairwise ordering of estimated event…

Machine Learning · Statistics 2021-01-14 Paidamoyo Chapfuwa , Chenyang Tao , Lawrence Carin , Ricardo Henao

Time series observations can be seen as realizations of an underlying dynamical system governed by rules that we typically do not know. For time series learning tasks, we need to understand that we fit our model on available data, which is…

Machine Learning · Computer Science 2023-01-31 Amine Mohamed Aboussalah , Min-Jae Kwon , Raj G Patel , Cheng Chi , Chi-Guhn Lee

We consider a joint survival and mixed-effects model to explain the survival time from longitudinal data and high-dimensional covariates in a population. The longitudinal data is modeled using a non linear mixed-effects model to account for…

Statistics Theory · Mathematics 2025-08-06 Antoine Caillebotte , Estelle Kuhn , Sarah Lemler

Time series forecasting, particularly in few-shot learning scenarios, is challenging due to the limited availability of high-quality training data. To address this, we present a pilot study on using reinforcement learning (RL) for time…

Machine Learning · Computer Science 2025-05-23 Haochen Yuan , Yutong Wang , Yihong Chen , Yunbo Wang , Xiaokang Yang

Cure models have been widely developed to estimate the cure fraction when some subjects never experience the event of interest. However these models were rarely focused on the estimation of the time-to-cure i.e. the delay elapsed between…

We revisit the replica method for analyzing inference and learning in parametric models, considering situations where the data-generating distribution is unknown or analytically intractable. Instead of assuming idealized distributions to…

Disordered Systems and Neural Networks · Physics 2025-11-17 Takashi Takahashi

Truncation is a statistical phenomenon that occurs in many time to event studies. For example, autopsy-confirmed studies of neurodegenerative diseases are subject to an inherent left and right truncation, also known as double truncation.…

Methodology · Statistics 2018-03-28 Lior Rennert , Sharon X. Xie

A common problem in health research is that we have a large database with many variables measured on a large number of individuals. We are interested in measuring additional variables on a subsample; these measurements may be newly…

Methodology · Statistics 2022-03-22 Thomas Lumley , Tong Chen

The use of massive survival data has become common in survival analysis. In this study, a subsampling algorithm is proposed for the Cox proportional hazards model with time-dependent covariates when the sample is extraordinarily large but…

Computation · Statistics 2023-02-07 Nan Qiao , Wangcheng Li , Feng Xiao , Cunjie Lin , Yong Zhou