English
Related papers

Related papers: Model Assessment and Selection under Temporal Dist…

200 papers

We consider the scenario where the parameters of a probabilistic model are expected to vary over time. We construct a novel prior distribution that promotes sparsity and adapts the strength of correlation between parameters at successive…

Machine Learning · Statistics 2015-11-10 Dani Yogatama , Bryan R. Routledge , Noah A. Smith

Machine learning systems deployed in the real world must operate under dynamic and often unpredictable distribution shifts. This challenges the validity of statistical safety assurances on the system's risk established beforehand. Common…

Machine Learning · Statistics 2025-06-23 Alexander Timans , Rajeev Verma , Eric Nalisnick , Christian A. Naesseth

Many medical decisions involve the use of dynamic information collected on individual patients toward predicting likely transitions in their future health status. If accurate predictions are developed, then a prognostic mode can identify…

Methodology · Statistics 2018-02-22 Aasthaa Bansal , Patrick J. Heagerty

This paper considers an opportunistic scheduling problem over a renewal system. A controller observes a random event at the beginning of each renewal frame and then chooses an action in response to the event, which affects the duration of…

Optimization and Control · Mathematics 2019-06-10 Xiaohan Wei , Michael J. Neely

Learning the continuous dynamics of a system from snapshots of its temporal marginals is a problem which appears throughout natural sciences and machine learning, including in quantum systems, single-cell biological data, and generative…

Machine Learning · Computer Science 2023-06-12 Kirill Neklyudov , Rob Brekelmans , Daniel Severo , Alireza Makhzani

There exist several methods developed for the canonical change point problem of detecting multiple mean shifts, which search for changes over sections of the data at multiple scales. In such methods, estimation of the noise level is often…

Methodology · Statistics 2022-11-07 Euan T. McGonigle , Haeran Cho

We study the well-motivated problem of online distribution shift in which the data arrive in batches and the distribution of each batch can change arbitrarily over time. Since the shifts can be large or small, abrupt or gradual, the length…

Machine Learning · Computer Science 2025-04-11 Dheeraj Baby , Boran Han , Shuai Zhang , Cuixiong Hu , Yuyang Wang , Yu-Xiang Wang

Sampling is an important tool for estimating large, complex sums and integrals over high dimensional spaces. For instance, important sampling has been used as an alternative to exact methods for inference in belief networks. Ideally, we…

Artificial Intelligence · Computer Science 2013-01-18 Luis E. Ortiz , Leslie Pack Kaelbling

In machine learning models, the estimation of errors is often complex due to distribution bias, particularly in spatial data such as those found in environmental studies. We introduce an approach based on the ideas of importance sampling to…

Machine Learning · Computer Science 2023-09-15 Boris Prokhorov , Diana Koldasbayeva , Alexey Zaytsev

Compositional generalization is a crucial step towards developing data-efficient intelligent machines that generalize in human-like ways. In this work, we tackle a challenging form of distribution shift, termed compositional shift, where…

Machine Learning · Computer Science 2025-07-14 Divyat Mahajan , Mohammad Pezeshki , Charles Arnal , Ioannis Mitliagkas , Kartik Ahuja , Pascal Vincent

Supervised fairness-aware machine learning under distribution shifts is an emerging field that addresses the challenge of maintaining equitable and unbiased predictions when faced with changes in data distributions from source to target…

Machine Learning · Computer Science 2024-05-07 Minglai Shao , Dong Li , Chen Zhao , Xintao Wu , Yujie Lin , Qin Tian

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

We study how we can adapt a predictor to a non-stationary environment with advises from multiple experts. We study the problem under complete feedback when the best expert changes over time from a decision theoretic point of view. Proposed…

Machine Learning · Computer Science 2017-08-08 Vishnu Raj , Sheetal Kalyani

Data assimilation in models representing spatio-temporal phenomena poses a challenge, particularly if the spatial histogram of the variable appears with multiple modes. The traditional Kalman model is based on a Gaussian initial…

Methodology · Statistics 2020-06-26 Maxime Conjard , Henning Omre

Temporal distribution shift (TDS) erodes the long-term accuracy of recommender systems, yet industrial practice still relies on periodic incremental training, which struggles to capture both stable and transient patterns. Existing…

Machine Learning · Computer Science 2025-11-27 Yuxuan Zhu , Cong Fu , Yabo Ni , Anxiang Zeng , Yuan Fang

Stochastic models in which agents interact with their neighborhood according to a network topology are a powerful modeling framework to study the emergence of complex dynamic patterns in real-world systems. Stochastic simulations are often…

Social and Information Networks · Computer Science 2021-01-27 Gerrit Großmann , Luca Bortolussi , Verena Wolf

Dataset shift is common in credit scoring scenarios, and the inconsistency between the distribution of training data and the data that actually needs to be predicted is likely to cause poor model performance. However, most of the current…

Machine Learning · Computer Science 2021-12-21 Hongyi Qian , Baohui Wang , Ping Ma , Lei Peng , Songfeng Gao , You Song

Nonstationarity of real-life time series requires model adaptation. In classical approaches like ARMA-ARCH there is assumed some arbitrarily chosen dependence type. To avoid their bias, we will focus on novel more agnostic approach: moving…

Methodology · Statistics 2025-06-09 Jarek Duda

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

We propose a novel and unified framework for change-point estimation in multivariate time series. The proposed method is fully nonparametric, enjoys effortless tuning and is robust to temporal dependence. One salient and distinct feature of…

Methodology · Statistics 2022-09-12 Zifeng Zhao , Feiyu Jiang , Xiaofeng Shao