English
Related papers

Related papers: Time Series Prediction under Distribution Shift us…

200 papers

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

Machine Learning · Computer Science 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Diffusion models have risen to prominence in time series forecasting, showcasing their robust capability to model complex data distributions. However, their effectiveness in deterministic predictions is often constrained by instability…

Machine Learning · Computer Science 2024-11-08 Hao Yang , Zhanbo Feng , Feng Zhou , Robert C Qiu , Zenan Ling

A distribution shift between the training and test data can severely harm performance of machine learning models. Importance weighting addresses this issue by assigning different weights to data points during training. We argue that…

Machine Learning · Statistics 2025-11-17 Floris Holstege , Bram Wouters , Noud van Giersbergen , Cees Diks

Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising…

Machine Learning · Computer Science 2024-07-15 Ignacio Hounie , Javier Porras-Valenzuela , Alejandro Ribeiro

Models for learning probability distributions such as generative models and density estimators behave quite differently from models for learning functions. One example is found in the memorization phenomenon, namely the ultimate convergence…

Machine Learning · Statistics 2021-03-03 Hongkang Yang , Weinan E

The generalization ability of machine learning models degrades significantly when the test distribution shifts away from the training distribution. We investigate the problem of training models that are robust to shifts caused by changes in…

Machine Learning · Computer Science 2023-09-19 Jiaheng Wei , Harikrishna Narasimhan , Ehsan Amid , Wen-Sheng Chu , Yang Liu , Abhishek Kumar

We consider the distribution of the turning point location of time series modeled as the sum of deterministic trend plus random noise. If the variables are modeled by shifted exponentials, whose location parameters define the trend, we…

Methodology · Statistics 2016-02-19 Camillo Cammarota

Time series data are valuable but are often inscrutable. Gaining trust in time series classifiers for finance, healthcare, and other critical applications may rely on creating interpretable models. Researchers have previously been forced to…

Machine Learning · Computer Science 2021-11-09 Yuhui Wang , Diane J. Cook

Linear discriminant analysis is a widely used method for classification. However, the high dimensionality of predictors combined with small sample sizes often results in large classification errors. To address this challenge, it is crucial…

Machine Learning · Statistics 2025-01-09 Hongzhe Zhang , Arnab Auddy , Hongzhe Lee

Multivariate time series are ubiquitous objects in signal processing. Measuring a distance or similarity between two such objects is of prime interest in a variety of applications, including machine learning, but can be very difficult as…

Machine Learning · Statistics 2022-11-02 Titouan Vayer , Romain Tavenard , Laetitia Chapel , Nicolas Courty , Rémi Flamary , Yann Soullard

This paper addresses the challenges of fault prediction and delayed response in distributed systems by proposing an intelligent prediction method based on temporal feature learning. The method takes multi-dimensional performance metric…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Yang Wang , Wenxuan Zhu , Xuehui Quan , Heyi Wang , Chang Liu , Qiyuan Wu

In numerous predictive scenarios, the predictive model affects the sampling distribution; for example, job applicants often meticulously craft their resumes to navigate through a screening systems. Such shifts in distribution are…

Machine Learning · Statistics 2025-04-14 Daniele Bracale , Subha Maity , Moulinath Banerjee , Yuekai Sun

As machine learning models are increasingly deployed in dynamic environments, it becomes paramount to assess and quantify uncertainties associated with distribution shifts. A distribution shift occurs when the underlying data-generating…

Methodology · Statistics 2024-10-08 Jiawei Ge , Debarghya Mukherjee , Jianqing Fan

Missing data imputation, where a model is trained on observed data to estimate unobserved values, is a fundamental problem in machine learning. In this paper, we rigorously formulate imputation model learning as a mean-squared error risk…

Machine Learning · Statistics 2026-05-14 Luke Shannon , Song Liu , Katarzyna Reluga

Machine learning systems deployed in the real world must operate under dynamic and often unpredictable distribution shifts. This challenges the validity of statistical safety assurances on the system's risk established beforehand. Common…

Machine Learning · Statistics 2025-06-23 Alexander Timans , Rajeev Verma , Eric Nalisnick , Christian A. Naesseth

We review the application of Statistical Mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent…

Disordered Systems and Neural Networks · Physics 2007-05-23 Renato Vicente , Osame Kinouchi , Nestor Caticha

We consider the setting where a collection of time series, modeled as random processes, evolve in a causal manner, and one is interested in learning the graph governing the relationships of these processes. A special case of wide interest…

Machine Learning · Computer Science 2016-08-30 Hossein Hosseini , Sreeram Kannan , Baosen Zhang , Radha Poovendran

This paper presents a new prediction model for time series data by integrating a time-varying Geometric Brownian Motion model with a pricing mechanism used in financial engineering. Typical time series models such as Auto-Regressive…

Applications · Statistics 2020-01-01 Abdullah AlShelahi , Jingxing Wang , Mingdi You , Eunshin Byon , Romesh Saigal

Similarity measures for time series are important problems for time series classification. To handle the nonlinear time distortions, Dynamic Time Warping (DTW) has been widely used. However, DTW is not learnable and suffers from a trade-off…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Shinnosuke Matsuo , Xiaomeng Wu , Gantugs Atarsaikhan , Akisato Kimura , Kunio Kashino , Brian Kenji Iwana , Seiichi Uchida

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

Machine Learning · Statistics 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas