English
Related papers

Related papers: Calibration of Time-Series Forecasting: Detecting …

200 papers

Time-series forecasting plays a critical role in many real-world applications. Although increasingly powerful models have been developed and achieved superior results on benchmark datasets, through a fine-grained sample-level inspection, we…

Machine Learning · Computer Science 2025-05-27 Zhining Liu , Ze Yang , Xiao Lin , Ruizhong Qiu , Tianxin Wei , Yada Zhu , Hendrik Hamann , Jingrui He , Hanghang Tong

The objective of Continual Test-time Domain Adaptation (CTDA) is to gradually adapt a pre-trained model to a sequence of target domains without accessing the source data. This paper proposes a Dynamic Sample Selection (DSS) method for CTDA.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yanshuo Wang , Jie Hong , Ali Cheraghian , Shafin Rahman , David Ahmedt-Aristizabal , Lars Petersson , Mehrtash Harandi

Supervised machine learning often encounters concept drift, where the data distribution changes over time, degrading model performance. Existing drift detection methods focus on identifying these shifts but often overlook the challenge of…

Machine Learning · Computer Science 2024-11-06 Christofer Fellicious , Lorenz Wendlinger , Mario Gancarski , Jelena Mitrovic , Michael Granitzer

Multivariate time-series anomaly detection (MTSAD) aims to identify deviations from normality in multivariate time-series and is critical in real-world applications. However, in real-world deployments, distribution shifts are ubiquitous and…

Machine Learning · Computer Science 2026-04-03 HyunGi Kim , Jisoo Mok , Hyungyu Lee , Juhyeon Shin , Sungroh Yoon

Vision-language models pre-trained at large scale have shown unprecedented adaptability and generalization to downstream tasks. Although its discriminative potential has been widely explored, its reliability and uncertainty are still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Julio Silva-Rodríguez , Ismail Ben Ayed , Jose Dolz

In decentralized learning networks, predictions from many participants are combined to generate a network inference. While many studies have demonstrated performance benefits of combining multiple model predictions, existing strategies…

Large-scale foundation models for scientific machine learning adapt to physical settings unseen during training, such as zero-shot transfer between turbulent scales. This phenomenon, in-context learning, challenges conventional…

Machine Learning · Computer Science 2026-04-14 Anthony Bao , Jeffrey Lai , William Gilpin

Though feature-alignment based Domain Adaptive Object Detection (DAOD) methods have achieved remarkable progress, they ignore the source bias issue, i.e., the detector tends to acquire more source-specific knowledge, impeding its…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Yongchao Feng , Shiwei Li , Yingjie Gao , Ziyue Huang , Yanan Zhang , Qingjie Liu , Yunhong Wang

As deep neural networks are increasingly deployed in dynamic, real-world environments, relying on a single static model is often insufficient. Changes in input data distributions caused by sensor drift or lighting variations necessitate…

Machine Learning · Computer Science 2025-09-26 Matteo Cardoni , Sam Leroux

Diffusion models have recently shown promise in time series forecasting, particularly for probabilistic predictions. However, they often fail to achieve state-of-the-art point estimation performance compared to regression-based methods.…

Artificial Intelligence · Computer Science 2025-11-25 Hang Ding , Xue Wang , Tian Zhou , Tao Yao

We introduce a neural network conformal prediction method for time series that enhances adaptivity in non-stationary environments. Our approach acts as a neural controller designed to achieve desired target coverage, leveraging auxiliary…

Machine Learning · Computer Science 2024-12-25 Ruipu Li , Alexander Rodríguez

Conformal predictive systems are sets of predictive distributions with theoretical out-of-sample calibration guarantees. The calibration guarantees are typically that the set of predictions contains a forecast distribution whose prediction…

Methodology · Statistics 2025-11-03 Sam Allen , Enrico Pescara , Johanna Ziegel

Deep learning-based diagnostic systems have demonstrated potential in skin disease diagnosis. However, their performance can easily degrade on test domains due to distribution shifts caused by input-level corruptions, such as imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-05-21 Ming Hu , Siyuan Yan , Peng Xia , Feilong Tang , Wenxue Li , Peibo Duan , Lin Zhang , Zongyuan Ge

Time-series forecasting often faces challenges from non-stationarity, particularly distributional drift, where the data distribution evolves over time. This dynamic behavior can undermine the effectiveness of adaptive optimizers, such as…

Machine Learning · Computer Science 2026-03-12 Yuze Dong , Jinsong Wu

In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that…

Machine Learning · Computer Science 2024-01-10 Sankalp Gilda , Neel Bhandari , Wendy Mak , Andrea Panizza

Time series anomaly detection (TSAD) is a critical task, but developing models that generalize to unseen data in a zero-shot manner remains a major challenge. Prevailing foundation models for TSAD predominantly rely on reconstruction-based…

Machine Learning · Computer Science 2026-05-29 Tian Lan , Hao Duong Le , Jinbo Li , Wenjun He , Meng Wang , Chenghao Liu , Chen Zhang

Supervised learning techniques typically assume training data originates from the target population. Yet, in reality, dataset shift frequently arises, which, if not adequately taken into account, may decrease the performance of their…

Contextual bandit algorithms are increasingly replacing non-adaptive A/B tests in e-commerce, healthcare, and policymaking because they can both improve outcomes for study participants and increase the chance of identifying good or even…

Machine Learning · Statistics 2021-06-02 Aurélien Bibaut , Antoine Chambaz , Maria Dimakopoulou , Nathan Kallus , Mark van der Laan

In many real-world scenarios, we often deal with streaming data that is sequentially collected over time. Due to the non-stationary nature of the environment, the streaming data distribution may change in unpredictable ways, which is known…

Machine Learning · Computer Science 2022-06-07 Wendi Li , Xiao Yang , Weiqing Liu , Yingce Xia , Jiang Bian

Accurate forecasting is critical for reliable power grid operations, particularly as the share of renewable generation, such as wind and solar, continues to grow. Given the inherent uncertainty and variability in renewable generation,…

Applications · Statistics 2025-10-20 Alireza Moradi , Mathieu Tanneau , Reza Zandehshahvar , Pascal Van Hentenryck