English
Related papers

Related papers: Adaptive Estimation and Learning under Temporal Di…

200 papers

Temporal distribution shifts pose a key challenge for machine learning models trained and deployed in dynamically evolving environments. This paper introduces RIDER (RIsk minimization under Dynamically Evolving Regimes) which derives…

Methodology · Statistics 2025-07-18 Yujin Jeong , Ramesh Johari , Dominik Rothenhäusler , Emily Fox

Real-world deployment of machine learning models is challenging because data evolves over time. While no model can work when data evolves in an arbitrary fashion, if there is some pattern to these changes, we might be able to design methods…

Machine Learning · Computer Science 2024-05-03 Rasool Fakoor , Jonas Mueller , Zachary C. Lipton , Pratik Chaudhari , Alexander J. Smola

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

We study the problem of learning under arbitrary distribution shift, where the learner is trained on a labeled set from one distribution but evaluated on a different, potentially adversarially generated test distribution. We focus on two…

Data Structures and Algorithms · Computer Science 2024-06-06 Surbhi Goel , Abhishek Shetty , Konstantinos Stavropoulos , Arsen Vasilyan

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

In this paper, we study a sampling problem where a source takes samples from a Wiener process and transmits them through a wireless channel to a remote estimator. Due to channel fading, interference, and potential collisions, the packet…

Information Theory · Computer Science 2023-10-19 Jiayu Pan , Yin Sun , Ness B. Shroff

Forecasting non-stationary time series is a challenging task because their statistical properties often change over time, making it hard for deep models to generalize well. Instance-level normalization techniques can help address shifts in…

Machine Learning · Computer Science 2025-06-09 Junpeng Lin , Tian Lan , Bo Zhang , Ke Lin , Dandan Miao , Huiru He , Jiantao Ye , Chen Zhang , Yan-fu Li

We consider a typical learning problem of point estimations for modeling of nonlinear functions or dynamical systems in which generalization, i.e., verifying a given learned model, can be embedded as an integral part of the learning process…

Optimization and Control · Mathematics 2024-08-06 Getachew K. Befekadu

Rapid progress in machine learning and deep learning has enabled a wide range of applications in the electricity load forecasting of power systems, for instance, univariate and multivariate short-term load forecasting. Though the strong…

Machine Learning · Computer Science 2024-02-20 Yuqi Jiang , Yan Li , Yize Chen

Abrupt change detection based on the wavelet transform and threshold method is very effective in detecting the abrupt changes and hence segmenting the signals recorded during disturbances in the electrical power network. The wavelet method…

Other Computer Science · Computer Science 2015-03-20 A. Ukil , R. Zivanovic

In this work, we tackle two widespread challenges in real applications for time-series forecasting that have been largely understudied: distribution shifts and missing data. We propose SpectraNet, a novel multivariate time-series…

Machine Learning · Computer Science 2022-10-26 Cristian Challu , Peihong Jiang , Ying Nian Wu , Laurent Callot

Extracting spatial-temporal knowledge from data is useful in many applications. It is important that the obtained knowledge is human-interpretable and amenable to formal analysis. In this paper, we propose a method that trains neural…

Artificial Intelligence · Computer Science 2022-01-10 Nasim Baharisangari , Kazuma Hirota , Ruixuan Yan , Agung Julius , Zhe Xu

Full Waveform Inversion (FWI) is a powerful technique for estimating high-resolution subsurface velocity models by minimizing the discrepancy between modeled and observed seismic data. However, the oscillatory nature of seismic waveforms…

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

Neural networks are traditionally trained under the assumption that data come from a stationary distribution. However, settings which violate this assumption are becoming more popular; examples include supervised learning under…

Machine Learning · Computer Science 2024-11-11 Alexandre Galashov , Michalis K. Titsias , András György , Clare Lyle , Razvan Pascanu , Yee Whye Teh , Maneesh Sahani

Recently, the distributed state estimation problem for continuous-time linear systems over jointly connected switching networks was solved. It was shown that the estimation errors will asymptotically converge to the origin by using the…

Optimization and Control · Mathematics 2022-10-07 Tao Liu , Jie Huang

We study density estimation for classes of shift-invariant distributions over $\mathbb{R}^d$. A multidimensional distribution is "shift-invariant" if, roughly speaking, it is close in total variation distance to a small shift of it in any…

Machine Learning · Computer Science 2018-11-12 Anindya De , Philip M. Long , Rocco A. Servedio

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach