English
Related papers

Related papers: Mitigating distribution shift in machine learning-…

200 papers

Clinical machine learning models are increasingly trained using large scale, multimodal foundation paradigms, yet deployment environments often differ systematically from the data generating settings used during training. Such shifts arise…

Machine Learning · Computer Science 2026-03-10 Yuanyun Zhang , Shi Li

This paper proposes a two-time scale neurodynamic duplex approach to solve distributionally robust geometric joint chance-constrained optimization problems. The probability distributions of the row vectors are not known in advance and…

Neural and Evolutionary Computing · Computer Science 2026-05-07 Ange Valli , Siham Tassouli , Abdel Lisser

Machine learning models are often trained on data from one distribution and deployed on others. So it becomes important to design models that are robust to distribution shifts. Most of the existing work focuses on optimizing for either…

Machine Learning · Computer Science 2021-03-31 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

To train machine learning models that are robust to distribution shifts in the data, distributionally robust optimization (DRO) has been proven very effective. However, the existing approaches to learning a distributionally robust model…

Machine Learning · Computer Science 2022-03-21 Farzin Haddadpour , Mohammad Mahdi Kamani , Mehrdad Mahdavi , Amin Karbasi

This paper presents a novel methodological framework, called the Actor-Simulator, that incorporates the calibration of digital twins into model-based reinforcement learning for more effective control of stochastic systems with complex…

Machine Learning · Computer Science 2025-01-07 Hua Zheng , Wei Xie , Ilya O. Ryzhov , Keilung Choy

Data-driven methods demonstrate considerable potential for accelerating the inherently expensive computational fluid dynamics (CFD) solvers. Nevertheless, pure machine-learning surrogate models face challenges in ensuring physical…

Fluid Dynamics · Physics 2024-09-12 Clément Caron , Philippe Lauret , Alain Bastide

Training robots for operation in the real world is a complex, time consuming and potentially expensive task. Despite significant success of reinforcement learning in games and simulations, research in real robot applications has not been…

Artificial Intelligence · Computer Science 2017-09-28 Markus Wulfmeier , Ingmar Posner , Pieter Abbeel

Machine learning models used in medical applications often face challenges due to the covariate shift, which occurs when there are discrepancies between the distributions of training and target data. This can lead to decreased predictive…

Machine Learning · Computer Science 2024-12-24 Mingyang Cai , Thomas Klausch , Mark A. van de Wiel

We consider the general problem of learning a predictor that satisfies multiple objectives of interest simultaneously, a broad framework that captures a range of specific learning goals including calibration, regret, and multiaccuracy. We…

Machine Learning · Computer Science 2026-02-17 Jivat Neet Kaur , Isaac Gibbs , Michael I. Jordan

Machine learning techniques are increasingly being applied in high-energy nuclear physics data analysis thanks to their outstanding performance. One key challenge in such applications is the construction of training samples that can…

Nuclear Experiment · Physics 2025-11-14 Yan Wang , Rangrong Ma , Kaifeng Shen , Zebo Tang , Wangmei Zha

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

Temporal distribution shifts pose a key challenge for machine learning models trained and deployed in dynamically evolving environments. This paper introduces RIDER (RIsk minimization under Dynamically Evolving Regimes) which derives…

Methodology · Statistics 2025-07-18 Yujin Jeong , Ramesh Johari , Dominik Rothenhäusler , Emily Fox

This paper proposes a simulation-based reinforcement learning algorithm for controlling systems with uncertain and varying system parameters. While simulators are useful for safely learning control policies, the reality gap remains a major…

Systems and Control · Electrical Eng. & Systems 2026-05-14 Junya Ikemoto

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

Machine Learning · Computer Science 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

The task of state estimation in active distribution systems faces a major challenge due to the integration of different measurements with multiple reporting rates. As a result, distribution systems are essentially unobservable in real time,…

Optimization and Control · Mathematics 2024-05-13 J. G. De la Varga , S. Pineda , J. M. Morales , Á. Porras

Time series prediction is often complicated by distribution shift which demands adaptive models to accommodate time-varying distributions. We frame time series prediction under distribution shift as a weighted empirical risk minimisation…

Machine Learning · Computer Science 2022-07-26 Stefanos Bennett , Jase Clarkson

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

We propose a novel calibration method for computer simulators, dealing with the problem of covariate shift. Covariate shift is the situation where input distributions for training and test are different, and ubiquitous in applications of…

Machine Learning · Statistics 2020-03-20 Keiichi Kisamori , Motonobu Kanagawa , Keisuke Yamazaki

A multi-agent optimization problem motivated by the management of energy systems is discussed. The associated cost function is separable and convex although not necessarily strongly convex and there exist edge-based coupling equality…

Optimization and Control · Mathematics 2022-06-03 Wicak Ananduta , Angelia Nedić , Carlos Ocampo-Martinez

Domain shifts are ubiquitous in machine learning, and can substantially degrade a model's performance when deployed to real-world data. To address this, distribution alignment methods aim to learn feature representations which are invariant…

Machine Learning · Computer Science 2024-10-08 Andrea Napoli , Paul White