English
Related papers

Related papers: An Information-theoretic Approach to Distribution …

200 papers

We study the problem of learning fair prediction models for unseen test sets distributed differently from the train set. Stability against changes in data distribution is an important mandate for responsible deployment of models. The domain…

Machine Learning · Computer Science 2021-01-26 Harvineet Singh , Rina Singh , Vishwali Mhasawade , Rumi Chunara

Datasets for training recommender systems are often subject to distribution shift induced by users' and recommenders' selection biases. In this paper, we study the impact of selection bias on datasets with different quantization. We then…

Information Retrieval · Computer Science 2022-12-29 Fengyu Li , Sarah Dean

Ensuring generalization to unseen environments remains a challenge. Domain shift can lead to substantially degraded performance unless shifts are well-exercised within the available training environments. We introduce a simple robust…

Machine Learning · Computer Science 2021-10-20 Yilun Xu , Tommi Jaakkola

Besides the classical offline setup of machine learning, stream learning constitutes a well-established setup where data arrives over time in potentially non-stationary environments. Concept drift, the phenomenon that the underlying…

Machine Learning · Computer Science 2024-12-13 Fabian Hinder , Valerie Vaquet , David Komnick , Barbara Hammer

Learning from previously collected datasets of expert data offers the promise of acquiring robotic policies without unsafe and costly online explorations. However, a major challenge is a distributional shift between the states in the…

Machine Learning · Computer Science 2022-07-19 Alfredo Reichlin , Giovanni Luca Marchetti , Hang Yin , Ali Ghadirzadeh , Danica Kragic

Distribution shifts introduce uncertainty that undermines the robustness and generalization capabilities of machine learning models. While conventional wisdom suggests that learning causal-invariant representations enhances robustness to…

Machine Learning · Computer Science 2025-05-28 Abbavaram Gowtham Reddy , Celia Rubio-Madrigal , Rebekka Burkholz , Krikamol Muandet

With the widespread adoption of machine learning technologies in autonomous driving systems, their role in addressing complex environmental perception challenges has become increasingly crucial. However, existing machine learning models…

Robotics · Computer Science 2025-08-19 Lida Xu

Transfer learning is a machine learning paradigm where knowledge from one problem is utilized to solve a new but related problem. While conceivable that knowledge from one task could be useful for solving a related task, if not executed…

Machine Learning · Computer Science 2021-10-01 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

In many business settings, task-specific labeled data are scarce or costly to obtain, limiting supervised learning on a target task. A classical response is transfer learning (TL). Many TL works study how to transfer information from…

Machine Learning · Statistics 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Yohan Petetin

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Training machine learning models from data with weak supervision and dataset shifts is still challenging. Designing algorithms when these two situations arise has not been explored much, and existing algorithms cannot always handle the most…

Machine Learning · Computer Science 2023-08-30 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

We present first empirical results from our ongoing investigation of distribution shifts in image data used for various computer vision tasks. Instead of analyzing the original training and test data, we propose to study shifts in the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Paul Gavrikov , Janis Keuper

The increasing reliance on ML models in high-stakes tasks has raised a major concern on fairness violations. Although there has been a surge of work that improves algorithmic fairness, most of them are under the assumption of an identical…

Machine Learning · Computer Science 2023-01-18 Bang An , Zora Che , Mucong Ding , Furong Huang

Dealing with distribution shifts is one of the central challenges for modern machine learning. One fundamental situation is the covariate shift, where the input distributions of data change from training to testing stages while the…

Machine Learning · Computer Science 2024-05-28 Yu-Jie Zhang , Zhen-Yu Zhang , Peng Zhao , Masashi Sugiyama

Distribution shift occurs when the test distribution differs from the training distribution, and it can considerably degrade performance of machine learning models deployed in the real world. Temporal shifts -- distribution shifts arising…

Machine Learning · Computer Science 2023-01-18 Huaxiu Yao , Caroline Choi , Bochuan Cao , Yoonho Lee , Pang Wei Koh , Chelsea Finn

Real-world datasets often encode stereotypes and societal biases. Such biases can be implicitly captured by trained models, leading to biased predictions and exacerbating existing societal preconceptions. Existing debiasing methods, such as…

Machine Learning · Computer Science 2022-05-06 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

As machine learning (ML) algorithms are increasingly used in high-stakes applications, concerns have arisen that they may be biased against certain social groups. Although many approaches have been proposed to make ML models fair, they…

Machine Learning · Computer Science 2023-02-01 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

The problem of model collapse has presented new challenges in iterative training of generative models, where such training with synthetic data leads to an overall degradation of performance. This paper looks at the problem from a…

Machine Learning · Statistics 2026-02-19 Soham Bakshi , Sunrit Chakraborty

Machine learning models have traditionally been developed under the assumption that the training and test distributions match exactly. However, recent success in few-shot learning and related problems are encouraging signs that these models…

Machine Learning · Statistics 2020-10-15 James Lucas , Mengye Ren , Irene Kameni , Toniann Pitassi , Richard Zemel

In real-world contexts, sometimes data are available in form of Natural Data Streams, i.e. data characterized by a streaming nature, unbalanced distribution, data drift over a long time frame and strong correlation of samples in short time…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Guido Borghi , Gabriele Graffieti , Davide Maltoni