English
Related papers

Related papers: Sufficient Invariant Learning for Distribution Shi…

200 papers

Attention-based multiple instance learning (MIL) has emerged as a powerful framework for whole slide image (WSI) diagnosis, leveraging attention to aggregate instance-level features into bag-level predictions. Despite this success, we find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Linfeng Ye , Shayan Mohajer Hamidi , Zhixiang Chi , Guang Li , Mert Pilanci , Takahiro Ogawa , Miki Haseyama , Konstantinos N. Plataniotis

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Due to the dynamic nature of time-series data, it is crucial to equip TSF models with out-of-distribution (OOD) generalization abilities, as historical training…

Machine Learning · Computer Science 2024-06-14 Haoxin Liu , Harshavardhan Kamarthi , Lingkai Kong , Zhiyuan Zhao , Chao Zhang , B. Aditya Prakash

Imitation learning (IL) enables autonomous behavior by learning from expert demonstrations. While more sample-efficient than comparative alternatives like reinforcement learning, IL is sensitive to compounding errors induced by distribution…

Systems and Control · Electrical Eng. & Systems 2025-12-22 Aditya Gahlawat , Ahmed Aboudonia , Sandeep Banik , Naira Hovakimyan , Nikolai Matni , Aaron D. Ames , Gioele Zardini , Alberto Speranzon

While training fair machine learning models has been studied extensively in recent years, most developed methods rely on the assumption that the training and test data have similar distributions. In the presence of distribution shifts, fair…

Machine Learning · Computer Science 2023-09-22 Sina Baharlouei , Meisam Razaviyayn

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

Machine Learning · Computer Science 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Neural network interpretation methods, particularly feature attribution methods, are known to be fragile with respect to adversarial input perturbations. To address this, several methods for enhancing the local smoothness of the gradient…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Sunghwan Joo , Seokhyeon Jeong , Juyeon Heo , Adrian Weller , Taesup Moon

Robustness is of central importance in machine learning and has given rise to the fields of domain generalization and invariant learning, which are concerned with improving performance on a test distribution distinct from but related to the…

Machine Learning · Computer Science 2020-12-03 Robert Adragna , Elliot Creager , David Madras , Richard Zemel

Can we modify the training data distribution to encourage the underlying optimization method toward finding solutions with superior generalization performance on in-distribution data? In this work, we approach this question for the first…

Machine Learning · Computer Science 2026-03-03 Dang Nguyen , Paymon Haddad , Eric Gan , Baharan Mirzasoleiman

Class-incremental learning (CIL) has emerged as a means to learn new classes incrementally without catastrophic forgetting of previous classes. Recently, CIL has undergone a paradigm shift towards dynamic architectures due to their superior…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Sunyuan Qiang , Yanyan Liang , Jun Wan , Du Zhang

The endeavor to preserve the generalization of a fair and invariant classifier across domains, especially in the presence of distribution shifts, becomes a significant and intricate challenge in machine learning. In response to this…

Machine Learning · Computer Science 2024-05-22 Chen Zhao , Kai Jiang , Xintao Wu , Haoliang Wang , Latifur Khan , Christan Grant , Feng Chen

As a crucial step toward real-world learning scenarios with changing environments, dataset shift theory and invariant representation learning algorithm have been extensively studied to relax the identical distribution assumption in…

Machine Learning · Computer Science 2024-06-25 You-Wei Luo , Chuan-Xian Ren

Deep learning models lack shift invariance, making them sensitive to input shifts that cause changes in output. While recent techniques seek to address this for images, our findings show that these approaches fail to provide…

Machine Learning · Computer Science 2025-02-28 Berken Utku Demirel , Christian Holz

Solving inverse problems, such as parameter estimation and optimal control, is a vital part of science. Many experiments repeatedly collect data and rely on machine learning algorithms to quickly infer solutions to the associated inverse…

Machine Learning · Computer Science 2022-10-14 Philipp Holl , Vladlen Koltun , Nils Thuerey

Single-domain generalization for object detection (S-DGOD) seeks to transfer learned representations from a single source domain to unseen target domains. While recent approaches have primarily focused on achieving feature invariance, they…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zhenwei He , Hongsu Ni

This paper concerns the central issues of model robustness and sample efficiency in offline reinforcement learning (RL), which aims to learn to perform decision making from history data without active exploration. Due to uncertainties and…

Machine Learning · Computer Science 2024-01-01 Laixi Shi , Yuejie Chi

Estimating the 3DoF rotation from a single RGB image is an important yet challenging problem. As a popular approach, probabilistic rotation modeling additionally carries prediction uncertainty information, compared to single-prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Yingda Yin , Jiangran Lyu , Yang Wang , Haoran Liu , He Wang , Baoquan Chen

Multi-source domain adaptation aims to reduce performance degradation when applying machine learning models to unseen domains. A fundamental challenge is devising the optimal strategy for feature selection. Existing literature is somewhat…

Machine Learning · Statistics 2024-03-12 Ziliang Samuel Zhong , Xiang Pan , Qi Lei

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized…

High Energy Physics - Phenomenology · Physics 2025-04-07 Seth Nabat , Aishik Ghosh , Edmund Witkowski , Gregor Kasieczka , Daniel Whiteson

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Practitioners often face the challenge of deploying prediction models in new environments with shifted distributions of covariates and responses. With observational data, such shifts are often driven by unobserved confounding, and can in…

Machine Learning · Computer Science 2026-04-02 Kulunu Dharmakeerthi , YoonHaeng Hur , Tengyuan Liang