English
Related papers

Related papers: Invariance Principle Meets Vicinal Risk Minimizati…

200 papers

Domain generalized semantic segmentation is an essential computer vision task, for which models only leverage source data to learn the capability of generalized semantic segmentation towards the unseen target domains. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Guanlong Jiao , Chenyangguang Zhang , Haonan Yin , Yu Mo , Biqing Huang , Hui Pan , Yi Luo , Jingxian Liu

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

Single-domain generalization for object detection (S-DGOD) seeks to transfer learned representations from a single source domain to unseen target domains. While recent approaches have primarily focused on achieving feature invariance, they…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zhenwei He , Hongsu Ni

This work studies the distributed empirical risk minimization (ERM) problem under differential privacy (DP) constraint. Standard distributed algorithms achieve DP typically by perturbing all local subgradients with noise, leading to…

Optimization and Control · Mathematics 2023-07-04 Changxin Liu , Karl H. Johansson , Yang Shi

Data augmentation is widely known as a simple yet surprisingly effective technique for regularizing deep networks. Conventional data augmentation schemes, e.g., flipping, translation or rotation, are low-level, data-independent and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Yulin Wang , Gao Huang , Shiji Song , Xuran Pan , Yitong Xia , Cheng Wu

Despite advances in image classification methods, detecting the samples not belonging to the training classes is still a challenging problem. There has been a burst of interest in this subject recently, which is called Open-Set Recognition…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Invariant risk minimization (IRM) has received increasing attention as a way to acquire environment-agnostic data representations and predictions, and as a principled solution for preventing spurious correlations from being learned and for…

Machine Learning · Computer Science 2023-03-07 Yihua Zhang , Pranay Sharma , Parikshit Ram , Mingyi Hong , Kush Varshney , Sijia Liu

Out-of-distribution (OOD) detection is critical to building reliable machine learning systems in the open world. Researchers have proposed various strategies to reduce model overconfidence on OOD data. Among them, ReAct is a typical and…

Machine Learning · Computer Science 2023-05-19 Mingyu Xu , Zheng Lian , Bin Liu , Jianhua Tao

Data augmentation (DA) is a crucial technique for enhancing the sample efficiency of visual reinforcement learning (RL) algorithms. Notably, employing simple observation transformations alone can yield outstanding performance without extra…

Machine Learning · Computer Science 2023-10-30 Guozheng Ma , Linrui Zhang , Haoyu Wang , Lu Li , Zilin Wang , Zhen Wang , Li Shen , Xueqian Wang , Dacheng Tao

Domain generalization asks for models trained over a set of training environments to perform well in unseen test environments. Recently, a series of algorithms such as Invariant Risk Minimization (IRM) has been proposed for domain…

Machine Learning · Computer Science 2022-07-08 Haoxiang Wang , Haozhe Si , Bo Li , Han Zhao

Recent domain generalization (DG) approaches typically use the hypothesis learned on source domains for inference on the unseen target domain. However, such a hypothesis can be arbitrarily far from the optimal one for the target domain,…

Machine Learning · Computer Science 2023-05-25 Yi-Fan Zhang , Jindong Wang , Jian Liang , Zhang Zhang , Baosheng Yu , Liang Wang , Dacheng Tao , Xing Xie

Unsupervised Domain Adaptation (UDA) has attracted a lot of attention in the last ten years. The emergence of Domain Invariant Representations (IR) has improved drastically the transferability of representations from a labelled source…

Machine Learning · Computer Science 2020-06-25 Victor Bouvier , Philippe Very , Clément Chastagnol , Myriam Tami , Céline Hudelot

Despite the huge effort in developing novel regularizers for Domain Generalization (DG), adding simple data augmentation to the vanilla ERM which is a practical implementation of the Vicinal Risk Minimization principle (VRM)…

Machine Learning · Computer Science 2023-12-12 Sobhan Hemati , Mahdi Beitollahi , Amir Hossein Estiri , Bassel Al Omari , Xi Chen , Guojun Zhang

The ability to generalize under distributional shifts is essential to reliable machine learning, while models optimized with empirical risk minimization usually fail on non-$i.i.d$ testing data. Recently, invariant learning methods for…

Machine Learning · Computer Science 2021-10-26 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Domain generalization aims to learn invariance across multiple training domains, thereby enhancing generalization against out-of-distribution data. While gradient or representation matching algorithms have achieved remarkable success, these…

Machine Learning · Computer Science 2024-06-17 Yuxin Dong , Tieliang Gong , Hong Chen , Shuangyong Song , Weizhan Zhang , Chen Li

The stochastic variational inequality problem (SVIP) is an equilibrium model that includes random variables and has been widely applied in various fields such as economics and engineering. Expected residual minimization (ERM) is an…

Optimization and Control · Mathematics 2023-01-25 Atsushi Hori , Yuya Yamakawa , Nobuo Yamashita

Recent advancements in domain generalization for deepfake detection have attracted significant attention, with previous methods often incorporating additional modules to prevent overfitting to domain-specific patterns. However, such…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Lingyu Qiu , Ke Jiang , Xiaoyang Tan

Domain shift remains a key challenge in deploying machine learning models to the real world. Unsupervised domain adaptation (UDA) aims to address this by minimising domain discrepancy during training, but the discrepancy estimates suffer…

Machine Learning · Computer Science 2026-05-07 Andrea Napoli , Paul White

Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods…

Machine Learning · Computer Science 2026-02-03 Yuanchao Wang , Zhao-Rong Lai , Tianqi Zhong , Fengnan Li

Entropy minimization has been widely used in unsupervised domain adaptation (UDA). However, existing works reveal that entropy minimization only may result into collapsed trivial solutions. In this paper, we propose to avoid trivial…

Machine Learning · Computer Science 2020-02-06 Xiaofu Wu , Suofei hang , Quan Zhou , Zhen Yang , Chunming Zhao , Longin Jan Latecki