English
Related papers

Related papers: On the Connection between Invariant Learning and A…

200 papers

Although attention mechanisms have become fundamental components of deep learning models, they are vulnerable to perturbations, which may degrade the prediction performance and model interpretability. Adversarial training (AT) for attention…

Computation and Language · Computer Science 2022-12-27 Shunsuke Kitada , Hitoshi Iyatomi

Adversarial training (AT) is a popular method for training robust deep neural networks (DNNs) against adversarial attacks. Yet, AT suffers from two shortcomings: (i) the robustness of DNNs trained by AT is highly intertwined with the size…

Machine Learning · Computer Science 2024-05-24 Shayan Mohajer Hamidi , Linfeng Ye

We propose a novel one-step supervised imitation learning (IL) framework called Adversarial Density Regression (ADR). This IL framework aims to correct the policy learned on unknown-quality to match the expert distribution by utilizing…

Machine Learning · Computer Science 2025-01-14 Ziqi Zhang , Zifeng Zhuang , Jingzehua Xu , Yiyuan Yang , Yubo Huang , Donglin Wang , Shuai Zhang

Cine cardiac magnetic resonance (CMR) has become the gold standard for the non-invasive evaluation of cardiac function. In particular, it allows the accurate quantification of functional parameters including the chamber volumes and ejection…

Image and Video Processing · Electrical Eng. & Systems 2020-08-28 Cian M. Scannell , Amedeo Chiribiri , Mitko Veta

Out-of-distribution (OOD) generalization remains challenging when models simultaneously encounter correlation shifts across environments and diversity shifts driven by rare or hard samples. Existing invariant risk minimization (IRM) methods…

Machine Learning · Computer Science 2026-02-03 Yuanchao Wang , Zhao-Rong Lai , Tianqi Zhong , Fengnan Li

Deep learning has achieved remarkable success in medical image classification. However, its clinical application is often hindered by data heterogeneity caused by variations in scanner vendors, imaging protocols, and operators. Approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Yu Yao , Xu Luo , Zhongliang Fu

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

Machine Learning · Statistics 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

Learning robust vision models that perform well in out-of-distribution (OOD) situations is an important task for model deployment in real-world settings. Despite extensive research in this field, many proposed methods have only shown minor…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Gyuseong Lee , Wooseok Jang , Jinhyeon Kim , Jaewoo Jung , Seungryong Kim

Out-of-distribution (OOD) detection holds significant importance across many applications. While semantic and domain-shift OOD problems are well-studied, this work focuses on covariate shifts - subtle variations in the data distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Francisco Caetano , Christiaan Viviers , Luis A. Zavala-Mondragón , Peter H. N. de With , Fons van der Sommen

Generating large-scale synthetic data in simulation is a feasible alternative to collecting/labelling real data for training vision-based deep learning models, albeit the modelling inaccuracies do not generalize to the physical world. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Ajay Kumar Tanwani

Traditional machine learning assumes that training and test sets are derived from the same distribution; however, this assumption does not always hold in practical applications. This distribution disparity can lead to severe performance…

Machine Learning · Computer Science 2025-02-18 Ahmad Chaddad , Yihang Wu , Yuchen Jiang , Ahmed Bouridane , Christian Desrosiers

Learning robust models that generalize well under changes in the data distribution is critical for real-world applications. To this end, there has been a growing surge of interest to learn simultaneously from multiple training domains -…

Machine Learning · Computer Science 2022-06-02 Alexandre Rame , Corentin Dancette , Matthieu Cord

Unsupervised Domain Adaptation (UDA) methods aim to transfer knowledge from a labeled source domain to an unlabeled target domain. UDA has been extensively studied in the computer vision literature. Deep networks have been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Shao-Yuan Lo , Vishal M. Patel

It is well-known that deep neural networks (DNNs) are susceptible to adversarial attacks, exposing a severe fragility of deep learning systems. As the result, adversarial training (AT) method, by incorporating adversarial examples during…

Machine Learning · Computer Science 2022-03-01 Tuan Anh Bui , Trung Le , Quan Tran , He Zhao , Dinh Phung

Adversarial learning has demonstrated good performance in the unsupervised domain adaptation setting, by learning domain-invariant representations. However, recent work has shown limitations of this approach when label distributions differ…

Machine Learning · Computer Science 2020-12-15 Remi Tachet , Han Zhao , Yu-Xiang Wang , Geoff Gordon

In many practical visual recognition scenarios, feature distribution in the source domain is generally different from that of the target domain, which results in the emergence of general cross-domain visual recognition problems. To address…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Shanshan Wang , Lei Zhang , JingRu Fu

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique aimed at learning features robust to such attacks and is widely regarded as a very effective defense.…

Machine Learning · Computer Science 2020-09-11 Theodoros Tsiligkaridis , Jay Roberts