English
Related papers

Related papers: Provable Domain Generalization via Invariant-Featu…

200 papers

Implicit Neural representations (INRs) are widely used for scientific data reduction and visualization by modeling the function that maps a spatial location to a data value. Without any prior knowledge about the spatial distribution of…

Graphics · Computer Science 2024-02-22 Haoyu Li , Han-Wei Shen

Empirical risk minimization can lead to poor generalization behavior on unseen environments if the learned model does not capture invariant feature representations. Invariant risk minimization (IRM) is a recent proposal for discovering…

Machine Learning · Computer Science 2023-10-24 Francesco Alesiani , Shujian Yu , Mathias Niepert

Supervised learning results typically rely on assumptions of i.i.d. data. Unfortunately, those assumptions are commonly violated in practice. In this work, we tackle such problem by focusing on domain generalization: a formalization where…

Machine Learning · Computer Science 2024-10-30 Isabela Albuquerque , João Monteiro , Mohammad Darvishi , Tiago H. Falk , Ioannis Mitliagkas

Structural and practical parameter non-identifiability issues are common when mathematical models are used to interpret data. Such issues motivate model reparameterisation and reduction methods. Here, we consider Invariant Image…

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

Machine Learning · Computer Science 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

Domain shifts in the training data are common in practical applications of machine learning; they occur for instance when the data is coming from different sources. Ideally, a ML model should work well independently of these shifts, for…

Image retrieval under generalized test scenarios has gained significant momentum in literature, and the recently proposed protocol of Universal Cross-domain Retrieval is a pioneer in this direction. A common practice in any such generalized…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Soumava Paul , Titir Dutta , Aheli Saha , Abhishek Samanta , Soma Biswas

Open-set domain generalization addresses a real-world challenge: training a model to generalize across unseen domains (domain generalization) while also detecting samples from unknown classes not encountered during training (open-set…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Haoliang Wang , Chen Zhao , Feng Chen

A common explanation for the failure of deep networks to generalize out-of-distribution is that they fail to recover the "correct" features. We challenge this notion with a simple experiment which suggests that ERM already learns sufficient…

Machine Learning · Computer Science 2022-10-31 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Medical image super-resolution (SR) is an active research area that has many potential applications, including reducing scan time, bettering visual understanding, increasing robustness in downstream tasks, etc. However, applying…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Cheng Peng , S. Kevin Zhou , Rama Chellappa

Despite impressive success in many tasks, deep learning models are shown to rely on spurious features, which will catastrophically fail when generalized to out-of-distribution (OOD) data. Invariant Risk Minimization (IRM) is proposed to…

Machine Learning · Computer Science 2022-12-20 Shiji Xin , Yifei Wang , Jingtong Su , Yisen Wang

Achieving health equity in Artificial Intelligence (AI) requires diagnostic models that maintain reliability across diverse populations. However, breast cancer screening systems frequently suffer from domain overfitting, degrading…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Hung Q. Vo , Samira Zare , Son T. Ly , Lin Wang , Chika F. Ezeana , Xiaohui Yu , Kelvin K. Wong , Stephen T. C. Wong , Hien V. Nguyen

It is well-known that in inverse problems, end-to-end trained networks overfit the degradation model seen in the training set, i.e., they do not generalize to other types of degradations well. Recently, an approach to first map images…

Image and Video Processing · Electrical Eng. & Systems 2021-06-02 Cansu Korkmaz , A. Murat Tekalp , Zafer Dogan

Machine learning models often generalize poorly to out-of-distribution (OOD) data as a result of relying on features that are spuriously correlated with the label during training. Recently, the technique of Invariant Risk Minimization (IRM)…

Machine Learning · Computer Science 2023-01-18 Dongsung Huh , Avinash Baidya

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Ngan Le

Invariant representation learning (IRL) encourages the prediction from invariant causal features to labels de-confounded from the environments, advancing the technical roadmap of out-of-distribution (OOD) generalization. Despite spotlights…

Machine Learning · Computer Science 2023-12-18 Ziliang Chen , Yongsen Zheng , Zhao-Rong Lai , Quanlong Guan , Liang Lin

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all…

Machine Learning · Computer Science 2022-02-16 A. Tuan Nguyen , Toan Tran , Yarin Gal , Atılım Güneş Baydin

Domain Generalization (DG) aims to train a model, from multiple observed source domains, in order to perform well on unseen target domains. To obtain the generalization capability, prior DG approaches have focused on extracting…

Machine Learning · Computer Science 2021-10-19 Manh-Ha Bui , Toan Tran , Anh Tuan Tran , Dinh Phung

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert's behavior. It is well known that, in…

Machine Learning · Computer Science 2022-10-14 Paul Rolland , Luca Viano , Norman Schuerhoff , Boris Nikolov , Volkan Cevher

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ling Zhang , Xiaosong Wang , Dong Yang , Thomas Sanford , Stephanie Harmon , Baris Turkbey , Holger Roth , Andriy Myronenko , Daguang Xu , Ziyue Xu