English
Related papers

Related papers: Domain Generalisation via Imprecise Learning

200 papers

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

Domain generalization (DG) aims to tackle the distribution shift between training domains and unknown target domains. Generating new domains is one of the most effective approaches, yet its performance gain depends on the distribution…

Machine Learning · Computer Science 2023-05-17 Rui Dai , Yonggang Zhang , Zhen Fang , Bo Han , Xinmei Tian

Recent domain generalization (DG) approaches typically use the hypothesis learned on source domains for inference on the unseen target domain. However, such a hypothesis can be arbitrarily far from the optimal one for the target domain,…

Machine Learning · Computer Science 2023-05-25 Yi-Fan Zhang , Jindong Wang , Jian Liang , Zhang Zhang , Baosheng Yu , Liang Wang , Dacheng Tao , Xing Xie

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Machine learning has achieved tremendous success in a variety of domains in recent years. However, a lot of these success stories have been in places where the training and the testing distributions are extremely similar to each other. In…

Machine Learning · Statistics 2021-03-05 Martin Arjovsky

In the field of computer vision, fine-tuning pre-trained models has become a prevalent strategy for out-of-distribution (OOD) generalization tasks. Different from most prior work that has focused on advancing learning algorithms, we…

Machine Learning · Computer Science 2025-04-29 Hiroki Naganuma , Ryuichiro Hataya , Kotaro Yoshida , Ioannis Mitliagkas

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Supervised learning datasets may contain multiple cues that explain the training set equally well, i.e., learning any of them would lead to the correct predictions on the training data. However, many of them can be spurious, i.e., lose…

Machine Learning · Computer Science 2024-04-23 Harold Benoit , Liangze Jiang , Andrei Atanov , Oğuzhan Fatih Kar , Mattia Rigotti , Amir Zamir

Out-of-distribution (OOD) generalization is indispensable for learning models in the wild, where testing distribution typically unknown and different from the training. Recent methods derived from causality have shown great potential in…

Machine Learning · Computer Science 2024-05-13 Mengyue Yang , Zhen Fang , Yonggang Zhang , Yali Du , Furui Liu , Jean-Francois Ton , Jianhong Wang , Jun Wang

Domain generalization aims to learn a model with good generalization ability, that is, the learned model should not only perform well on several seen domains but also on unseen domains with different data distributions. State-of-the-art…

Machine Learning · Computer Science 2023-04-04 Boyang Lyu , Thuan Nguyen , Matthias Scheutz , Prakash Ishwar , Shuchin Aeron

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

Recently, data heterogeneity among the training datasets on the local clients (a.k.a., Non-IID data) has attracted intense interest in Federated Learning (FL), and many personalized federated learning methods have been proposed to handle…

Machine Learning · Computer Science 2022-11-22 Xueyang Tang , Song Guo , Jie Zhang

Neural networks are often utilised in critical domain applications (e.g. self-driving cars, financial markets, and aerospace engineering), even though they exhibit overconfident predictions for ambiguous inputs. This deficiency demonstrates…

Machine Learning · Computer Science 2023-01-03 John Mitros , Brian Mac Namee

Out-of-distribution (OOD) detection is critical to ensuring the reliability and safety of machine learning systems. For instance, in autonomous driving, we would like the driving system to issue an alert and hand over the control to humans…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jingkang Yang , Kaiyang Zhou , Yixuan Li , Ziwei Liu

Out-of-distribution (OOD) generalization remains a fundamental challenge in real-world classification, where test distributions often differ substantially from training data. Most existing approaches pursue domain-invariant representations,…

Machine Learning · Computer Science 2026-01-30 Chen Cheng , Ang Li

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

The goal of domain generalization algorithms is to predict well on distributions different from those seen during training. While a myriad of domain generalization algorithms exist, inconsistencies in experimental conditions -- datasets,…

Machine Learning · Computer Science 2020-07-06 Ishaan Gulrajani , David Lopez-Paz

In the field of object detection, domain generalisation (DG) aims to ensure robust performance across diverse and unseen target domains by learning the robust domain-invariant features corresponding to the objects of interest across…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shuvam Jena , Sushmetha Sumathi Rajendran , Karthik Seemakurthy , Sasithradevi A , Vijayalakshmi M , Prakash Poornachari

We study the Out-of-Distribution (OOD) generalization in machine learning and propose a general framework that establishes information-theoretic generalization bounds. Our framework interpolates freely between Integral Probability Metric…

Information Theory · Computer Science 2024-12-16 Wenliang Liu , Guanding Yu , Lele Wang , Renjie Liao