English
Related papers

Related papers: Bias as a Virtue: Rethinking Generalization under …

200 papers

Effective out-of-distribution (OOD) detection is crucial for reliable machine learning models, yet most current methods are limited in practical use due to requirements like access to training data or intervention in training. We present a…

Machine Learning · Computer Science 2024-03-13 Fran Jelenić , Josip Jukić , Martin Tutek , Mate Puljiz , Jan Šnajder

There has been a massive increase in research interest towards applying data driven methods to problems in mechanics. While traditional machine learning (ML) methods have enabled many breakthroughs, they rely on the assumption that the…

Machine Learning · Statistics 2022-09-16 Lingxiao Yuan , Harold S. Park , Emma Lejeune

Out-of-distribution (OOD) detection plays a key role in enhancing the robustness of artificial intelligence systems by identifying inputs that differ significantly from the training distribution, thereby preventing unreliable predictions…

Out-of-distribution (OOD) testing is increasingly popular for evaluating a machine learning system's ability to generalize beyond the biases of a training set. OOD benchmarks are designed to present a different joint distribution of data…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Damien Teney , Kushal Kafle , Robik Shrestha , Ehsan Abbasnejad , Christopher Kanan , Anton van den Hengel

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Distributed learning provides an attractive framework for scaling the learning task by sharing the computational load over multiple nodes in a network. Here, we investigate the performance of distributed learning for large-scale linear…

Machine Learning · Statistics 2021-11-03 Martin Hellkvist , Ayça Özçelikkale , Anders Ahlén

Machine learning has recently demonstrated impressive progress in predictive accuracy across a wide array of tasks. Most ML approaches focus on generalization performance on unseen data that are similar to the training data…

Machine Learning · Computer Science 2021-07-20 Anand Avati , Martin Seneviratne , Emily Xue , Zhen Xu , Balaji Lakshminarayanan , Andrew M. Dai

The pervasive issue of bias in AI presents a significant challenge to painting classification, and is getting more serious as these systems become increasingly integrated into tasks like art curation and restoration. Biases, often arising…

Artificial Intelligence · Computer Science 2025-07-11 Mridula Vijendran , Shuang Chen , Jingjing Deng , Hubert P. H. Shum

We consider the problem of OOD generalization, where the goal is to train a model that performs well on test distributions that are different from the training distribution. Deep learning models are known to be fragile to such shifts and…

Machine Learning · Computer Science 2022-08-22 Anshul Nasery , Sravanti Addepalli , Praneeth Netrapalli , Prateek Jain

Modern machine learning models deployed often encounter distribution shifts in real-world applications, manifesting as covariate or semantic out-of-distribution (OOD) shifts. These shifts give rise to challenges in OOD generalization and…

Machine Learning · Computer Science 2024-10-11 Haoyue Bai , Jifan Zhang , Robert Nowak

Cross-validation is a common method for estimating the predictive performance of machine learning models. In a data-scarce regime, where one typically wishes to maximize the number of instances used for training the model, an approach…

Methodology · Statistics 2025-03-25 George I. Austin , Itsik Pe'er , Tal Korem

Robustness in AI systems refers to their ability to maintain reliable and accurate performance under various conditions, including out-of-distribution (OOD) samples, adversarial attacks, and environmental changes. This is crucial in…

Artificial Intelligence · Computer Science 2025-10-15 Wissam Salhab , Darine Ameyed , Hamid Mcheick , Fehmi Jaafar

Out-of-distribution (OOD) detection is essential for the reliability of ML models. Most existing methods for OOD detection learn a fixed decision criterion from a given in-distribution dataset and apply it universally to decide if a data…

Machine Learning · Computer Science 2023-11-29 YiFan Zhang , Xue Wang , Tian Zhou , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

Machine Learning · Computer Science 2022-02-21 Abderrahmen Amich , Birhanu Eshete

Several data augmentation methods deploy unlabeled-in-distribution (UID) data to bridge the gap between the training and inference of neural networks. However, these methods have clear limitations in terms of availability of UID data and…

Machine Learning · Computer Science 2021-11-23 Saehyung Lee , Changhwa Park , Hyungyu Lee , Jihun Yi , Jonghyun Lee , Sungroh Yoon

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

State-of-the-art image classifiers trained on massive datasets (such as ImageNet) have been shown to be vulnerable to a range of both intentional and incidental distribution shifts. On the other hand, several recent classifiers with…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Benjamin Feuer , Ameya Joshi , Chinmay Hegde

Supervised learning datasets may contain multiple cues that explain the training set equally well, i.e., learning any of them would lead to the correct predictions on the training data. However, many of them can be spurious, i.e., lose…

Machine Learning · Computer Science 2024-04-23 Harold Benoit , Liangze Jiang , Andrei Atanov , Oğuzhan Fatih Kar , Mattia Rigotti , Amir Zamir

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang