English
Related papers

Related papers: Scalable Ensemble Diversification for OOD Generali…

200 papers

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this…

Machine Learning · Computer Science 2024-05-07 Zhaiming Shen , Menglun Wang , Guang Cheng , Ming-Jun Lai , Lin Mu , Ruihao Huang , Qi Liu , Hao Zhu

Deep ensembles excel in large-scale image classification tasks both in terms of prediction accuracy and calibration. Despite being simple to train, the computation and memory cost of deep ensembles limits their practicability. While some…

Machine Learning · Computer Science 2021-10-28 Giung Nam , Jongmin Yoon , Yoonho Lee , Juho Lee

Gradient-based learning algorithms have an implicit simplicity bias which in effect can limit the diversity of predictors being sampled by the learning procedure. This behavior can hinder the transferability of trained models by (i)…

Machine Learning · Computer Science 2022-11-24 Matteo Pagliardini , Martin Jaggi , François Fleuret , Sai Praneeth Karimireddy

Open Set Recognition (OSR) extends image classification to an open-world setting, by simultaneously classifying known classes and identifying unknown ones. While conventional OSR approaches can detect Out-of-Distribution (OOD) samples, they…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Piyapat Saranrittichai , Chaithanya Kumar Mummadi , Claudia Blaiotta , Mauricio Munoz , Volker Fischer

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

Machine Learning · Computer Science 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Detecting out-of-distribution (OOD) samples is important for deploying machine learning models in safety-critical applications such as autonomous driving and robot-assisted surgery. Existing research has mainly focused on unimodal scenarios…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Hao Dong , Yue Zhao , Eleni Chatzi , Olga Fink

Detecting out-of-distribution (OOD) samples plays a key role in open-world and safety-critical applications such as autonomous systems and healthcare. Recently, self-supervised representation learning techniques (via contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Sina Mohseni , Arash Vahdat , Jay Yadawa

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

Machine Learning · Computer Science 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

Out-of-distribution (OOD) detection is important for deploying reliable machine learning models on real-world applications. Recent advances in outlier exposure have shown promising results on OOD detection via fine-tuning model with…

Machine Learning · Computer Science 2023-10-27 Jianing Zhu , Geng Yu , Jiangchao Yao , Tongliang Liu , Gang Niu , Masashi Sugiyama , Bo Han

Despite advances in image classification methods, detecting the samples not belonging to the training classes is still a challenging problem. There has been a burst of interest in this subject recently, which is called Open-Set Recognition…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Out-of-distribution (OOD) detection is crucial for the reliable deployment of machine learning models in real-world scenarios, enabling the identification of unknown samples or objects. A prominent approach to enhance OOD detection…

Machine Learning · Statistics 2025-08-05 Heng Gao , Jun Li

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jingkang Yang , Pengyun Wang , Dejian Zou , Zitang Zhou , Kunyuan Ding , Wenxuan Peng , Haoqi Wang , Guangyao Chen , Bo Li , Yiyou Sun , Xuefeng Du , Kaiyang Zhou , Wayne Zhang , Dan Hendrycks , Yixuan Li , Ziwei Liu

Open-set semi-supervised learning (open-set SSL) investigates a challenging but practical scenario where out-of-distribution (OOD) samples are contained in the unlabeled data. While the mainstream technique seeks to completely filter out…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Junkai Huang , Chaowei Fang , Weikai Chen , Zhenhua Chai , Xiaolin Wei , Pengxu Wei , Liang Lin , Guanbin Li

Despite commendable achievements made by existing work, prevailing multimodal sarcasm detection studies rely more on textual content over visual information. It unavoidably induces spurious correlations between textual words and labels,…

Computation and Language · Computer Science 2023-12-20 Mengzhao Jia , Can Xie , Liqiang Jing

The inaccuracy of neural network models on inputs that do not stem from the training data distribution is both problematic and at times unrecognized. Model uncertainty estimation can address this issue, where uncertainty estimates are often…

Machine Learning · Computer Science 2020-02-14 Siddhartha Jain , Ge Liu , Jonas Mueller , David Gifford

Diversity is an important consideration in the construction of robust neural network ensembles. A collection of well trained models will generalize better if they are diverse in the patterns they respond to and the predictions they make.…

Machine Learning · Computer Science 2023-02-14 Tim Whitaker , Darrell Whitley

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD…

Machine Learning · Computer Science 2024-10-16 Qingyang Zhang , Qiuxuan Feng , Joey Tianyi Zhou , Yatao Bian , Qinghua Hu , Changqing Zhang

The training and test data for deep-neural-network-based classifiers are usually assumed to be sampled from the same distribution. When part of the test samples are drawn from a distribution that is sufficiently far away from that of the…

Machine Learning · Computer Science 2021-12-14 Yinan Wang , Wenbo Sun , Jionghua "Judy" Jin , Zhenyu "James" Kong , Xiaowei Yue

Domain adaptation is an attractive approach given the availability of a large amount of labeled data with similar properties but different domains. It is effective in image classification tasks where obtaining sufficient label data is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Yeganeh Madadi , Vahid Seydi , Jian Sun , Edward Chaum , Siamak Yousefi