English
Related papers

Related papers: Exploring Optimal Substructure for Out-of-distribu…

200 papers

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully…

Machine Learning · Computer Science 2022-10-28 Qizhou Wang , Feng Liu , Yonggang Zhang , Jing Zhang , Chen Gong , Tongliang Liu , Bo Han

Detecting out-of-distribution (OOD) inputs during the inference stage is crucial for deploying neural networks in the real world. Previous methods commonly relied on the output of a network derived from the highly activated feature map. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yeonguk Yu , Sungho Shin , Seongju Lee , Changhyun Jun , Kyoobin Lee

Existing Out-of-Distribution (OoD) detection methods address to detect OoD samples from In-Distribution (InD) data mainly by exploring differences in features, logits and gradients in Deep Neural Networks (DNNs). We in this work propose a…

Machine Learning · Computer Science 2024-07-17 Kun Fang , Qinghua Tao , Xiaolin Huang , Jie Yang

Supervised learning datasets may contain multiple cues that explain the training set equally well, i.e., learning any of them would lead to the correct predictions on the training data. However, many of them can be spurious, i.e., lose…

Machine Learning · Computer Science 2024-04-23 Harold Benoit , Liangze Jiang , Andrei Atanov , Oğuzhan Fatih Kar , Mattia Rigotti , Amir Zamir

Recent works demonstrate the effectiveness of diffusion models as unsupervised solvers for inverse imaging problems. Sparse-view computed tomography (CT) has greatly benefited from these advancements, achieving improved generalization…

Image and Video Processing · Electrical Eng. & Systems 2025-05-28 Ezgi Demircan-Tureyen , Felix Lucka , Tristan van Leeuwen

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

Machine Learning · Computer Science 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

Pruning is a model compression method that removes redundant parameters in deep neural networks (DNNs) while maintaining accuracy. Most available filter pruning methods require complex treatments such as iterative pruning, features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yue Wu , Yuan Lan , Luchan Zhang , Yang Xiang

Benign overfitting refers to the phenomenon where an over-parameterized model fits the training data perfectly, including noise in the data, but still generalizes well to the unseen test data. While prior work provides some theoretical…

Machine Learning · Computer Science 2024-12-20 Shange Tang , Jiayun Wu , Jianqing Fan , Chi Jin

Out-of-Distribution (OOD) detection is crucial when deploying machine learning models in open-world applications. The core challenge in OOD detection is mitigating the model's overconfidence on OOD data. While recent methods using auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jiankang Chen , Ling Deng , Zhiyong Gan , Wei-Shi Zheng , Ruixuan Wang

Out-of-distribution (OOD) detection identifies test samples that fall outside a model's training distribution, a capability critical for safe deployment in high-stakes applications. Standard OOD detectors are trained on a specific…

Artificial Intelligence · Computer Science 2026-05-14 Shawn Li , You Qin , Jiate Li , Charith Peris , Lisa Bauer , Roger Zimmermann , Yue Zhao

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Out-of-distribution (OOD) detection and lossless compression constitute two problems that can be solved by the training of probabilistic models on a first dataset with subsequent likelihood evaluation on a second dataset, where data…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Mingtian Zhang , Andi Zhang , Steven McDonagh

Generalizing to out-of-distribution (OOD) data or unseen domain, termed OOD generalization, still lacks appropriate theoretical guarantees. Canonical OOD bounds focus on different distance measurements between source and target domains but…

Machine Learning · Computer Science 2024-03-12 Yingtian Zou , Kenji Kawaguchi , Yingnan Liu , Jiashuo Liu , Mong-Li Lee , Wynne Hsu

Graphs are a fundamental data structure for representing relational information in domains such as social networks, molecular systems, and knowledge graphs. However, graph learning models often suffer from limited generalization when…

Machine Learning · Computer Science 2026-01-30 Haoyang Li , Haibo Chen , Xin Wang , Wenwu Zhu

Out-of-distribution (OOD) detection is indispensable for machine learning models deployed in the open world. Recently, the use of an auxiliary outlier dataset during training (also known as outlier exposure) has shown promising performance.…

Machine Learning · Computer Science 2022-06-29 Yifei Ming , Ying Fan , Yixuan Li

Out-of-distribution (OOD) generalization is indispensable for learning models in the wild, where testing distribution typically unknown and different from the training. Recent methods derived from causality have shown great potential in…

Machine Learning · Computer Science 2024-05-13 Mengyue Yang , Zhen Fang , Yonggang Zhang , Yali Du , Furui Liu , Jean-Francois Ton , Jianhong Wang , Jun Wang

Generative modelling has been a topic at the forefront of machine learning research for a substantial amount of time. With the recent success in the field of machine learning, especially in deep learning, there has been an increased…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 M. M. A. Valiuddin , C. G. A. Viviers