English
Related papers

Related papers: SFP: Spurious Feature-targeted Pruning for Out-of-…

200 papers

We propose a method for generating spurious features by leveraging large-scale text-to-image diffusion models. Although the previous work detects spurious features in a large-scale dataset like ImageNet and introduces Spurious ImageNet, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 AprilPyone MaungMaung , Huy H. Nguyen , Hitoshi Kiya , Isao Echizen

When transferring a pretrained model to a downstream task, two popular methods are full fine-tuning (updating all the model parameters) and linear probing (updating only the last linear layer -- the "head"). It is well known that…

Machine Learning · Computer Science 2022-02-24 Ananya Kumar , Aditi Raghunathan , Robbie Jones , Tengyu Ma , Percy Liang

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

Software fault prediction (SFP) is a critical task in software engineering, enabling early identification of faults in modules to improve software quality and reduce maintenance costs. This research investigates the combined effects of…

Software Engineering · Computer Science 2026-05-19 Ahmad Nauman Ghazi , Nagajyothi Devarapalli , Ashir Javeed , Sadi Alawadi , Fahed Alkhabbas , Khalid AlKharabsheh

In recent years, Artificial Intelligence (AI) models have achieved remarkable success across various domains, yet challenges persist in two critical areas: ensuring robustness against uncertain inputs and drastically increasing model…

Machine Learning · Computer Science 2025-02-20 Erik B. Terres-Escudero , Javier Del Ser , Aitor Martínez-Seras , Pablo Garcia-Bringas

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Sen Pei

Out-of-distribution (OOD) detection is crucial for ensuring the reliable deployment of deep models in real-world scenarios. Recently, from the perspective of over-parameterization, a series of methods leveraging weight sparsification…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Haonan Xu , Yang Yang

Feature shaping refers to a family of methods that exhibit state-of-the-art performance for out-of-distribution (OOD) detection. These approaches manipulate the feature representation, typically from the penultimate layer of a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Qinyu Zhao , Ming Xu , Kartik Gupta , Akshay Asthana , Liang Zheng , Stephen Gould

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

Machine Learning · Statistics 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Graph Out-of-Distribution (OOD), requiring that models trained on biased data generalize to the unseen test data, has a massive of real-world applications. One of the most mainstream methods is to extract the invariant subgraph by aligning…

Machine Learning · Computer Science 2024-02-15 Xuexin Chen , Ruichu Cai , Kaitao Zheng , Zhifan Jiang , Zhengting Huang , Zhifeng Hao , Zijian Li

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan

Most deep-learning-based image classification methods assume that all samples are generated under an independent and identically distributed (IID) setting. However, out-of-distribution (OOD) generalization is more common in practice, which…

Machine Learning · Computer Science 2022-02-24 Xin Guo , Zhengxu Yu , Chao Xiang , Zhongming Jin , Jianqiang Huang , Deng Cai , Xiaofei He , Xian-Sheng Hua

For a machine learning model deployed in real world scenarios, the ability of detecting out-of-distribution (OOD) samples is indispensable and challenging. Most existing OOD detection methods focused on exploring advanced training skills or…

Machine Learning · Computer Science 2024-02-16 Chao Chen , Zhihang Fu , Kai Liu , Ze Chen , Mingyuan Tao , Jieping Ye

Invariant representation learning (IRL) encourages the prediction from invariant causal features to labels de-confounded from the environments, advancing the technical roadmap of out-of-distribution (OOD) generalization. Despite spotlights…

Machine Learning · Computer Science 2023-12-18 Ziliang Chen , Yongsen Zheng , Zhao-Rong Lai , Quanlong Guan , Liang Lin

Semi-supervised Learning (SSL) has been proven vulnerable to out-of-distribution (OOD) samples in realistic large-scale unsupervised datasets due to over-confident pseudo-labeling OODs as in-distribution (ID). A key underlying problem is…

Machine Learning · Computer Science 2023-08-31 Xuwei Tan , Yi-Jie Huang , Yaqian Li

In recent years, semantic segmentation has flourished in various applications. However, the high computational cost remains a significant challenge that hinders its further adoption. The filter pruning method for structured network slimming…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Dongyue Wu , Zilin Guo , Li Yu , Nong Sang , Changxin Gao

Federated Learning (FL) enables collaborative model training while preserving data privacy, but its practical deployment is hampered by system and statistical heterogeneity. While federated network pruning offers a path to mitigate these…

Machine Learning · Computer Science 2026-04-09 Zheng Jiang , Nan He , Yiming Chen , Lifeng Sun

Recent years have witnessed the great success of self-supervised learning (SSL) in recommendation systems. However, SSL recommender models are likely to suffer from spurious correlations, leading to poor generalization. To mitigate spurious…

Information Retrieval · Computer Science 2024-04-19 Xinyu Lin , Yiyan Xu , Wenjie Wang , Yang Zhang , Fuli Feng

While deep learning models have shown remarkable performance in various tasks, they are susceptible to learning non-generalizable spurious features rather than the core features that are genuinely correlated to the true label. In this…

Machine Learning · Computer Science 2023-10-31 Yihe Deng , Yu Yang , Baharan Mirzasoleiman , Quanquan Gu