English
Related papers

Related papers: SFP: Spurious Feature-targeted Pruning for Out-of-…

200 papers

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

Machine Learning · Computer Science 2024-06-05 Litian Liu , Yao Qin

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Sparsification-based pruning has been an important category in model compression. Existing methods commonly set sparsity-inducing penalty terms to suppress the importance of dropped weights, which is regarded as the suppressed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shengji Tang , Weihao Lin , Hancheng Ye , Peng Ye , Chong Yu , Baopu Li , Tao Chen

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

We introduce DiMPLe (Disentangled Multi-Modal Prompt Learning), a novel approach to disentangle invariant and spurious features across vision and language modalities in multi-modal learning. Spurious correlations in visual data often hinder…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Umaima Rahman , Mohammad Yaqub , Dwarikanath Mahapatra

In response to recent data regulation requirements, machine unlearning (MU) has emerged as a critical process to remove the influence of specific examples from a given model. Although exact unlearning can be achieved through complete model…

Machine Learning · Computer Science 2024-01-30 Jinghan Jia , Jiancheng Liu , Parikshit Ram , Yuguang Yao , Gaowen Liu , Yang Liu , Pranay Sharma , Sijia Liu

To avoid failures on out-of-distribution data, recent works have sought to extract features that have an invariant or stable relationship with the label across domains, discarding "spurious" or unstable features whose relationship with the…

Out-of-distribution (OOD) generalization is critical for machine learning models deployed in the real world. However, achieving this can be fundamentally challenging, as it requires the ability to learn invariant features across different…

Machine Learning · Computer Science 2024-11-05 Haoyue Bai , Yifei Ming , Julian Katz-Samuels , Yixuan Li

Deep neural networks can be unreliable in the real world especially when they heavily use {\it spurious} features for their predictions. Focusing on image classifications, we define {\it core features} as the set of visual features that are…

Machine Learning · Computer Science 2022-03-29 Sahil Singla , Soheil Feizi

Structured pruning is an effective approach for compressing large pre-trained neural networks without significantly affecting their performance. However, most current structured pruning methods do not provide any performance guarantees, and…

Machine Learning · Computer Science 2023-02-14 Marwa El Halabi , Suraj Srinivas , Simon Lacoste-Julien

Federated Learning (FL) enables collaborative model training across large-scale distributed service nodes while preserving data privacy, making it a cornerstone of intelligent service systems in edge-cloud environments. However, in…

Machine Learning · Computer Science 2026-02-03 Zhiwei Ling , Hailiang Zhao , Chao Zhang , Xiang Ao , Ziqi Wang , Cheng Zhang , Zhen Qin , Xinkui Zhao , Kingsum Chow , Yuanqing Wu , MengChu Zhou

The advent of sparsity inducing techniques in neural networks has been of a great help in the last few years. Indeed, those methods allowed to find lighter and faster networks, able to perform more efficiently in resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Nathan Hubens , Victor Delvigne , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

Predictive pattern mining is an approach used to construct prediction models when the input is represented by structured data, such as sets, graphs, and sequences. The main idea behind predictive pattern mining is to build a prediction…

Machine Learning · Statistics 2023-06-26 Takumi Yoshida , Hiroyuki Hanada , Kazuya Nakagawa , Kouichi Taji , Koji Tsuda , Ichiro Takeuchi

Out-of-Distribution (OOD) detection is a cornerstone for the safe deployment of AI systems in the open world. However, existing methods treat OOD detection as a binary classification problem, a cognitive flattening that fails to distinguish…

Machine Learning · Statistics 2025-10-16 Ningkang Peng , Yuzhe Mao , Yuhao Zhang , Linjin Qian , Qianfeng Yu , Yanhui Gu , Yi Chen , Li Kong

For a responsible and safe deployment of diffusion models in various domains, regulating the generated outputs from these models is desirable because such models could generate undesired, violent, and obscene outputs. To tackle this…

Machine Learning · Computer Science 2026-03-24 Subhodip Panda , Varun M S , Shreyans Jain , Sarthak Kumar Maharana , Prathosh A. P

We consider the challenging problem of learning Signed Distance Functions (SDF) from sparse and noisy 3D point clouds. In contrast to recent methods that depend on smoothness priors, our method, rooted in a distributionally robust…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Amine Ouasfi , Shubhendu Jena , Eric Marchand , Adnane Boukhayma

Feature selection is fundamental to robust data-centric AI, but most existing methods optimize predictive performance under a single data distribution. This often selects spurious features that fail under distribution shifts. Motivated by…

Machine Learning · Computer Science 2026-03-24 Arun Vignesh Malarkkan , Xinyuan Wang , Kunpeng Liu , Denghui Zhang , Yanjie Fu

Supervised fine-tuning (SFT) has become a crucial step for aligning pretrained large language models (LLMs) using supervised datasets of input-output pairs. However, despite being supervised, SFT is inherently limited by its generative…

Computation and Language · Computer Science 2025-07-25 Siqi Guo , Ilgee Hong , Vicente Balmaseda , Changlong Yu , Liang Qiu , Xin Liu , Haoming Jiang , Tuo Zhao , Tianbao Yang