中文
相关论文

相关论文: SFP: Spurious Feature-targeted Pruning for Out-of-…

200 篇论文

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

机器学习 · 计算机科学 2023-11-07 Reza Averly , Wei-Lun Chao

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

机器学习 · 计算机科学 2024-06-05 Litian Liu , Yao Qin

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Haoyue Bai

Sparsification-based pruning has been an important category in model compression. Existing methods commonly set sparsity-inducing penalty terms to suppress the importance of dropped weights, which is regarded as the suppressed…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Shengji Tang , Weihao Lin , Hancheng Ye , Peng Ye , Chong Yu , Baopu Li , Tao Chen

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

We introduce DiMPLe (Disentangled Multi-Modal Prompt Learning), a novel approach to disentangle invariant and spurious features across vision and language modalities in multi-modal learning. Spurious correlations in visual data often hinder…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Umaima Rahman , Mohammad Yaqub , Dwarikanath Mahapatra

In response to recent data regulation requirements, machine unlearning (MU) has emerged as a critical process to remove the influence of specific examples from a given model. Although exact unlearning can be achieved through complete model…

机器学习 · 计算机科学 2024-01-30 Jinghan Jia , Jiancheng Liu , Parikshit Ram , Yuguang Yao , Gaowen Liu , Yang Liu , Pranay Sharma , Sijia Liu

To avoid failures on out-of-distribution data, recent works have sought to extract features that have an invariant or stable relationship with the label across domains, discarding "spurious" or unstable features whose relationship with the…

Out-of-distribution (OOD) generalization is critical for machine learning models deployed in the real world. However, achieving this can be fundamentally challenging, as it requires the ability to learn invariant features across different…

机器学习 · 计算机科学 2024-11-05 Haoyue Bai , Yifei Ming , Julian Katz-Samuels , Yixuan Li

Deep neural networks can be unreliable in the real world especially when they heavily use {\it spurious} features for their predictions. Focusing on image classifications, we define {\it core features} as the set of visual features that are…

机器学习 · 计算机科学 2022-03-29 Sahil Singla , Soheil Feizi

Structured pruning is an effective approach for compressing large pre-trained neural networks without significantly affecting their performance. However, most current structured pruning methods do not provide any performance guarantees, and…

机器学习 · 计算机科学 2023-02-14 Marwa El Halabi , Suraj Srinivas , Simon Lacoste-Julien

Federated Learning (FL) enables collaborative model training across large-scale distributed service nodes while preserving data privacy, making it a cornerstone of intelligent service systems in edge-cloud environments. However, in…

The advent of sparsity inducing techniques in neural networks has been of a great help in the last few years. Indeed, those methods allowed to find lighter and faster networks, able to perform more efficiently in resource-constrained…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Nathan Hubens , Victor Delvigne , Matei Mancas , Bernard Gosselin , Marius Preda , Titus Zaharia

Predictive pattern mining is an approach used to construct prediction models when the input is represented by structured data, such as sets, graphs, and sequences. The main idea behind predictive pattern mining is to build a prediction…

机器学习 · 统计学 2023-06-26 Takumi Yoshida , Hiroyuki Hanada , Kazuya Nakagawa , Kouichi Taji , Koji Tsuda , Ichiro Takeuchi

Out-of-Distribution (OOD) detection is a cornerstone for the safe deployment of AI systems in the open world. However, existing methods treat OOD detection as a binary classification problem, a cognitive flattening that fails to distinguish…

机器学习 · 统计学 2025-10-16 Ningkang Peng , Yuzhe Mao , Yuhao Zhang , Linjin Qian , Qianfeng Yu , Yanhui Gu , Yi Chen , Li Kong

For a responsible and safe deployment of diffusion models in various domains, regulating the generated outputs from these models is desirable because such models could generate undesired, violent, and obscene outputs. To tackle this…

机器学习 · 计算机科学 2026-03-24 Subhodip Panda , Varun M S , Shreyans Jain , Sarthak Kumar Maharana , Prathosh A. P

We consider the challenging problem of learning Signed Distance Functions (SDF) from sparse and noisy 3D point clouds. In contrast to recent methods that depend on smoothness priors, our method, rooted in a distributionally robust…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Amine Ouasfi , Shubhendu Jena , Eric Marchand , Adnane Boukhayma

Feature selection is fundamental to robust data-centric AI, but most existing methods optimize predictive performance under a single data distribution. This often selects spurious features that fail under distribution shifts. Motivated by…

机器学习 · 计算机科学 2026-03-24 Arun Vignesh Malarkkan , Xinyuan Wang , Kunpeng Liu , Denghui Zhang , Yanjie Fu

Supervised fine-tuning (SFT) has become a crucial step for aligning pretrained large language models (LLMs) using supervised datasets of input-output pairs. However, despite being supervised, SFT is inherently limited by its generative…

计算与语言 · 计算机科学 2025-07-25 Siqi Guo , Ilgee Hong , Vicente Balmaseda , Changlong Yu , Liang Qiu , Xin Liu , Haoming Jiang , Tuo Zhao , Tianbao Yang