中文
相关论文

相关论文: Understanding and Improving Feature Learning for O…

200 篇论文

Out-of-distribution (OOD) detection is crucial for building reliable machine learning models. Although negative prompt tuning has enhanced the OOD detection capabilities of vision-language models, these tuned models often suffer from…

计算机视觉与模式识别 · 计算机科学 2025-07-30 Wenjie Zhu , Yabin Zhang , Xin Jin , Wenjun Zeng , Lei Zhang

Feature shaping refers to a family of methods that exhibit state-of-the-art performance for out-of-distribution (OOD) detection. These approaches manipulate the feature representation, typically from the penultimate layer of a pre-trained…

计算机视觉与模式识别 · 计算机科学 2024-02-02 Qinyu Zhao , Ming Xu , Kartik Gupta , Akshay Asthana , Liang Zheng , Stephen Gould

Empirical risk minimization (ERM) is not robust to changes in the distribution of data. When the distribution of test data is different from that of training data, the problem is known as out-of-distribution generalization. Recently, two…

计算机视觉与模式识别 · 计算机科学 2025-01-16 Shijian Xu

Federated Learning is an emerging privacy-preserving distributed machine learning approach to building a shared model by performing distributed training locally on participating devices (clients) and aggregating the local models into a…

机器学习 · 计算机科学 2021-04-15 Sreya Francis , Irene Tenison , Irina Rish

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

机器学习 · 计算机科学 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Deep learning models often rely only on a small set of features even when there is a rich set of predictive signals in the training data. This makes models brittle and sensitive to distribution shifts. In this work, we first examine vision…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Armand Mihai Nicolicioiu , Andrei Liviu Nicolicioiu , Bogdan Alexe , Damien Teney

As deep neural networks become adopted in high-stakes domains, it is crucial to identify when inference inputs are Out-of-Distribution (OOD) so that users can be alerted of likely drops in performance and calibration despite high confidence…

计算机视觉与模式识别 · 计算机科学 2025-04-16 Will LeVine , Benjamin Pikus , Jacob Phillips , Berk Norman , Fernando Amat Gil , Sean Hendryx

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

A majority of recent work in AI assesses models' generalization capabilities through the lens of performance on out-of-distribution (OOD) datasets. Despite their practicality, such evaluations build upon a strong assumption: that OOD…

计算与语言 · 计算机科学 2025-08-27 Michal Štefánik , Timothee Mickus , Marek Kadlčík , Michal Spiegel , Josef Kuchař

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

机器学习 · 计算机科学 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

Empirical studies suggest that machine learning models often rely on features, such as the background, that may be spuriously correlated with the label only during training time, resulting in poor accuracy during test-time. In this work, we…

机器学习 · 计算机科学 2024-09-10 Vaishnavh Nagarajan , Anders Andreassen , Behnam Neyshabur

Modern foundation models exhibit remarkable out-of-distribution (OOD) generalization, solving tasks far beyond the support of their training data. However, the theoretical principles underpinning this phenomenon remain elusive. This paper…

机器学习 · 统计学 2025-05-29 Jiawei Ge , Amanda Wang , Shange Tang , Chi Jin

Generalizing to out-of-distribution data while being aware of model fairness is a significant and challenging problem in meta-learning. The goal of this problem is to find a set of fairness-aware invariant parameters of classifier that is…

机器学习 · 计算机科学 2024-11-05 Kai Jiang , Chen Zhao , Haoliang Wang , Feng Chen

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

机器学习 · 计算机科学 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

机器学习 · 计算机科学 2023-11-07 Reza Averly , Wei-Lun Chao

This paper proposes deception as a mechanism for out-of-distribution (OOD) generalization: by learning data representations that make training data appear independent and identically distributed (iid) to an observer, we can identify stable…

机器学习 · 计算机科学 2025-09-16 Anirudha Majumdar

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

机器学习 · 计算机科学 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

The crux of effective out-of-distribution (OOD) detection lies in acquiring a robust in-distribution (ID) representation, distinct from OOD samples. While previous methods predominantly leaned on recognition-based techniques for this…

计算机视觉与模式识别 · 计算机科学 2024-01-08 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

机器学习 · 计算机科学 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Neural networks are notorious for being overconfident predictors, posing a significant challenge to their safe deployment in real-world applications. While feature normalization has garnered considerable attention within the deep learning…

计算机视觉与模式识别 · 计算机科学 2023-06-09 Sudarshan Regmi , Bibek Panthi , Sakar Dotel , Prashnna K. Gyawali , Danail Stoyanov , Binod Bhattarai