中文
相关论文

相关论文: Domain Feature Collapse: Implications for Out-of-D…

200 篇论文

Deep learning-based object reconstruction algorithms have shown remarkable improvements over classical methods. However, supervised learning based methods perform poorly when the training data and the test data have different distributions.…

计算机视觉与模式识别 · 计算机科学 2021-08-26 Brandon Leung , Siddharth Singh , Arik Horodniceanu

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

机器学习 · 计算机科学 2020-02-10 Garrett Wilson , Diane J. Cook

Despite the widespread adoption of deterministic samplers in diffusion models (DMs), their potential limitations remain largely unexplored. In this paper, we identify collapse errors, a previously unrecognized phenomenon in ODE-based…

机器学习 · 计算机科学 2025-08-25 Yi Zhang , Zhenyu Liao , Jingfeng Wu , Difan Zou

While deep neural networks have made remarkable progress in various vision tasks, their performance typically deteriorates when tested in out-of-distribution (OOD) scenarios. Many OOD methods focus on extracting domain-invariant features…

计算机视觉与模式识别 · 计算机科学 2024-09-16 Qiaowei Miao , Yawei Luo , Yi Yang

Detecting whether examples belong to a given in-distribution or are Out-Of-Distribution (OOD) requires identifying features specific to the in-distribution. In the absence of labels, these features can be learned by self-supervised…

人工智能 · 计算机科学 2022-01-19 Nima Rafiee , Rahil Gholamipoorfard , Nikolas Adaloglou , Simon Jaxy , Julius Ramakers , Markus Kollmann

Recent advances in deep learning have led to the development of accurate and efficient models for various computer vision applications such as classification, segmentation, and detection. However, learning highly accurate models relies on…

计算机视觉与模式识别 · 计算机科学 2021-07-06 Poojan Oza , Vishwanath A. Sindagi , Vibashan VS , Vishal M. Patel

Despite rapid advances in AI, safety remains the main bottleneck to deploying machine-learning systems. A critical safety component is out-of-distribution detection: given an input, decide whether it comes from the same distribution as the…

机器学习 · 计算机科学 2025-11-06 Joonas Järve , Karl Kaspar Haavel , Meelis Kull

Out-of-distribution (OOD) detection empowers the model trained on the closed image set to identify unknown data in the open world. Though many prior techniques have yielded considerable improvements in this research direction, two crucial…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Sen Pei

In recent years, machine learning models have achieved success based on the independently and identically distributed assumption. However, this assumption can be easily violated in real-world applications, leading to the Out-of-Distribution…

机器学习 · 计算机科学 2024-03-27 Yifan Hao , Yong Lin , Difan Zou , Tong Zhang

With recent advancements in artificial intelligence, its applications can be seen in every aspect of humans' daily life. From voice assistants to mobile healthcare and autonomous driving, we rely on the performance of AI methods for many…

机器学习 · 计算机科学 2022-09-28 Navid Ghassemi , Ehsan Fazl-Ersi

In this work, we train a network to simultaneously perform segmentation and pixel-wise Out-of-Distribution (OoD) detection, such that the segmentation of unknown regions of scenes can be rejected. This is made possible by leveraging an OoD…

计算机视觉与模式识别 · 计算机科学 2021-03-02 David Williams , Matthew Gadd , Daniele De Martini , Paul Newman

As deep neural networks (DNNs) become increasingly common, concerns about their robustness do as well. A longstanding problem for deployed DNNs is their behavior in the face of unfamiliar inputs; specifically, these models tend to be…

机器学习 · 计算机科学 2025-01-23 Esha Datta , Johanna Hennig , Eva Domschot , Connor Mattes , Michael R. Smith

Deep neural networks have demonstrated their ability to automatically extract meaningful features from data. However, in supervised learning, information specific to the dataset used for training, but irrelevant to the task at hand, may…

机器学习 · 计算机科学 2022-11-23 David Bertoin , Emmanuel Rachelson

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

We investigate a "learning to reject" framework to address the problem of silent failures in Domain Generalization (DG), where the test distribution differs from the training distribution. Assuming a mild distribution shift, we wish to…

机器学习 · 计算机科学 2023-06-22 Jens Müller , Stefan T. Radev , Robert Schmier , Felix Draxler , Carsten Rother , Ullrich Köthe

We study the ability of foundation models to learn representations for classification that are transferable to new, unseen classes. Recent results in the literature show that representations learned by a single classifier over many classes…

机器学习 · 计算机科学 2023-07-18 Tomer Galanti , András György , Marcus Hutter

The notion of neural collapse refers to several emergent phenomena that have been empirically observed across various canonical classification problems. During the terminal phase of training a deep neural network, the feature embedding of…

机器学习 · 计算机科学 2023-04-05 Duc Anh Nguyen , Ron Levie , Julian Lienen , Gitta Kutyniok , Eyke Hüllermeier

Out-of-distribution (OOD) detection is critical for ensuring the reliability of open-world intelligent systems. Despite the notable advancements in existing OOD detection methodologies, our study identifies a significant performance drop…

计算机视觉与模式识别 · 计算机科学 2024-02-01 Jiuqing Dong , Yongbin Gao , Heng Zhou , Jun Cen , Yifan Yao , Sook Yoon , Park Dong Sun

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

\noindent Out-of-distribution (OOD) detection is essential for the safe deployment of machine learning models. Extensive work has focused on devising various scoring functions for detecting OOD samples, while only a few studies focus on…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Yifan Ding , Xixi Liu , Jonas Unger , Gabriel Eilertsen