中文
相关论文

相关论文: Contrast transfer functions help quantify neural n…

200 篇论文

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Detecting out-of-distribution (OOD) data is crucial for robust machine learning systems. Normalizing flows are flexible deep generative models that often surprisingly fail to distinguish between in- and out-of-distribution data: a flow…

机器学习 · 统计学 2020-06-16 Polina Kirichenko , Pavel Izmailov , Andrew Gordon Wilson

Foundational models, trained on vast and diverse datasets, have demonstrated remarkable capabilities in generalizing across different domains and distributions for various zero-shot tasks. Our work addresses the challenge of retaining these…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Tom Shaked , Yuval Goldman , Oran Shayer

Now published in Nature Communications DOI: https://doi.org/10.1038/s41467-026-69345-9 Large-scale visual neural datasets such as the Natural Scenes Dataset (NSD) are boosting computational neuroscience research by enabling models of the…

神经元与认知 · 定量生物学 2026-02-10 Alessandro T. Gifford , Radoslaw M. Cichy , Thomas Naselaris , Kendrick Kay

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

机器学习 · 统计学 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Out-of-distribution generalization (OODG) is a longstanding challenge for neural networks. This challenge is quite apparent in tasks with well-defined variables and rules, where explicit use of the rules could solve problems independently…

机器学习 · 计算机科学 2022-12-14 Andrew J. Nam , Mustafa Abdool , Trevor Maxfield , James L. McClelland

Recent advances in deep learning have led to breakthroughs in the development of automated skin disease classification. As we observe an increasing interest in these models in the dermatology space, it is crucial to address aspects such as…

计算机视觉与模式识别 · 计算机科学 2021-06-03 Hannah Kim , Girmaw Abebe Tadesse , Celia Cintas , Skyler Speakman , Kush Varshney

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

机器学习 · 计算机科学 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Out-of-distribution (OOD) generalization is a critical ability for deep learning models in many real-world scenarios including healthcare and autonomous vehicles. Recently, different techniques have been proposed to improve OOD…

机器学习 · 计算机科学 2023-08-24 Sobhan Hemati , Guojun Zhang , Amir Estiri , Xi Chen

This paper proposes deception as a mechanism for out-of-distribution (OOD) generalization: by learning data representations that make training data appear independent and identically distributed (iid) to an observer, we can identify stable…

机器学习 · 计算机科学 2025-09-16 Anirudha Majumdar

Object recognition and viewpoint estimation lie at the heart of visual understanding. Recent works suggest that convolutional neural networks (CNNs) fail to generalize to out-of-distribution (OOD) category-viewpoint combinations, ie.…

计算机视觉与模式识别 · 计算机科学 2021-11-18 Spandan Madan , Timothy Henry , Jamell Dozier , Helen Ho , Nishchal Bhandari , Tomotake Sasaki , Frédo Durand , Hanspeter Pfister , Xavier Boix

In real word applications, data generating process for training a machine learning model often differs from what the model encounters in the test stage. Understanding how and whether machine learning models generalize under such…

机器学习 · 统计学 2022-02-08 Abdulkadir Canatar , Blake Bordelon , Cengiz Pehlevan

Deep learning (DL) has driven broad advances across scientific and engineering domains. Despite its success, DL models often exhibit limited interpretability and generalization, which can undermine trust, especially in safety-critical…

机器学习 · 计算机科学 2026-01-14 Atefeh Termehchi , Ekram Hossain , Isaac Woungang

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

机器学习 · 计算机科学 2024-09-30 Han Wang , Yixuan Li

Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from…

机器学习 · 计算机科学 2021-03-16 Aristotelis-Angelos Papadopoulos , Mohammad Reza Rajati , Nazim Shaikh , Jiamian Wang

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

机器学习 · 计算机科学 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

With the availability of large pre-trained models, a modern workflow for building real-world machine learning solutions is to fine-tune such models on a downstream task with a relatively small domain-specific dataset. In such applications,…

机器学习 · 计算机科学 2024-05-28 Lu Tan , Huei Zhou , Yinxiang Huang , Zeming Zheng , Yujiu Yang

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

Machine learning models often fail to generalize well under distributional shifts. Understanding and overcoming these failures have led to a research field of Out-of-Distribution (OOD) generalization. Despite being extensively studied for…

Out-Of-Distribution (OOD) generalization has gained increasing attentions for machine learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation under distribution shifts. Existing graph OOD methods tend to…

机器学习 · 计算机科学 2025-05-12 Henan Sun , Xunkai Li , Lei Zhu , Junyi Han , Guang Zeng , Ronghua Li , Guoren Wang