中文
相关论文

相关论文: Towards Robust Out-of-Distribution Generalization:…

200 篇论文

Recent advances on Out-of-Distribution (OoD) generalization reveal the robustness of deep learning models against distribution shifts. However, existing works focus on OoD algorithms, such as invariant risk minimization, domain…

机器学习 · 计算机科学 2021-09-07 Haoyue Bai , Fengwei Zhou , Lanqing Hong , Nanyang Ye , S. -H. Gary Chan , Zhenguo Li

Deep learning has achieved tremendous success with independent and identically distributed (i.i.d.) data. However, the performance of neural networks often degenerates drastically when encountering out-of-distribution (OoD) data, i.e., when…

机器学习 · 计算机科学 2022-04-01 Nanyang Ye , Kaican Li , Haoyue Bai , Runpeng Yu , Lanqing Hong , Fengwei Zhou , Zhenguo Li , Jun Zhu

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Deep neural networks (DNNs) have become the de facto learning mechanism in different domains. Their tendency to perform unreliably on out-of-distribution (OOD) inputs hinders their adoption in critical domains. Several approaches have been…

机器学习 · 计算机科学 2020-06-26 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay

While deep learning demonstrates its strong ability to handle independent and identically distributed (IID) data, it often suffers from out-of-distribution (OoD) generalization, where the test data come from another distribution (w.r.t. the…

机器学习 · 计算机科学 2020-12-18 Haoyue Bai , Rui Sun , Lanqing Hong , Fengwei Zhou , Nanyang Ye , Han-Jia Ye , S. -H. Gary Chan , Zhenguo Li

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

机器学习 · 计算机科学 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs' reliability…

机器学习 · 计算机科学 2024-04-09 Naveen Karunanayake , Ravin Gunawardena , Suranga Seneviratne , Sanjay Chawla

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

机器学习 · 计算机科学 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Graph neural networks (GNNs) have exhibited remarkable performance under the assumption that test data comes from the same distribution of training data. However, in real-world scenarios, this assumption may not always be valid.…

机器学习 · 计算机科学 2024-02-15 Kai Guo , Hongzhi Wen , Wei Jin , Yaming Guo , Jiliang Tang , Yi Chang

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

机器学习 · 计算机科学 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

机器学习 · 计算机科学 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Out-of-distribution (OOD) generalization is a challenging machine learning problem yet highly desirable in many high-stake applications. Existing methods suffer from overly pessimistic modeling with low generalization confidence. As…

机器学习 · 计算机科学 2024-06-10 Fengchun Qiao , Xi Peng

In recent years, deep neural network (DNN) compression systems have proved to be highly effective for designing source codes for many natural sources. However, like many other machine learning systems, these compressors suffer from…

机器学习 · 计算机科学 2021-10-15 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

Out-of-distribution (OOD) generalization deals with the prevalent learning scenario where test distribution shifts from training distribution. With rising application demands and inherent complexity, graph OOD problems call for specialized…

机器学习 · 计算机科学 2024-06-06 Xiner Li , Shurui Gui , Youzhi Luo , Shuiwang Ji

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

机器学习 · 计算机科学 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui
‹ 上一页 1 2 3 10 下一页 ›