中文
相关论文

相关论文: Rethinking Machine Learning Robustness via its Lin…

200 篇论文

Generative information retrieval methods retrieve documents by directly generating their identifiers. Much effort has been devoted to developing effective generative IR models. Less attention has been paid to the robustness of these models.…

信息检索 · 计算机科学 2024-12-30 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Changjiang Zhou , Maarten de Rijke , Xueqi Cheng

In the rapidly evolving field of artificial intelligence, machine learning emerges as a key technology characterized by its vast potential and inherent risks. The stability and reliability of these models are important, as they are frequent…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Haibo Zhang , Zhihua Yao , Kouichi Sakurai , Takeshi Saitoh

A major challenge in machine learning is resilience to out-of-distribution data, that is data that exists outside of the distribution of a model's training data. Training is often performed using limited, carefully curated datasets and so…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Christopher J. Holder , Majid Khonji , Jorge Dias , Muhammad Shafique

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Deep neural networks (DNNs) have become the de facto learning mechanism in different domains. Their tendency to perform unreliably on out-of-distribution (OOD) inputs hinders their adoption in critical domains. Several approaches have been…

机器学习 · 计算机科学 2020-06-26 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

机器学习 · 统计学 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Deep neural networks often face generalization problems to handle out-of-distribution (OOD) data, and there remains a notable theoretical gap between the contributing factors and their respective impacts. Literature evidence from…

机器学习 · 计算机科学 2024-04-24 Songming Zhang , Yuxiao Luo , Qizhou Wang , Haoang Chi , Xiaofeng Chen , Bo Han , Jinyan Li

The deployment of machine learning solutions in real-world scenarios often involves addressing the challenge of out-of-distribution (OOD) detection. While significant efforts have been devoted to OOD detection in classical supervised…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Loïc Le Bescond , Maria Vakalopoulou , Stergios Christodoulidis , Fabrice André , Hugues Talbot

Constructing a robust model that can effectively generalize to test samples under distribution shifts remains a significant challenge in the field of medical imaging. The foundational models for vision and language, pre-trained on extensive…

The robustness of neural networks is challenged by adversarial examples that contain almost imperceptible perturbations to inputs, which mislead a classifier to incorrect outputs in high confidence. Limited by the extreme difficulty in…

机器学习 · 计算机科学 2020-10-20 Honglin Li , Yifei Fan , Frieder Ganz , Anthony Yezzi , Payam Barnaghi

Graph machine learning (GML) has been successfully applied across a wide range of tasks. Nonetheless, GML faces significant challenges in generalizing over out-of-distribution (OOD) data, which raises concerns about its wider applicability.…

机器学习 · 计算机科学 2024-10-17 Jing Ma

Machine learning algorithms often encounter different or "out-of-distribution" (OOD) data at deployment time, and OOD detection is frequently employed to detect these examples. While it works reasonably well in practice, existing…

机器学习 · 计算机科学 2025-01-16 Konstantin Garov , Kamalika Chaudhuri

Out-of-distribution (OOD) detection and lossless compression constitute two problems that can be solved by the training of probabilistic models on a first dataset with subsequent likelihood evaluation on a second dataset, where data…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Mingtian Zhang , Andi Zhang , Steven McDonagh

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

机器学习 · 计算机科学 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Adversarial examples are a type of attack on machine learning (ML) systems which cause misclassification of inputs. Achieving robustness against adversarial examples is crucial to apply ML in the real world. While most prior work on…

密码学与安全 · 计算机科学 2020-07-16 Nico Döttling , Kathrin Grosse , Michael Backes , Ian Molloy

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

机器学习 · 计算机科学 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

机器学习 · 统计学 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

Detecting and understanding out-of-distribution (OOD) samples is crucial in machine learning (ML) to ensure reliable model performance. Current OOD studies primarily focus on extrapolatory (outside) OOD, neglecting potential cases of…

机器学习 · 计算机科学 2025-09-03 Teddy Lazebnik

Out-of-distribution (OOD) testing is increasingly popular for evaluating a machine learning system's ability to generalize beyond the biases of a training set. OOD benchmarks are designed to present a different joint distribution of data…

计算机视觉与模式识别 · 计算机科学 2020-05-20 Damien Teney , Kushal Kafle , Robik Shrestha , Ehsan Abbasnejad , Christopher Kanan , Anton van den Hengel

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

机器学习 · 计算机科学 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo