English
Related papers

Related papers: Gradient-Based Adversarial and Out-of-Distribution…

200 papers

Traditional adversarial attacks rely upon the perturbations generated by gradients from the network which are generally safeguarded by gradient guided search to provide an adversarial counterpart to the network. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Ujjwal Upadhyay , Prerana Mukherjee

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

Machine Learning · Statistics 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

The identification of out-of-distribution content is critical to the successful implementation of neural networks. Watchdog techniques have been developed to support the detection of these inputs, but the performance can be limited by the…

Machine Learning · Computer Science 2023-05-03 Glauco Amigo , Justin M. Bui , Charles Baylis , Robert J. Marks

Detecting test samples drawn sufficiently far away from the training distribution statistically or adversarially is a fundamental requirement for deploying a good classifier in many real-world machine learning applications. However, deep…

Machine Learning · Statistics 2018-10-30 Kimin Lee , Kibok Lee , Honglak Lee , Jinwoo Shin

Identifying anomalies refers to detecting samples that do not resemble the training data distribution. Many generative models have been used to find anomalies, and among them, generative adversarial network (GAN)-based approaches are…

Machine Learning · Computer Science 2022-01-03 Laya Rafiee Sevyeri , Thomas Fevens

A crucial requirement for machine learning algorithms is not only to perform well, but also to show robustness and adaptability when encountering novel scenarios. One way to achieve these characteristics is to endow the deep learning models…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Eduardo Aguilar , Bogdan Raducanu , Petia Radeva

Estimating the test performance of a model, possibly under distribution shift, without having access to the ground-truth labels is a challenging, yet very important problem for the safe deployment of machine learning algorithms in the wild.…

Machine Learning · Computer Science 2025-05-13 Renchunzi Xie , Ambroise Odonnat , Vasilii Feofanov , Ievgen Redko , Jianfeng Zhang , Bo An

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

Neural networks are known to be susceptible to adversarial samples: small variations of natural examples crafted to deliberately mislead the models. While they can be easily generated using gradient-based techniques in digital and physical…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Haotian Xue , Alexandre Araujo , Bin Hu , Yongxin Chen

Though deep neural networks have achieved state-of-the-art performance in visual classification, recent studies have shown that they are all vulnerable to the attack of adversarial examples. Small and often imperceptible perturbations to…

Machine Learning · Computer Science 2018-06-05 Pinlong Zhao , Zhouyu Fu , Ou wu , Qinghua Hu , Jun Wang

Most existing deep learning models are trained based on the closed-world assumption, where the test data is assumed to be drawn i.i.d. from the same distribution as the training data, known as in-distribution (ID). However, when models are…

Machine Learning · Computer Science 2022-11-09 Yixin Liu , Kaize Ding , Huan Liu , Shirui Pan

To classify in-distribution samples, deep neural networks explore strongly label-related information and discard weakly label-related information according to the information bottleneck. Out-of-distribution samples drawn from distributions…

Machine Learning · Computer Science 2023-08-29 Zhilin Zhao , Longbing Cao

A core data-centric learning challenge is the identification of training samples that are detrimental to model performance. Influence functions serve as a prominent tool for this task and offer a robust framework for assessing training data…

Machine Learning · Computer Science 2025-11-04 Anshuman Chhabra , Bo Li , Jian Chen , Prasant Mohapatra , Hongfu Liu

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Detecting data points deviating from the training distribution is pivotal for ensuring reliable machine learning. Extensive research has been dedicated to the challenge, spanning classical anomaly detection techniques to contemporary…

Machine Learning · Computer Science 2024-05-30 Xuefeng Du , Yiyou Sun , Yixuan Li

The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Galadrielle Humblot-Renaux , Sergio Escalera , Thomas B. Moeslund

Detecting unusual patterns in graph data is a crucial task in data mining. However, existing methods face challenges in consistently achieving satisfactory performance and often lack interpretability, which hinders our understanding of…

Machine Learning · Computer Science 2024-06-28 Yifei Yang , Peng Wang , Xiaofan He , Dongmian Zou

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the…

Machine Learning · Computer Science 2019-10-24 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay , Taylor Denounden , Sachin Vernekar , Buu Phan

Detecting out-of-distribution (OOD) examples is crucial to guarantee the reliability and safety of deep neural networks in real-world settings. In this paper, we offer an innovative perspective on quantifying the disparities between…

Machine Learning · Computer Science 2024-01-17 Jinggang Chen , Junjie Li , Xiaoyang Qu , Jianzong Wang , Jiguang Wan , Jing Xiao

The integrity of training data, even when annotated by experts, is far from guaranteed, especially for non-IID datasets comprising both in- and out-of-distribution samples. In an ideal scenario, the majority of samples would be…

Machine Learning · Computer Science 2023-11-07 Zhilin Zhao , Longbing Cao , Chang-Dong Wang