English
Related papers

Related papers: DAAIN: Detection of Anomalous and Adversarial Inpu…

200 papers

Unsupervised Out-of-Distribution (OOD) detection consists in identifying anomalous regions in images leveraging only models trained on images of healthy anatomy. An established approach is to tokenize images and model the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Sergio Naval Marimont , Vasilis Siomos , Giacomo Tarroni

It has become routine in neuroscience studies to measure brain networks for different individuals using neuroimaging. These networks are typically expressed as adjacency matrices, with each cell containing a summary of connectivity between…

Methodology · Statistics 2022-06-30 Pritam Dey , Zhengwu Zhang , David B. Dunson

Recent studies have shown that deep learning models are vulnerable to specifically crafted adversarial inputs that are quasi-imperceptible to humans. In this letter, we propose a novel method to detect adversarial inputs, by augmenting the…

Machine Learning · Computer Science 2020-02-25 Kirthi Shankar Sivamani , Rajeev Sahay , Aly El Gamal

Collaborative inference enables resource-constrained edge devices to make inferences by uploading inputs (e.g., images) to a server (i.e., cloud) where the heavy deep learning models run. While this setup works cost-effectively for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Sumaiya Tabassum Nimi , Md Adnan Arefeen , Md Yusuf Sarwar Uddin , Yugyung Lee

We propose to utilize gradients for detecting adversarial and out-of-distribution samples. We introduce confounding labels -- labels that differ from normal labels seen during training -- in gradient generation to probe the effective…

Machine Learning · Computer Science 2022-07-05 Jinsol Lee , Mohit Prabhushankar , Ghassan AlRegib

As the use of machine learning continues to expand, the importance of ensuring its safety cannot be overstated. A key concern in this regard is the ability to identify whether a given sample is from the training distribution, or is an…

Machine Learning · Computer Science 2023-08-11 Nicola Franco , Daniel Korth , Jeanette Miriam Lorenz , Karsten Roscher , Stephan Guennemann

Deep Learning based AI systems have shown great promise in various domains such as vision, audio, autonomous systems (vehicles, drones), etc. Recent research on neural networks has shown the susceptibility of deep networks to adversarial…

Machine Learning · Computer Science 2019-11-25 Sambuddha Saha , Aashish Kumar , Pratyush Sahay , George Jose , Srinivas Kruthiventi , Harikrishna Muralidhara

Cyberthreats are a permanent concern in our modern technological world. In the recent years, sophisticated traffic analysis techniques and anomaly detection (AD) algorithms have been employed to face the more and more subversive adversarial…

Machine Learning · Computer Science 2022-05-17 Paul Irofti , Andrei Pătraşcu , Andrei Iulian Hîji

Despite the enormous performance of deepneural networks (DNNs), recent studies have shown theirvulnerability to adversarial examples (AEs), i.e., care-fully perturbed inputs designed to fool the targetedDNN. Currently, the literature is…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Anouar Kherchouche , Sid Ahmed Fezza , Wassim Hamidouche

Modern machine learning models deployed often encounter distribution shifts in real-world applications, manifesting as covariate or semantic out-of-distribution (OOD) shifts. These shifts give rise to challenges in OOD generalization and…

Machine Learning · Computer Science 2024-10-11 Haoyue Bai , Jifan Zhang , Robert Nowak

The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Galadrielle Humblot-Renaux , Sergio Escalera , Thomas B. Moeslund

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced…

Machine Learning · Computer Science 2022-02-21 Andre T. Nguyen , Fred Lu , Gary Lopez Munoz , Edward Raff , Charles Nicholas , James Holt

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Most classification and segmentation datasets assume a closed-world scenario in which predictions are expressed as distribution over a predetermined set of visual classes. However, such assumption implies unavoidable and often unnoticeable…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

Detecting test samples drawn sufficiently far away from the training distribution statistically or adversarially is a fundamental requirement for deploying a good classifier in many real-world machine learning applications. However, deep…

Machine Learning · Statistics 2018-10-30 Kimin Lee , Kibok Lee , Honglak Lee , Jinwoo Shin

We outline a detection method for adversarial inputs to deep neural networks. By viewing neural network computations as graphs upon which information flows from input space to out- put distribution, we compare the differences in graphs…

Machine Learning · Computer Science 2017-12-01 Thomas Gebhart , Paul Schrater

A significant threat to the recent, wide deployment of machine learning-based systems, including deep neural networks (DNNs), is adversarial learning attacks. We analyze possible test-time evasion-attack mechanisms and show that, in some…

Machine Learning · Computer Science 2018-06-29 David J. Miller , Yulia Wang , George Kesidis

Deep neural networks (DNNs) have been shown to be vulnerable against adversarial examples (AEs), which are maliciously designed to cause dramatic model output errors. In this work, we reveal that normal examples (NEs) are insensitive to the…

Machine Learning · Computer Science 2021-03-09 Jinyu Tian , Jiantao Zhou , Yuanman Li , Jia Duan

Anomaly detection aims to recognize samples with anomalous and unusual patterns with respect to a set of normal data. This is significant for numerous domain applications, such as industrial inspection, medical imaging, and security…

Machine Learning · Computer Science 2020-03-30 Shuo Wang , Tianle Chen , Shangyu Chen , Carsten Rudolph , Surya Nepal , Marthie Grobler

Detecting out-of-distribution (OOD) inputs is a critical safeguard for deploying machine learning models in the real world. However, most post-hoc detection methods operate on penultimate feature representations derived from global average…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Abid Hassan , Tuan Ngo , Saad Shafiq , Nenad Medvidovic