English
Related papers

Related papers: Scanning Trojaned Models Using Out-of-Distribution…

200 papers

Deep neural networks are susceptible to generating overconfident yet erroneous predictions when presented with data beyond known concepts. This challenge underscores the importance of detecting out-of-distribution (OOD) samples in the open…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yiye Chen , Yunzhi Lin , Ruinian Xu , Patricio A. Vela

Backdoor attacks are an important type of adversarial threat against deep neural network classifiers, wherein test samples from one or more source classes will be (mis)classified to the attacker's target class when a backdoor pattern is…

Machine Learning · Computer Science 2023-08-08 Hang Wang , Zhen Xiang , David J. Miller , George Kesidis

Machine Learning classifiers used in Brain-Computer Interfaces make classifications based on the distribution of data they were trained on. When they need to make inferences on samples that fall outside of this distribution, they can only…

Machine Learning · Computer Science 2026-03-17 Merlijn Quincent Mulder , Matias Valdenegro-Toro , Andreea Ioana Sburlea , Ivo Pascal de Jong

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

A variety of defenses have been proposed against Trojans planted in (backdoor attacks on) deep neural network (DNN) classifiers. Backdoor-agnostic methods seek to reliably detect and/or to mitigate backdoors irrespective of the…

Cryptography and Security · Computer Science 2025-03-10 Guangmingmei Yang , Xi Li , Hang Wang , David J. Miller , George Kesidis

Out-of-distribution (OOD) detection is crucial for the deployment of machine learning models in the open world. While existing OOD detectors are effective in identifying OOD samples that deviate significantly from in-distribution (ID) data,…

Machine Learning · Computer Science 2024-12-10 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Machine-learning based intrusion detection classifiers are able to detect unknown attacks, but at the same time, they may be susceptible to evasion by obfuscation techniques. An adversary intruder which possesses a crucial knowledge about a…

Cryptography and Security · Computer Science 2019-04-16 Ivan Homoliak , Martin Teknos , Martín Ochoa , Dominik Breitenbacher , Saeid Hosseini , Petr Hanacek

Trojan backdoor is a poisoning attack against Neural Network (NN) classifiers in which adversaries try to exploit the (highly desirable) model reuse property to implant Trojans into model parameters for backdoor breaches through a poisoned…

Cryptography and Security · Computer Science 2022-09-07 Guanxiong Liu , Abdallah Khreishah , Fatima Sharadgah , Issa Khalil

Out-of-distribution (OOD) detection lies at the heart of robust artificial intelligence (AI), aiming to identify samples from novel distributions beyond the training set. Recent approaches have exploited feature representations as…

Machine Learning · Computer Science 2025-08-06 Tarhib Al Azad , Faizul Rakib Sayem , Shahana Ibrahim

Deep neural networks (DNNs) are now the de facto choice for computer vision tasks such as image classification. However, their complexity and "black box" nature often renders the systems they're deployed in vulnerable to a range of security…

Cryptography and Security · Computer Science 2021-10-19 Chandramouli Amarnath , Aishwarya H. Balwani , Kwondo Ma , Abhijit Chatterjee

Deep Neural Networks are vulnerable to Trojan (or backdoor) attacks. Reverse-engineering methods can reconstruct the trigger and thus identify affected models. Existing reverse-engineering methods only consider input space constraints,…

Cryptography and Security · Computer Science 2022-10-28 Zhenting Wang , Kai Mei , Hailun Ding , Juan Zhai , Shiqing Ma

Deep neural networks are vulnerable to Trojan attacks. Existing attacks use visible patterns (e.g., a patch or image transformations) as triggers, which are vulnerable to human inspection. In this paper, we propose stealthy and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zhenting Wang , Juan Zhai , Shiqing Ma

Out-of-Distribution (OOD) detection is critical for safe deployment; however, existing detectors often struggle to generalize across datasets of varying scales and model architectures, and some can incur high computational costs in…

Machine Learning · Computer Science 2025-04-04 Litian Liu , Yao Qin

Neural networks are powering the deployment of embedded devices and Internet of Things. Applications range from personal assistants to critical ones such as self-driving cars. It has been shown recently that models obtained from neural nets…

Cryptography and Security · Computer Science 2019-09-06 Erwan Le Merrer , Gilles Tredan

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

We target the problem of detecting Trojans or backdoors in DNNs. Such models behave normally with typical inputs but produce specific incorrect predictions for inputs poisoned with a Trojan trigger. Our approach is based on a novel…

Machine Learning · Computer Science 2020-12-07 Karan Sikka , Indranil Sur , Susmit Jha , Anirban Roy , Ajay Divakaran

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

Machine Learning · Computer Science 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Detecting out-of-distribution (OOD) samples are crucial for machine learning models deployed in open-world environments. Classifier-based scores are a standard approach for OOD detection due to their fine-grained detection capability.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Jaewoo Park , Yoon Gyo Jung , Andrew Beng Jin Teoh

As deep learning methods form a critical part in commercially important applications such as autonomous driving and medical diagnostics, it is important to reliably detect out-of-distribution (OOD) inputs while employing these algorithms.…

Machine Learning · Computer Science 2018-09-12 Apoorv Vyas , Nataraj Jammalamadaka , Xia Zhu , Dipankar Das , Bharat Kaul , Theodore L. Willke