English
Related papers

Related papers: Adversaries Can Misuse Combinations of Safe Models

200 papers

Deep neural networks are facing a potential security threat from adversarial examples, inputs that look normal but cause an incorrect classification by the deep neural network. For example, the proposed threat could result in hand-written…

Computer Vision and Pattern Recognition · Computer Science 2016-10-17 Abigail Graese , Andras Rozsa , Terrance E. Boult

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Recently, the vulnerability of deep image classification models to adversarial attacks has been investigated. However, such an issue has not been thoroughly studied for image-to-image tasks that take an input image and generate an output…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Jun-Ho Choi , Huan Zhang , Jun-Hyuk Kim , Cho-Jui Hsieh , Jong-Seok Lee

Deep learning models are vulnerable to adversarial examples and make incomprehensible mistakes, which puts a threat on their real-world deployment. Combined with the idea of adversarial training, preprocessing-based defenses are popular and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Tao Bai , Jun Zhao , Lanqing Guo , Bihan Wen

Although current deep learning techniques have yielded superior performance on various computer vision tasks, yet they are still vulnerable to adversarial examples. Adversarial training and its variants have been shown to be the most…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Junhao Dong , Seyed-Mohsen Moosavi-Dezfooli , Jianhuang Lai , Xiaohua Xie

Recent work has demonstrated the plausibility of frontier AI models scheming -- knowingly and covertly pursuing an objective misaligned with its developer's intentions. Such behavior could be very hard to detect, and if present in future…

Machine Learning · Computer Science 2025-07-04 Mary Phuong , Roland S. Zimmermann , Ziyue Wang , David Lindner , Victoria Krakovna , Sarah Cogan , Allan Dafoe , Lewis Ho , Rohin Shah

Machine learning models are vulnerable to adversarial examples: minor perturbations to input samples intended to deliberately cause misclassification. While an obvious security threat, adversarial examples yield as well insights about the…

Cryptography and Security · Computer Science 2019-11-19 Kathrin Grosse , David Pfaff , Michael Thomas Smith , Michael Backes

Adversarial examples raise questions about whether neural network models are sensitive to the same visual features as humans. In this paper, we first detect adversarial examples or otherwise corrupted images based on a class-conditional…

Machine Learning · Computer Science 2020-02-19 Yao Qin , Nicholas Frosst , Sara Sabour , Colin Raffel , Garrison Cottrell , Geoffrey Hinton

Recent studies have demonstrated the vulnerability of Automatic Speech Recognition systems to adversarial examples, which can deceive these systems into misinterpreting input speech commands. While previous research has primarily focused on…

Sound · Computer Science 2025-11-21 Aravindhan G , Yuvaraj Govindarajulu , Parin Shah

The vulnerability of deep neural networks to adversarial attacks has been widely demonstrated (e.g., adversarial example attacks). Traditional attacks perform unstructured pixel-wise perturbation to fool the classifier. An alternative…

Machine Learning · Computer Science 2022-05-23 Shuo Wang , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen , Tianle Chen

Deep Neural Networks have been widely used in many fields. However, studies have shown that DNNs are easily attacked by adversarial examples, which have tiny perturbations and greatly mislead the correct judgment of DNNs. Furthermore, even…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shaowei Zhu , Wanli Lyu , Bin Li , Zhaoxia Yin , Bin Luo

As machine learning models are increasingly used in critical decision-making settings (e.g., healthcare, finance), there has been a growing emphasis on developing methods to explain model predictions. Such \textit{explanations} are used to…

Machine Learning · Computer Science 2021-06-29 Dylan Slack , Sophie Hilgard , Sameer Singh , Himabindu Lakkaraju

The rapid advancement of Generative Artificial Intelligence (GenAI) capabilities is accompanied by a concerning rise in its misuse. In particular the generation of credible misinformation in the form of images poses a significant threat to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Sina Mavali , Jonas Ricker , David Pape , Asja Fischer , Lea Schönherr

Convolutional neural networks have been used to achieve a string of successes during recent years, but their lack of interpretability remains a serious issue. Adversarial examples are designed to deliberately fool neural networks into…

Machine Learning · Computer Science 2020-04-28 Jan Philip Göpfert , André Artelt , Heiko Wersing , Barbara Hammer

Most existing machine learning classifiers are highly vulnerable to adversarial examples. An adversarial example is a sample of input data which has been modified very slightly in a way that is intended to cause a machine learning…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

One of the widely used cyber deception techniques is decoying, where defenders create fictitious machines (i.e., honeypots) to lure attackers. Honeypots are deployed to entice attackers, but their effectiveness depends on their…

Cryptography and Security · Computer Science 2021-08-26 Palvi Aggarwal , Yinuo Du , Kuldeep Singh , Cleotilde Gonzalez

Neural models of code have shown impressive results when performing tasks such as predicting method names and identifying certain kinds of bugs. We show that these models are vulnerable to adversarial examples, and introduce a novel…

Machine Learning · Computer Science 2020-10-14 Noam Yefet , Uri Alon , Eran Yahav

A growing ecosystem of large, open-source foundation models has reduced the labeled data and technical expertise necessary to apply machine learning to many new problems. Yet foundation models pose a clear dual-use risk, indiscriminately…

Machine Learning · Computer Science 2023-08-10 Peter Henderson , Eric Mitchell , Christopher D. Manning , Dan Jurafsky , Chelsea Finn

AI Agents can perform complex operations at great speed, but just like all the humans we have ever hired, their intelligence remains fallible. Miscommunications aren't noticed, systemic biases have no counter-action, and inner monologues…

Multiagent Systems · Computer Science 2026-01-22 Gopal Vijayaraghavan , Prasanth Jayachandran , Arun Murthy , Sunil Govindan , Vivek Subramanian

Time-series models typically assume untainted and legitimate streams of data. However, a self-interested adversary may have incentive to corrupt this data, thereby altering a decision maker's inference. Within the broader field of…

Cryptography and Security · Computer Science 2024-02-22 William N. Caballero , Jose Manuel Camacho , Tahir Ekin , Roi Naveiro
‹ Prev 1 3 4 5 6 7 10 Next ›