English
Related papers

Related papers: MMCert: Provable Defense against Adversarial Attac…

200 papers

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Machine-learning models can be fooled by adversarial examples, i.e., carefully-crafted input perturbations that force models to output wrong predictions. While uncertainty quantification has been recently proposed to detect adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Emanuele Ledda , Daniele Angioni , Giorgio Piras , Giorgio Fumera , Battista Biggio , Fabio Roli

Despite the remarkable performance of video-based large language models (LLMs), their adversarial threat remains unexplored. To fill this gap, we propose the first adversarial attack tailored for video-based LLMs by crafting flow-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jinmin Li , Kuofeng Gao , Yang Bai , Jingyun Zhang , Shu-tao Xia , Yisen Wang

Evaluating the robustness of a defense model is a challenging task in adversarial robustness research. Obfuscated gradients have previously been found to exist in many defense methods and cause a false signal of robustness. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Xingjun Ma , Linxi Jiang , Hanxun Huang , Zejia Weng , James Bailey , Yu-Gang Jiang

Adversarial audio attacks can be considered as a small perturbation unperceptive to human ears that is intentionally added to the audio signal and causes a machine learning model to make mistakes. This poses a security concern about the…

Machine Learning · Computer Science 2019-11-26 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Monocular Depth Estimation (MDE) plays a vital role in applications such as autonomous driving. However, various attacks target MDE models, with physical attacks posing significant threats to system security. Traditional adversarial…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zhiyuan Cheng , Cheng Han , James Liang , Qifan Wang , Xiangyu Zhang , Dongfang Liu

Recently demonstrated physical-world adversarial attacks have exposed vulnerabilities in perception systems that pose severe risks for safety-critical applications such as autonomous driving. These attacks place adversarial artifacts in the…

Machine Learning · Computer Science 2021-06-23 Jan Hendrik Metzen , Nicole Finnie , Robin Hutmacher

Multimodal large language models (MLLMs) have revolutionized vision-language understanding but remain vulnerable to multimodal jailbreak attacks, where adversarial inputs are meticulously crafted to elicit harmful or inappropriate…

Computation and Language · Computer Science 2025-02-03 Sejoon Oh , Yiqiao Jin , Megha Sharma , Donghyun Kim , Eric Ma , Gaurav Verma , Srijan Kumar

The ability to deploy neural networks in real-world, safety-critical systems is severely limited by the presence of adversarial examples: slightly perturbed inputs that are misclassified by the network. In recent years, several techniques…

Machine Learning · Computer Science 2018-02-21 Nicholas Carlini , Guy Katz , Clark Barrett , David L. Dill

Present attack methods can make state-of-the-art classification systems based on deep neural networks misclassify every adversarially modified test example. The design of general defense strategies against a wide range of such attacks still…

Machine Learning · Computer Science 2019-08-06 Sailik Sengupta , Tathagata Chakraborti , Subbarao Kambhampati

This study investigates the vulnerability of semantic segmentation models to adversarial input perturbations, in the domain of off-road autonomous driving. Despite good performance in generic conditions, the state-of-the-art classifiers are…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Pankaj Deoli , Rohit Kumar , Axel Vierling , Karsten Berns

As machine learning (ML) techniques are being increasingly used in many applications, their vulnerability to adversarial attacks becomes well-known. Test time attacks, usually launched by adding adversarial noise to test instances, have…

Machine Learning · Computer Science 2021-10-22 Vibha Belavadi , Yan Zhou , Murat Kantarcioglu , Bhavani M. Thuraisingham

Deep learning models are known to be vulnerable to adversarial examples crafted by adding human-imperceptible perturbations on benign images. Many existing adversarial attack methods have achieved great white-box attack performance, but…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Xiaosen Wang , Jiadong Lin , Han Hu , Jingdong Wang , Kun He

There are increasing concerns about malicious attacks on autonomous vehicles. In particular, inaudible voice command attacks pose a significant threat as voice commands become available in autonomous driving systems. How to empirically…

Cryptography and Security · Computer Science 2023-06-09 Jiwei Guan , Lei Pan , Chen Wang , Shui Yu , Longxiang Gao , Xi Zheng

Adversarial machine learning is a well-studied field of research where an adversary causes predictable errors in a machine learning algorithm through precise manipulation of the input. Numerous techniques have been proposed to harden…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Pratik Vaishnavi , Kevin Eykholt , Atul Prakash , Amir Rahmati

This is Btech thesis report on detection and purification of adverserially attacked images. A deep learning model is trained on certain training examples for various tasks such as classification, regression etc. By training, weights are…

Machine Learning · Computer Science 2022-05-18 Dvij Kalaria

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

Machine Learning · Computer Science 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in cross-modal understanding, but remain vulnerable to adversarial attacks through visual inputs despite robust textual safety mechanisms. These…

Cryptography and Security · Computer Science 2025-11-21 Wei Zhao , Zhe Li , Yige Li , Jun Sun

From face recognition systems installed in phones to self-driving cars, the field of AI is witnessing rapid transformations and is being integrated into our everyday lives at an incredible pace. Any major failure in these system's…

Cryptography and Security · Computer Science 2020-12-14 Ayush Goel