中文
相关论文

相关论文: Adversarial Evaluation of Multimodal Models under …

200 篇论文

As deep learning models are increasingly deployed in safety-critical applications, evaluating their vulnerabilities to adversarial perturbations is essential for ensuring their reliability and trustworthiness. Over the past decade, a large…

机器学习 · 计算机科学 2025-03-12 Yong Xie , Weijie Zheng , Hanxun Huang , Guangnan Ye , Xingjun Ma

Multi-modal embeddings encode texts, images, thermal images, sounds, and videos into a single embedding space, aligning representations across different modalities (e.g., associate an image of a dog with a barking sound). In this paper, we…

密码学与安全 · 计算机科学 2025-08-26 Tingwei Zhang , Rishi Jha , Eugene Bagdasaryan , Vitaly Shmatikov

Deep neural networks have been shown to exhibit an intriguing vulnerability to adversarial input images corrupted with imperceptible perturbations. However, the majority of adversarial attacks assume global, fine-grained control over the…

计算机视觉与模式识别 · 计算机科学 2019-08-19 Ameya Joshi , Amitangshu Mukherjee , Soumik Sarkar , Chinmay Hegde

Facially manipulated images and videos or DeepFakes can be used maliciously to fuel misinformation or defame individuals. Therefore, detecting DeepFakes is crucial to increase the credibility of social media platforms and other media…

计算机视觉与模式识别 · 计算机科学 2020-11-20 Paarth Neekhara , Brian Dolhansky , Joanna Bitton , Cristian Canton Ferrer

Current adversarial attack algorithms, where an adversary changes a text to fool a victim model, have been repeatedly shown to be effective against text classifiers. These attacks, however, generally assume that the victim model is…

计算与语言 · 计算机科学 2024-01-17 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Machine learning models are now widely deployed in real-world applications. However, the existence of adversarial examples has been long considered a real threat to such models. While numerous defenses aiming to improve the robustness have…

机器学习 · 计算机科学 2021-03-10 Sahar Abdelnabi , Mario Fritz

Adversarial attacks that generate small L_p-norm perturbations to mislead classifiers have limited success in black-box settings and with unseen classifiers. These attacks are also not robust to defenses that use denoising filters and to…

计算机视觉与模式识别 · 计算机科学 2020-04-14 Ali Shahin Shamsabadi , Ricardo Sanchez-Matilla , Andrea Cavallaro

Traditional white-box methods for creating adversarial perturbations against LLMs typically rely only on gradient computation from the targeted model, ignoring the internal mechanisms responsible for attack success or failure. Conversely,…

机器学习 · 计算机科学 2025-05-07 Thomas Winninger , Boussad Addad , Katarzyna Kapusta

Multimodal large language models (MLLMs) comprise of both visual and textual modalities to process vision language tasks. However, MLLMs are vulnerable to security-related issues, such as jailbreak attacks that alter the model's input to…

密码学与安全 · 计算机科学 2025-10-27 Xingwei Zhong , Kar Wai Fok , Vrizlynn L. L. Thing

Adversarial attacks and defenses have gained increasing interest on computer vision systems in recent years, but as of today, most investigations are limited to images. However, many artificial intelligence models actually handle…

计算机视觉与模式识别 · 计算机科学 2023-05-03 Timothée Fronteau , Arnaud Paran , Aymen Shabou

In the past few years, there has been a surge of interest in multi-modal problems, from image captioning to visual question answering and beyond. In this paper, we focus on hate speech detection in multi-modal memes wherein memes pose an…

计算机视觉与模式识别 · 计算机科学 2021-01-01 Abhishek Das , Japsimar Singh Wahi , Siyao Li

Video-based multimodal large language models (V-MLLMs) have shown vulnerability to adversarial examples in video-text multimodal tasks. However, the transferability of adversarial videos to unseen models - a common and practical real-world…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Linhao Huang , Xue Jiang , Zhiqiang Wang , Wentao Mo , Xi Xiao , Yong-Jie Yin , Bo Han , Feng Zheng

Adversarial attacks on deep-learning models pose a serious threat to their reliability and security. Existing defense mechanisms are narrow addressing a specific type of attack or being vulnerable to sophisticated attacks. We propose a new…

机器学习 · 计算机科学 2023-06-22 Mouna Rabhi , Roberto Di Pietro

Deep neural networks are vulnerable to adversarial attacks. White-box adversarial attacks can fool neural networks with small adversarial perturbations, especially for large size images. However, keeping successful adversarial perturbations…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Yongwei Wang , Mingquan Feng , Rabab Ward , Z. Jane Wang , Lanjun Wang

Many machine learning algorithms are vulnerable to almost imperceptible perturbations of their inputs. So far it was unclear how much risk adversarial perturbations carry for the safety of real-world machine learning applications because…

机器学习 · 统计学 2018-02-19 Wieland Brendel , Jonas Rauber , Matthias Bethge

Adversarial ranking attacks have gained increasing attention due to their success in probing vulnerabilities, and, hence, enhancing the robustness, of neural ranking models. Conventional attack methods employ perturbations at a single…

信息检索 · 计算机科学 2024-04-12 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

State-of-the-art image and text classification models, such as Convolutional Neural Networks and Transformers, have long been able to classify their respective unimodal reasoning satisfactorily with accuracy close to or exceeding human…

机器学习 · 计算机科学 2022-12-20 Weijun Jin , Lance Wilhelm

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

机器学习 · 计算机科学 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

人工智能 · 计算机科学 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Intelligent machine learning approaches are finding active use for event detection and identification that allow real-time situational awareness. Yet, such machine learning algorithms have been shown to be susceptible to adversarial attacks…

系统与控制 · 电气工程与系统科学 2024-04-23 Obai Bahwal , Oliver Kosut , Lalitha Sankar