中文
相关论文

相关论文: Adversarial Attacks in Multimodal Systems: A Pract…

200 篇论文

Recent advances in instruction tuning have led to the development of State-of-the-Art Large Multimodal Models (LMMs). Given the novelty of these models, the impact of visual adversarial attacks on LMMs has not been thoroughly examined. We…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Xuanming Cui , Alejandro Aparcedo , Young Kyun Jang , Ser-Nam Lim

Deep learning solutions are instrumental in cybersecurity, harnessing their ability to analyze vast datasets, identify complex patterns, and detect anomalies. However, malevolent actors can exploit these capabilities to orchestrate…

密码学与安全 · 计算机科学 2024-12-19 Shalini Saini , Anitha Chennamaneni , Babatunde Sawyerr

Adversarial Machine Learning (AML) addresses vulnerabilities in AI systems where adversaries manipulate inputs or training data to degrade performance. This article provides a comprehensive analysis of evasion and poisoning attacks,…

密码学与安全 · 计算机科学 2025-02-11 Pranav K Jha

Textual adversarial attacking has received wide and increasing attention in recent years. Various attack models have been proposed, which are enormously distinct and implemented with different programming frameworks and settings. These…

计算与语言 · 计算机科学 2021-09-27 Guoyang Zeng , Fanchao Qi , Qianrui Zhou , Tingji Zhang , Zixian Ma , Bairu Hou , Yuan Zang , Zhiyuan Liu , Maosong Sun

Integrating adversarial machine learning with Question Answering (QA) systems has emerged as a critical area for understanding the vulnerabilities and robustness of these systems. This article aims to comprehensively review adversarial…

计算与语言 · 计算机科学 2024-08-13 Gulsum Yigit , Mehmet Fatih Amasyali

Machine Learning (ML) has been instrumental in enabling joint transceiver optimization by merging all physical layer blocks of the end-to-end wireless communication systems. Although there have been a number of adversarial attacks on…

密码学与安全 · 计算机科学 2024-11-22 Jung-Woo Chang , Ke Sun , Nasimeh Heydaribeni , Seira Hidano , Xinyu Zhang , Farinaz Koushanfar

Multimodal machine learning models that combine visual and textual data are increasingly being deployed in critical applications, raising significant safety and security concerns due to their vulnerability to adversarial attacks. This paper…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Maisha Binte Rashid , Pablo Rivas

Although multimodal large language models (MLLMs) are increasingly deployed in real-world applications, their instruction-following behavior leaves them vulnerable to prompt injection attacks. Existing prompt injection methods predominantly…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Meiwen Ding , Song Xia , Chenqi Kong , Xudong Jiang

In recent years, Deep Neural Network models have been developed in different fields, where they have brought many advances. However, they have also started to be used in tasks where risk is critical. A misdiagnosis of these models can lead…

机器学习 · 计算机科学 2024-02-13 Xabier Echeberria-Barrio , Amaia Gil-Lerchundi , Jon Egana-Zubia , Raul Orduna-Urrutia

With recent breakthroughs in deep neural networks, numerous tasks within autonomous driving have exhibited remarkable performance. However, deep learning models are susceptible to adversarial attacks, presenting significant security risks…

机器学习 · 计算机科学 2024-09-13 Lu Wang , Tianyuan Zhang , Yikai Han , Muyang Fang , Ting Jin , Jiaqi Kang

Machine learning (ML) algorithms are increasingly being integrated into embedded and IoT systems that surround us, and they are vulnerable to adversarial attacks. The deployment of these ML algorithms on resource-limited embedded platforms…

机器学习 · 计算机科学 2023-03-07 Christian Westbrook , Sudeep Pasricha

Research in ML4VIS investigates how to use machine learning (ML) techniques to generate visualizations, and the field is rapidly growing with high societal impact. However, as with any computational pipeline that employs ML processes,…

密码学与安全 · 计算机科学 2024-09-25 Takanori Fujiwara , Kostiantyn Kucher , Junpeng Wang , Rafael M. Martins , Andreas Kerren , Anders Ynnerman

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

人工智能 · 计算机科学 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Recent work has highlighted the vulnerability of many deep machine learning models to adversarial examples. It attracts increasing attention to adversarial attacks, which can be used to evaluate the security and robustness of models before…

机器学习 · 计算机科学 2020-06-22 Xuli Sun , Shiliang Sun

Neural networks build the foundation of several intelligent systems, which, however, are known to be easily fooled by adversarial examples. Recent advances made these attacks possible even in air-gapped scenarios, where the autonomous…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Ana Răduţoiu , Jan-Philipp Schulze , Philip Sperl , Konstantin Böttinger

Adversarial machine learning (AML) studies the adversarial phenomenon of machine learning, which may make inconsistent or unexpected predictions with humans. Some paradigms have been recently developed to explore this adversarial phenomenon…

机器学习 · 计算机科学 2024-01-05 Baoyuan Wu , Zihao Zhu , Li Liu , Qingshan Liu , Zhaofeng He , Siwei Lyu

Adversarial examples are inputs to machine learning models that an attacker has intentionally designed to confuse the model into making a mistake. Such examples pose a serious threat to the applicability of machine-learning-based systems,…

机器学习 · 计算机科学 2023-10-18 Peiyu Xiong , Michael Tegegn , Jaskeerat Singh Sarin , Shubhraneel Pal , Julia Rubin

Machine learning algorithms are used to construct a mathematical model for a system based on training data. Such a model is capable of making highly accurate predictions without being explicitly programmed to do so. These techniques have a…

密码学与安全 · 计算机科学 2022-02-22 Cato Pauling , Michael Gimson , Muhammed Qaid , Ahmad Kida , Basel Halak

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…