中文
相关论文

相关论文: Adversarial Evaluation of Multimodal Models under …

200 篇论文

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

人工智能 · 计算机科学 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang

Deep neural networks have been proved that they are vulnerable to adversarial examples, which are generated by adding human-imperceptible perturbations to images. To defend these adversarial examples, various detection based methods have…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Kejiang Chen , Yuefeng Chen , Hang Zhou , Chuan Qin , Xiaofeng Mao , Weiming Zhang , Nenghai Yu

Multimodal large language models (MLLMs) have become integral to a wide range of real-world applications by jointly reasoning over text and visual inputs. However, despite recent advances in safety alignment, MLLMs remain vulnerable to…

密码学与安全 · 计算机科学 2026-03-10 Xinkai Wang , Beibei Li , Zerui Shao , Ao Liu , Guangquan Xu , Shouling Ji

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

密码学与安全 · 计算机科学 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

Neural networks are known to be vulnerable to carefully crafted adversarial examples, and these malicious samples often transfer, i.e., they remain adversarial even against other models. Although great efforts have been delved into the…

图像与视频处理 · 电气工程与系统科学 2019-11-27 Yantao Lu , Yunhan Jia , Jianyu Wang , Bai Li , Weiheng Chai , Lawrence Carin , Senem Velipasalar

Adversarial machine learning is an emerging area showing the vulnerability of deep learning models. Exploring attack methods to challenge state of the art artificial intelligence (A.I.) models is an area of critical concern. The reliability…

计算机视觉与模式识别 · 计算机科学 2022-08-31 Samet Bayram , Kenneth Barner

Generative AI technology has become increasingly integrated into our daily lives, offering powerful capabilities to enhance productivity. However, these same capabilities can be exploited by adversaries for malicious purposes. While…

密码学与安全 · 计算机科学 2025-07-17 Dayong Ye , Tianqing Zhu , Shang Wang , Bo Liu , Leo Yu Zhang , Wanlei Zhou , Yang Zhang

Transfer-based adversarial example is one of the most important classes of black-box attacks. However, there is a trade-off between transferability and imperceptibility of the adversarial perturbation. Prior work in this direction often…

计算机视觉与模式识别 · 计算机科学 2022-12-29 Fangcheng Liu , Chao Zhang , Hongyang Zhang

Research on adversarial attacks are becoming widely popular in the recent years. One of the unexplored areas where prior research is lacking is the effect of adversarial attacks on code-mixed data. Therefore, in the present work, we have…

计算与语言 · 计算机科学 2021-11-02 Sourya Dipta Das , Ayan Basak , Soumil Mandal , Dipankar Das

Adversarial examples, which are slightly perturbed inputs generated with the aim of fooling a neural network, are known to transfer between models; adversaries which are effective on one model will often fool another. This concept of…

机器学习 · 计算机科学 2020-05-13 George Adam , Romain Speciel

With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection of intellectual…

计算与语言 · 计算机科学 2024-04-03 Ying Zhou , Ben He , Le Sun

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

计算与语言 · 计算机科学 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Speech emotion recognition (SER) is constantly gaining attention in recent years due to its potential applications in diverse fields and thanks to the possibility offered by deep learning technologies. However, recent studies have shown…

声音 · 计算机科学 2024-04-30 Nicolas Facchinetti , Federico Simonetta , Stavros Ntalampiras

Recent research has found that many families of machine learning models are vulnerable to adversarial examples: inputs that are specifically designed to cause the target model to produce erroneous outputs. In this survey, we focus on…

机器学习 · 计算机科学 2019-11-19 Rey Reza Wiyatno , Anqi Xu , Ousmane Dia , Archy de Berker

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

计算与语言 · 计算机科学 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

With an ever-increasing reliance on machine learning (ML) models in the real world, adversarial examples threaten the safety of AI-based systems such as autonomous vehicles. In the image domain, they represent maliciously perturbed data…

There are two main attack models considered in the adversarial robustness literature: black-box and white-box. We consider these threat models as two ends of a fine-grained spectrum, indexed by the number of queries the adversary can ask.…

机器学习 · 计算机科学 2021-02-11 Grzegorz Głuch , Rüdiger Urbanke

Recently, with the advancement of deep learning, several applications in text classification have advanced significantly. However, this improvement comes with a cost because deep learning is vulnerable to adversarial examples. This weakness…

机器学习 · 计算机科学 2024-05-08 Korn Sooksatra , Bikram Khanal , Pablo Rivas

Black box attacks, where adversaries have limited knowledge of the target model, pose a significant threat to machine learning systems. Adversarial examples generated with a substitute model often suffer from limited transferability to the…

机器学习 · 计算机科学 2024-10-22 Bar Avraham , Yisroel Mirsky

Recent studies have shown that adversarial examples hand-crafted on one white-box model can be used to attack other black-box models. Such cross-model transferability makes it feasible to perform black-box attacks, which has raised security…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Zhipeng Wei , Jingjing Chen , Zuxuan Wu , Yu-Gang Jiang