English
Related papers

Related papers: Adversarial Attack on Black-Box Multi-Agent by Ada…

200 papers

We introduce a grey-box adversarial attack and defence framework for sentiment classification. We address the issues of differentiability, label preservation and input reconstruction for adversarial attack and defence in one unified…

Machine Learning · Computer Science 2021-03-23 Ying Xu , Xu Zhong , Antonio Jimeno Yepes , Jey Han Lau

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Large language model-based multi-agent systems (LLM-MAS) effectively accomplish complex and dynamic tasks through inter-agent communication, but this reliance introduces substantial safety vulnerabilities. Existing attack methods targeting…

Cryptography and Security · Computer Science 2025-08-06 Bingyu Yan , Ziyi Zhou , Xiaoming Zhang , Chaozhuo Li , Ruilin Zeng , Yirui Qi , Tianbo Wang , Litian Zhang

Adversarial ranking attacks have gained increasing attention due to their success in probing vulnerabilities, and, hence, enhancing the robustness, of neural ranking models. Conventional attack methods employ perturbations at a single…

Information Retrieval · Computer Science 2024-04-12 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Multi-agent systems rely on communication for information sharing and action coordination, which exposes a vulnerability to attacks. We investigate single-victim communication perturbation attacks against Multi-Agent Reinforcement…

Machine Learning · Computer Science 2026-05-14 Maxwell Standen , Junae Kim , Claudia Szabo

The integration of external data services (e.g., Model Context Protocol, MCP) has made large language model-based agents increasingly powerful for complex task execution. However, this advancement introduces critical security…

Cryptography and Security · Computer Science 2026-02-25 Che Wang , Jiaming Zhang , Ziqi Zhang , Zijie Wang , Yinghui Wang , Jianbo Gao , Tao Wei , Zhong Chen , Wei Yang Bryan Lim

Recent approaches in machine learning often solve a task using a composition of multiple models or agentic architectures. When targeting a composed system with adversarial attacks, it might not be computationally or informationally feasible…

Machine Learning · Computer Science 2024-11-01 Julian Collado , Kevin Stangl

Distributed blackbox consensus optimization is a fundamental problem in multi-agent systems, where agents must improve a global objective using only local objective queries and limited neighbor communication. Existing methods largely rely…

Multiagent Systems · Computer Science 2026-05-04 Zi-Bo Qin , Feng-Feng Wei , Tai-You Chen , Wei-Neng Chen

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Black-box attacks usually face two problems: poor transferability and the inability to evade the adversarial defense. To overcome these shortcomings, we create an original approach to generate adversarial examples by smoothing the linear…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Hui Xia , Rui Zhang , Shuliang Jiang , Zi Kang

Traffic state prediction is necessary for many Intelligent Transportation Systems applications. Recent developments of the topic have focused on network-wide, multi-step prediction, where state of the art performance is achieved via deep…

Machine Learning · Computer Science 2024-03-12 Bibek Poudel , Weizi Li

This study probes the vulnerabilities of cooperative multi-agent reinforcement learning (c-MARL) under adversarial attacks, a critical determinant of c-MARL's worst-case performance prior to real-world implementation. Current…

Machine Learning · Computer Science 2024-07-31 Simin Li , Jun Guo , Jingqiao Xiu , Yuwei Zheng , Pu Feng , Xin Yu , Aishan Liu , Yaodong Yang , Bo An , Wenjun Wu , Xianglong Liu

Deep neural networks are known to be extremely vulnerable to adversarial examples under white-box setting. Moreover, the malicious adversaries crafted on the surrogate (source) model often exhibit black-box transferability on other models…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Xiaosen Wang , Xuanran He , Jingdong Wang , Kun He

Deep neural networks are vulnerable to adversarial attacks. White-box adversarial attacks can fool neural networks with small adversarial perturbations, especially for large size images. However, keeping successful adversarial perturbations…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Yongwei Wang , Mingquan Feng , Rabab Ward , Z. Jane Wang , Lanjun Wang

Large language model (LLM) agents have demonstrated remarkable capabilities in complex reasoning and decision-making by leveraging external tools. However, this tool-centric paradigm introduces a previously underexplored attack surface,…

Artificial Intelligence · Computer Science 2026-01-08 Kanghua Mo , Li Hu , Yucheng Long , Zhihao Li

We present a new method for black-box adversarial attack. Unlike previous methods that combined transfer-based and scored-based methods by using the gradient or initialization of a surrogate white-box model, this new method tries to learn a…

Machine Learning · Computer Science 2020-01-07 Zhichao Huang , Tong Zhang

Cooperative multi-agent reinforcement learning (c-MARL) has been widely deployed in real-world applications, such as social robots, embodied intelligence, UAV swarms, etc. Nevertheless, many adversarial attacks still exist to threaten…

Machine Learning · Computer Science 2026-03-24 Men Niu , Xinxin Fan , Quanliang Jing , Shaoye Luo , Yunfeng Lu

Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, collaborative manipulation by robotic arms, and multi-target encirclement. However, potential…

Machine Learning · Computer Science 2024-06-27 Oubo Ma , Yuwen Pu , Linkang Du , Yang Dai , Ruo Wang , Xiaolei Liu , Yingcai Wu , Shouling Ji

Existing works show that augmenting the training data of pre-trained language models (PLMs) for classification tasks fine-tuned via parameter-efficient fine-tuning methods (PEFT) using both clean and adversarial examples can enhance their…

Computation and Language · Computer Science 2024-06-18 Tuc Nguyen , Thai Le

Although deep learning has made remarkable progress in processing various types of data such as images, text and speech, they are known to be susceptible to adversarial perturbations: perturbations specifically designed and added to the…

Cryptography and Security · Computer Science 2023-01-04 Tianzuo Luo , Yuyi Zhong , Siaucheng Khoo