English
Related papers

Related papers: Web Fraud Attacks Against LLM-Driven Multi-Agent S…

200 papers

Prompt injection attacks represent a major vulnerability in Large Language Model (LLM) deployments, where malicious instructions embedded in user inputs can override system prompts and induce unintended behaviors. This paper presents a…

Cryptography and Security · Computer Science 2025-12-18 S M Asif Hossain , Ruksat Khan Shayoni , Mohd Ruhul Ameen , Akif Islam , M. F. Mridha , Jungpil Shin

As Large Language Model (LLM) agents become more capable, their coordinated use in the form of multi-agent systems is anticipated to emerge as a practical paradigm. Prior work has examined the safety and misuse risks associated with agents.…

Artificial Intelligence · Computer Science 2026-02-26 Akshat Naik , Jay Culligan , Yarin Gal , Philip Torr , Rahaf Aljundi , Alasdair Paren , Adel Bibi

Backdoor attacks pose a serious threat to the secure deployment of large language models (LLMs), enabling adversaries to implant hidden behaviors triggered by specific inputs. However, existing methods often rely on manually crafted…

Cryptography and Security · Computer Science 2025-11-24 Yige Li , Zhe Li , Wei Zhao , Nay Myat Min , Hanxun Huang , Xingjun Ma , Jun Sun

In recent years, large language models (LLMs) have become increasingly capable and can now interact with tools (i.e., call functions), read documents, and recursively call themselves. As a result, these LLMs can now function autonomously as…

Cryptography and Security · Computer Science 2024-02-19 Richard Fang , Rohan Bindu , Akul Gupta , Qiusi Zhan , Daniel Kang

Large language models (LLMs) have been widely deployed as the backbone with additional tools and text information for real-world applications. However, integrating external information into LLM-integrated applications raises significant…

Cryptography and Security · Computer Science 2024-11-27 Jiongxiao Wang , Fangzhou Wu , Wendi Li , Jinsheng Pan , Edward Suh , Z. Morley Mao , Muhao Chen , Chaowei Xiao

Since the official release of ChatGPT in 2022, large language models (LLMs) have rapidly evolved from chatbot-style interfaces into agentic systems that can delegate work through tools and newly spawned subagents. While these capabilities…

Cryptography and Security · Computer Science 2026-05-12 Ziwen Cai , Yihe Zhang , Xiali Hei

In recent years, Cyber attacks have increased in number, and with them, the intensity of the attacks and their potential to damage the user have also increased significantly. In an ever-advancing world, users find it difficult to keep up…

Cryptography and Security · Computer Science 2024-11-22 Latesh G. Malik , Rohini Shambharkar , Shivam Morey , Shubhlak Kanpate , Vedika Raut

The escalating threat of phishing emails has become increasingly sophisticated with the rise of Large Language Models (LLMs). As attackers exploit LLMs to craft more convincing and evasive phishing emails, it is crucial to assess the…

Cryptography and Security · Computer Science 2024-11-22 Khalifa Afane , Wenqi Wei , Ying Mao , Junaid Farooq , Juntao Chen

LLM-powered Multi-Agent Systems (LLM-MAS) unlock new potentials in distributed reasoning, collaboration, and task generalization but also introduce additional risks due to unguaranteed agreement, cascading uncertainty, and adversarial…

Multiagent Systems · Computer Science 2025-10-22 Jinwei Hu , Yi Dong , Shuang Ao , Zhuoyun Li , Boxuan Wang , Lokesh Singh , Guangliang Cheng , Sarvapali D. Ramchurn , Xiaowei Huang

Federated learning (FL) is vulnerable to backdoor attacks, yet most existing methods are limited by fixed-pattern or single-target triggers, making them inflexible and easier to detect. We propose FLAT (FL Arbitrary-Target Attack), a novel…

Machine Learning · Computer Science 2025-08-07 Tuan Nguyen , Khoa D Doan , Kok-Seng Wong

Large Language Models (LLMs) are susceptible to malicious influence by cyber attackers through intrusions such as adversarial, backdoor, and embedding inversion attacks. In response, the burgeoning field of LLM Security aims to study and…

Computation and Language · Computer Science 2024-12-17 Yiyi Chen , Russa Biswas , Heather Lent , Johannes Bjerva

Recent advances in large language models (LLMs) have raised concerns about jailbreaking attacks, i.e., prompts that bypass safety mechanisms. This paper investigates the use of multi-agent LLM systems as a defence against such attacks. We…

Artificial Intelligence · Computer Science 2025-07-01 Maria Carolina Cornelia Wit , Jun Pang

LLM-based multi-agent systems have demonstrated impressive capabilities, but they also introduce significant safety risks when individual agents fail or behave adversarially. In this work, we study the automated design of agentic systems…

Machine Learning · Computer Science 2026-05-25 Jonathan Nöther , Adish Singla , Goran Radanovic

Autonomous Large Language Model (LLM) agents, exemplified by OpenClaw, demonstrate remarkable capabilities in executing complex, long-horizon tasks. However, their tightly coupled instant-messaging interaction paradigm and high-privilege…

Web agents powered by vision-language models (VLMs) enable autonomous interaction with web environments by perceiving and acting on both visual and textual webpage content to accomplish user-specified tasks. However, they are highly…

Cryptography and Security · Computer Science 2026-04-15 Yulin Chen , Tri Cao , Haoran Li , Yue Liu , Yibo Li , Yufei He , Le Minh Khoi , Yangqiu Song , Shuicheng Yan , Bryan Hooi

The rapid spread of misinformation on digital platforms threatens public discourse, emotional stability, and decision-making. While prior work has explored various adversarial attacks in misinformation detection, the specific…

Computation and Language · Computer Science 2025-10-13 Nouar Aldahoul , Yasir Zaki

Anticipating emerging attack methodologies is crucial for proactive cybersecurity. Recent advances in Large Language Models (LLMs) have enabled the automated generation of phishing messages and accelerated research into potential attack…

Cryptography and Security · Computer Science 2025-07-30 Seiji Sato , Tetsushi Ohki , Masakatsu Nishigaki

The multi-agent reinforcement learning systems (MARL) based on the Markov decision process (MDP) have emerged in many critical applications. To improve the robustness/defense of MARL systems against adversarial attacks, the study of various…

Multiagent Systems · Computer Science 2024-02-01 Ziqing Lu , Guanlin Liu , Lifeng Lai , Weiyu Xu

We introduce Fraud-R1, a benchmark designed to evaluate LLMs' ability to defend against internet fraud and phishing in dynamic, real-world scenarios. Fraud-R1 comprises 8,564 fraud cases sourced from phishing scams, fake job postings,…

Computation and Language · Computer Science 2025-05-27 Shu Yang , Shenzhe Zhu , Zeyu Wu , Keyu Wang , Junchi Yao , Junchao Wu , Lijie Hu , Mengdi Li , Derek F. Wong , Di Wang

Machine-learning phishing webpage detectors (ML-PWD) have been shown to suffer from adversarial manipulations of the HTML code of the input webpage. Nevertheless, the attacks recently proposed have demonstrated limited effectiveness due to…

Cryptography and Security · Computer Science 2023-10-17 Biagio Montaruli , Luca Demetrio , Maura Pintor , Luca Compagna , Davide Balzarotti , Battista Biggio