English
Related papers

Related papers: How Adversarial Environments Mislead Agentic AI?

200 papers

AI agents integrated with Web3 offer autonomy and openness but raise security concerns as they interact with financial protocols and immutable smart contracts. This paper investigates the vulnerabilities of AI agents within blockchain-based…

Cryptography and Security · Computer Science 2025-07-10 Atharv Singh Patlan , Peiyao Sheng , S. Ashwin Hebbar , Prateek Mittal , Pramod Viswanath

Autonomous agent frameworks built upon large language models (LLMs) are evolving into complex, tool-integrated, and continuously operating systems, introducing security risks beyond traditional prompt-level vulnerabilities. As this paradigm…

Cryptography and Security · Computer Science 2026-05-01 Luyao Xu , Xiang Chen

The rise of AI agent frameworks has introduced agent skills, modular packages containing instructions and executable code that dynamically extend agent capabilities. While this architecture enables powerful customization, skills execute…

Cryptography and Security · Computer Science 2026-01-16 Yi Liu , Weizhe Wang , Ruitao Feng , Yao Zhang , Guangquan Xu , Gelei Deng , Yuekang Li , Leo Zhang

Explainable AI (XAI) helps users interpret model behavior and identify potential faults. Agentic XAI systems use Large Language Models (LLMs) to make explanations more accessible through natural-language interaction, but they can also…

Artificial Intelligence · Computer Science 2026-05-28 Jaechang Kim , Sunung Mun , Seungjoon Lee , Jaewoong Cho , Jungseul Ok

Open agentic systems combine LLM-based planning with external capabilities, persistent memory, and privileged execution. They are used in coding assistants, browser copilots, and enterprise automation. OpenClaw is a visible instance of this…

Cryptography and Security · Computer Science 2026-03-30 Shiping Chen , Qin Wang , Guangsheng Yu , Xu Wang , Liming Zhu

AI agents, predominantly powered by large language models (LLMs), are vulnerable to indirect prompt injection, in which malicious instructions embedded in untrusted data can trigger dangerous agent actions. This position paper discusses our…

Cryptography and Security · Computer Science 2026-04-01 Chong Xiang , Drew Zagieboylo , Shaona Ghosh , Sanjay Kariyappa , Kai Greshake , Hanshen Xiao , Chaowei Xiao , G. Edward Suh

The increased adoption of Artificial Intelligence (AI) presents an opportunity to solve many socio-economic and environmental challenges; however, this cannot happen without securing AI-enabled technologies. In recent years, most AI models…

Cryptography and Security · Computer Science 2021-02-10 Ayodeji Oseni , Nour Moustafa , Helge Janicke , Peng Liu , Zahir Tari , Athanasios Vasilakos

The Model Context Protocol (MCP) enables large language models to invoke external tools through natural-language descriptions, forming the foundation of many AI agent applications. However, MCP does not enforce consistency between…

Cryptography and Security · Computer Science 2026-02-04 Zhihao Li , Boyang Ma , Xuelong Dai , Minghui Xu , Yue Zhang , Biwei Yan , Kun Li

Agentic AI systems powered by large language models (LLMs) and endowed with planning, tool use, memory, and autonomy, are emerging as powerful, flexible platforms for automation. Their ability to autonomously execute tasks across web,…

Artificial Intelligence · Computer Science 2026-04-07 Anshuman Chhabra , Shrestha Datta , Shahriar Kabir Nahin , Prasant Mohapatra

Embodied Artificial Intelligence (AI) promises to handle edge cases in robotic vehicle systems where data is scarce by using common-sense reasoning grounded in perception and action to generalize beyond training distributions and adapt to…

Cryptography and Security · Computer Science 2026-02-10 Luis Burbano , Diego Ortiz , Qi Sun , Siwei Yang , Haoqin Tu , Cihang Xie , Yinzhi Cao , Alvaro A Cardenas

Autonomous systems such as self-driving cars and general-purpose robots are safety-critical systems that operate in highly uncertain and dynamic environments. We propose an interactive multi-agent framework where the system-under-design is…

Machine Learning · Computer Science 2021-07-07 Xin Qin , Nikos Aréchiga , Andrew Best , Jyotirmoy Deshmukh

As generative AI (GenAI) agents become more common in enterprise settings, they introduce security challenges that differ significantly from those posed by traditional systems. These agents are not just LLMs; they reason, remember, and act,…

Cryptography and Security · Computer Science 2025-05-06 Vineeth Sai Narajala , Om Narayan

How to detect and mitigate deceptive AI systems is an open problem for the field of safe and trustworthy AI. We analyse two algorithms for mitigating deception: The first is based on the path-specific objectives framework where paths in the…

Artificial Intelligence · Computer Science 2023-06-27 Ismail Sahbane , Francis Rhys Ward , C Henrik Åslund

The rapid and dynamic pace of Artificial Intelligence (AI) and Machine Learning (ML) is revolutionizing the insurance sector. AI offers significant, very much welcome advantages to insurance companies, and is fundamental to their…

Machine Learning · Computer Science 2023-01-19 Elisa Luciano , Matteo Cattaneo , Ron Kenett

Foundation models have transformed automated code generation, yet autonomous software-engineering agents remain unreliable in realistic development settings. The dominant explanation locates this gap in model capability. We propose a…

Software Engineering · Computer Science 2026-05-14 Hailin Zhong , Shengxin Zhu

Embedded into information systems, artificial intelligence (AI) faces security threats that exploit AI-specific vulnerabilities. This paper provides an accessible overview of adversarial attacks unique to predictive and generative AI…

Cryptography and Security · Computer Science 2025-07-01 Naoto Kiribuchi , Kengo Zenitani , Takayuki Semitsu

Adversarial attacks are valuable for providing insights into the blind-spots of deep learning models and help improve their robustness. Existing work on adversarial attacks have mainly focused on static scenes; however, it remains unclear…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Aishan Liu , Tairan Huang , Xianglong Liu , Yitao Xu , Yuqing Ma , Xinyun Chen , Stephen J. Maybank , Dacheng Tao

Edge deployment of LLM agents on IoT hardware introduces attack surfaces absent from cloud-hosted orchestration. We present an empirical security analysis of three architectures (cloud-hosted, edge-local swarm, and hybrid) using a…

Cryptography and Security · Computer Science 2026-04-23 Zhonghao Zhan , Krinos Li , Yefan Zhang , Hamed Haddadi

We introduce a novel methodology for identifying adversarial attacks on deepfake detectors using eXplainable Artificial Intelligence (XAI). In an era characterized by digital advancement, deepfakes have emerged as a potent tool, creating a…

Cryptography and Security · Computer Science 2024-08-20 Ben Pinhasov , Raz Lapid , Rony Ohayon , Moshe Sipper , Yehudit Aperstein

The Model Context Protocol (MCP), introduced by Anthropic in November 2024 and now governed by the Linux Foundation's Agentic AI Foundation, has rapidly become the de facto standard for connecting large language model (LLM)-based agents to…

Cryptography and Security · Computer Science 2026-04-08 Nirajan Acharya , Gaurav Kumar Gupta