English
Related papers

Related papers: Technical Report: Exploring the Emerging Threats o…

200 papers

Agentic AI systems are entering software engineering workflows, yet empirical evidence on how industrial organizations actually adopt them remains sparse. We present a qualitative interview study with sixteen practitioners across twelve…

Software Engineering · Computer Science 2026-05-15 Spyridon Alvanakis Apostolou , Jan Bosch , Helena Holmström Olsson

Current AI agents can flexibly invoke tools and execute complex tasks, yet their long-term advancement is hindered by the lack of systematic accumulation and transfer of skills. Without a unified mechanism for skill consolidation, agents…

Agentic AI systems can plan, call tools, inspect code, interact with web applications, and coordinate multi-step workflows. These same capabilities change the economics of cyber offense. The central near-term risk is not that every…

Cryptography and Security · Computer Science 2026-05-11 Christopher Koch

Although large language model (LLM)-based agents, exemplified by OpenClaw, are increasingly evolving from task-oriented systems into personalized AI assistants for solving complex real-world tasks, their practical deployment also introduces…

Artificial Intelligence · Computer Science 2026-02-12 Yuhang Wang , Feiming Xu , Zheng Lin , Guangyu He , Yuzhe Huang , Haichang Gao , Zhenxing Niu , Shiguo Lian , Zhaoxiang Liu

The robustness of LLMs to jailbreak attacks, where users design prompts to circumvent safety measures and misuse model capabilities, has been studied primarily for LLMs acting as simple chatbots. Meanwhile, LLM agents -- which use external…

The capabilities of artificial intelligence systems have been advancing to a great extent, but these systems still struggle with failure modes, vulnerabilities, and biases. In this paper, we study the current state of the field, and present…

Cryptography and Security · Computer Science 2025-06-12 Xingli Fang , Jianwei Li , Varun Mulchandani , Jung-Eun Kim

We present CAIA, a benchmark exposing a critical blind spot in AI evaluation: the inability of state-of-the-art models to operate in adversarial, high-stakes environments where misinformation is weaponized and errors are irreversible. While…

Artificial Intelligence · Computer Science 2026-01-21 Zeshi Dai , Zimo Peng , Zerui Cheng , Ryan Yihe Li

We argue that LLM agent security is fundamentally an agent-human interaction (AHI) problem, not a purely algorithmic one. To substantiate this position, we conduct a systematic analysis of 59 academic papers, 21 production agent systems,…

Cryptography and Security · Computer Science 2026-05-26 Peiran Wang , Ying Li , Yuan Tian

Autonomous coding agents are increasingly integrated into software development workflows, offering capabilities that extend beyond code suggestion to active system interaction and environment management. OpenClaw, a representative platform…

Cryptography and Security · Computer Science 2026-03-23 Fazhong Liu , Zhuoyan Chen , Tu Lan , Haozhen Tan , Zhenyu Xu , Xiang Li , Guoxing Chen , Yan Meng , Haojin Zhu

The rapid emergence of multi-agent AI systems (MAS), including LangChain, CrewAI, and AutoGen, has shaped how large language model (LLM) applications are developed and orchestrated. However, little is known about how these systems evolve…

Software Engineering · Computer Science 2026-01-13 Daniel Liu , Krishna Upadhyay , Vinaik Chhetri , A. B. Siddique , Umar Farooq

Agentic AI scientists equipped with domain-specific tools are rapidly entering scientific workflows across disciplines, with especially strong uptake in the life sciences where they can be used for literature synthesis, sequence analysis,…

Other Quantitative Biology · Quantitative Biology 2026-05-05 Kimon Antonios Provatas , Avery Self , Ioannis Mouratidis , Ilias Georgakopoulos-Soares

AI agents, specifically powered by large language models, have demonstrated exceptional capabilities in various applications where precision and efficacy are necessary. However, these agents come with inherent risks, including the potential…

Cryptography and Security · Computer Science 2025-03-04 Ishaan Domkundwar , Mukunda N S , Ishaan Bhola , Riddhik Kochhar

Machine learning (ML) underpins foundation models in finance, healthcare, and critical infrastructure, making them targets for data poisoning, model extraction, prompt injection, automated jailbreaking, and preference-guided black-box…

Cryptography and Security · Computer Science 2025-12-30 Armstrong Foundjem , Lionel Nganyewou Tidjon , Leuson Da Silva , Foutse Khomh

Recent advances in AI are transforming AI's ubiquitous presence in our world from that of standalone AI-applications into deeply integrated AI-agents. These changes have been driven by agents' increasing capability to autonomously make…

Cryptography and Security · Computer Science 2025-07-04 Jose Sanchez Vicarte , Marcin Spoczynski , Mostafa Elsaid

Privacy is a key principle for developing ethical AI technologies, but how does including AI technologies in products and services change privacy risks? We constructed a taxonomy of AI privacy risks by analyzing 321 documented AI privacy…

Human-Computer Interaction · Computer Science 2024-02-13 Hao-Ping Lee , Yu-Ju Yang , Thomas Serban von Davier , Jodi Forlizzi , Sauvik Das

Securing AI agents powered by Large Language Models (LLMs) represents one of the most critical challenges in AI security today. Unlike traditional software, AI agents leverage LLMs as their "brain" to autonomously perform actions via…

Cryptography and Security · Computer Science 2025-11-25 Itay Hazan , Yael Mathov , Guy Shtar , Ron Bitton , Itsik Mantin

Skills are increasingly used to extend LLM agents by packaging prompts, code, and configurations into reusable modules. As public registries and marketplaces expand, they form an emerging agentic supply chain, but also introduce a new…

Cryptography and Security · Computer Science 2026-03-31 Shenao Wang , Junjie He , Yanjie Zhao , Yayi Wang , Kan Yu , Haoyu Wang

Autonomous Artificial Intelligence (AI) agents, powered by Large Language Models (LLMs), advance rapidly toward interconnected systems -- an Internet of Agents (IoA). This vision enables complex problem-solving while introducing systemic…

Multiagent Systems · Computer Science 2026-04-28 Juan A. Wibowo , George C. Polyzos

Agent tools are becoming a core interface through which LLM agents access external data, services, and execution environments. As these tools are distributed through public marketplaces, raw tool counts may substantially overstate ecosystem…

Software Engineering · Computer Science 2026-05-19 Taein Kim , David Jiang , Yuepeng Hu , Yuqi Jia , Neil Gong

Organisations are starting to adopt LLM-based AI agents, with their deployments naturally evolving from single agents towards interconnected, multi-agent networks. Yet a collection of safe agents does not guarantee a safe collection of…

Multiagent Systems · Computer Science 2025-08-11 Alistair Reid , Simon O'Callaghan , Liam Carroll , Tiberio Caetano