English
Related papers

Related papers: From Assistant to Double Agent: Formalizing and Be…

200 papers

The rapid rise of autonomous AI systems and advancements in agent capabilities are introducing new risks due to reduced oversight of real-world interactions. Yet agent testing remains nascent and is still a developing science. As AI agents…

Driven by the rapid development of Large Language Models (LLMs), LLM-based agents have been developed to handle various real-world applications, including finance, healthcare, and shopping, etc. It is crucial to ensure the reliability and…

Cryptography and Security · Computer Science 2024-10-30 Wenkai Yang , Xiaohan Bi , Yankai Lin , Sishuo Chen , Jie Zhou , Xu Sun

Recent advancements in Web AI agents have demonstrated remarkable capabilities in addressing complex web navigation tasks. However, emerging research shows that these agents exhibit greater vulnerability compared to standalone Large…

Machine Learning · Computer Science 2025-09-23 Jeffrey Yang Fan Chiang , Seungjae Lee , Jia-Bin Huang , Furong Huang , Yizheng Chen

The increasing use of large language models (LLMs) in mental healthcare raises safety concerns in high-stakes therapeutic interactions. A key challenge is distinguishing therapeutic empathy from maladaptive validation, where supportive…

Computation and Language · Computer Science 2026-04-07 Qingyang Xu , Yaling Shen , Stephanie Fong , Zimu Wang , Yiwen Jiang , Xiangyu Zhao , Jiahe Liu , Zhongxing Xu , Vincent Lee , Zongyuan Ge

The rapid advancement of conversational agents, particularly chatbots powered by Large Language Models (LLMs), poses a significant risk of social engineering (SE) attacks on social media platforms. SE detection in multi-turn, chat-based…

Agent Skill framework, now widely and officially supported by major players such as GitHub Copilot, LangChain, and OpenAI, performs especially well with proprietary models by improving context engineering, reducing hallucinations, and…

Artificial Intelligence · Computer Science 2026-02-23 Yangjie Xu , Lujun Li , Lama Sleem , Niccolo Gentile , Yewei Song , Yiqun Wang , Siming Ji , Wenbo Wu , Radu State

Enterprise software engineering is shifting away from deterministic CRUD/REST architectures toward AI-native systems where large language models act as cognitive orchestrators. This transition introduces a critical security tension:…

Cryptography and Security · Computer Science 2026-04-29 Ignacio Peyrano

Modern Large Language Model (LLM) agents promise end to end assistance with real-world software tasks, yet existing benchmarks evaluate LLM agents almost exclusively in pre-baked environments where every dependency is pre-installed. To fill…

Software Engineering · Computer Science 2025-07-15 Avi Arora , Jinu Jang , Roshanak Zilouchian Moghaddam

In January 2026, the open-source agent framework OpenClaw and the agent-only social network Moltbook produced a large-scale dataset of autonomous AI-to-AI interaction, attracting six academic publications within fourteen days. This study…

Artificial Intelligence · Computer Science 2026-03-05 Lukas Weidener , Marko Brkić , Phillip Lee , Martin Karlsson , Kevin Noessler , Paul Kohlhaas

Computer-use agents extend language models from text generation to persistent action over tools, files, and execution environments. Unlike chat systems, they maintain state across interactions and translate intermediate outputs into…

Artificial Intelligence · Computer Science 2026-04-06 Yunhao Feng , Yifan Ding , Yingshui Tan , Xingjun Ma , Yige Li , Yutao Wu , Yifeng Gao , Kun Zhai , Yanming Guo

In the vast domain of cybersecurity, the transition from reactive defense to offensive has become critical in protecting digital infrastructures. This paper explores the integration of Artificial Intelligence (AI) into offensive…

Cryptography and Security · Computer Science 2024-06-13 Leroy Jacob Valencia

Agentic AI systems are emerging as powerful tools for automating complex, multi-step tasks across various industries. One such industry is telecommunications, where the growing complexity of next-generation radio access networks (RANs)…

Networking and Internet Architecture · Computer Science 2026-04-16 Sotiris Chatzimiltis , Mahdi Boloursaz Mashhadi , Mohammad Shojafar , Merouane Debbah , Rahim Tafazolli

Since the advent of large language models, prompt engineering now enables the rapid, low-effort creation of diverse autonomous agents that are already in widespread use. Yet this convenience raises urgent concerns about the safety,…

Artificial Intelligence · Computer Science 2025-06-27 Daewon Kang , YeongHwan Shin , Doyeon Kim , Kyu-Hwan Jung , Meong Hi Son

Multi-agent artificial intelligence systems or MAS are systems of autonomous agents that exercise delegated tool authority, share persistent memory, and coordinate via inter-agent communication. MAS introduces qualitatively distinct…

Cryptography and Security · Computer Science 2026-04-28 Tam Nguyen , Moses Ndebugre , Dheeraj Arremsetty

As Large Language Models (LLMs) evolve from code generators into collaborative partners for software engineers, our methods for evaluation are lagging. Current benchmarks, focused on code correctness, fail to capture the nuanced,…

Software Engineering · Computer Science 2026-01-01 Tao Dong , Harini Sampath , Ja Young Lee , Sherry Y. Shi , Andrew Macvean

AI agents have the potential to significantly alter the cybersecurity landscape. Here, we introduce the first framework to capture offensive and defensive cyber-capabilities in evolving real-world systems. Instantiating this framework with…

Agentic AI systems, which leverage multiple autonomous agents and large language models (LLMs), are increasingly used to address complex, multi-step tasks. The safety, security, and functionality of these systems are critical, especially in…

Artificial Intelligence · Computer Science 2026-04-16 Edoardo Allegrini , Ananth Shreekumar , Z. Berkay Celik

Large Language Models (LLMs) represent a transformative leap in artificial intelligence, enabling the comprehension, generation, and nuanced interaction with human language on an unparalleled scale. However, LLMs are increasingly vulnerable…

Cryptography and Security · Computer Science 2025-02-06 Nan Wang , Kane Walter , Yansong Gao , Alsharif Abuadbba

The growing prevalence of artificial intelligence (AI) in various applications underscores the need for agents that can successfully navigate and adapt to an ever-changing, open-ended world. A key challenge is ensuring these AI agents are…

Machine Learning · Computer Science 2025-12-10 Mikayel Samvelyan

As agent systems move into increasingly diverse execution settings, trajectory-level safety evaluation and diagnosis require benchmarks that evolve with them. ATBench is a diverse and realistic agent trajectory benchmark for safety…

Artificial Intelligence · Computer Science 2026-04-30 Zhonghao Yang , Yu Li , Yanxu Zhu , Tianyi Zhou , Yuejin Xie , Haoyu Luo , Jing Shao , Xia Hu , Dongrui Liu