English
Related papers

Related papers: Evolving Deception: When Agents Evolve, Deception …

200 papers

Traditional evolutionary game theory describes how certain strategy spreads throughout the system where individual player imitates the most successful strategy among its neighborhood. Accordingly, player doesn't have own authority to change…

Multiagent Systems · Computer Science 2016-04-14 Sundong Kim , Jin-Jae Lee

As large language models (LLMs) are increasingly deployed as autonomous agents, understanding how strategic behavior emerges in multi-agent environments has become an important alignment challenge. We take a neutral empirical stance and…

Large language models (LLMs) are currently at the forefront of intertwining artificial intelligence (AI) systems with human communication and everyday life. Thus, aligning them with human values is of great importance. However, given the…

Computation and Language · Computer Science 2024-06-06 Thilo Hagendorff

Large language models are increasingly deployed as autonomous agents in multi-agent settings where they communicate intentions and take consequential actions with limited human oversight. A critical safety question is whether agents that…

Computers and Society · Computer Science 2026-04-07 Jerick Shi , Terry Jingcheng Zhang , Zhijing Jin , Vincent Conitzer

Experience-driven self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactions, thus enabling adaptation to novel tasks at deployment time. This process places…

Artificial Intelligence · Computer Science 2026-05-12 Zhiyuan Fan , Wenwei Jin , Feng Zhang , Bin Li , Yihong Dong , Yao Hu , Jiawei Li

As large language models are deployed as autonomous agents, their capacity for strategic deception raises core questions for coordination, reliability, and safety in multi-goal, multi-agent systems. We study deception and communication in…

Multiagent Systems · Computer Science 2026-03-30 Maria Milkowski , Tim Weninger

We present a general framework for evolutionary learning to emergent unbiased state representation without any supervision. Evolutionary frameworks such as self-play converge to bad local optima in case of multi-agent reinforcement learning…

Machine Learning · Statistics 2023-02-03 Shohei Ohsawa

Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill…

Computation and Language · Computer Science 2025-12-23 Guibin Zhang , Haotian Ren , Chong Zhan , Zhenhong Zhou , Junhao Wang , He Zhu , Wangchunshu Zhou , Shuicheng Yan

Evolutionary agentic systems intensify the trade-off between computational efficiency and reasoning capability by repeatedly invoking large language models (LLMs) during inference. This setting raises a central question: how can an agent…

Computation and Language · Computer Science 2026-04-27 Pretam Ray , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

Autonomous agents powered by large language models (LLMs) enable novel use cases in domains where responsible action is increasingly important. Yet the inherent unpredictability of LLMs raises safety concerns about agent reliability. In…

Artificial Intelligence · Computer Science 2025-05-19 Jan Chojnacki

Current Large Language Model (LLM) agents show strong performance in tool use, but lack the crucial capability to systematically learn from their own experiences. While existing frameworks mainly focus on mitigating external knowledge gaps,…

Computation and Language · Computer Science 2026-05-19 Rong Wu , Xiaoman Wang , Jianbiao Mei , Pinlong Cai , Daocheng Fu , Cheng Yang , Licheng Wen , Xuemeng Yang , Yufan Shen , Yuxin Wang , Botian Shi

Autonomous LLM-based agents are increasingly engaging in decentralized service interactions to collaboratively execute complex tasks. However, the intrinsic instability and low-cost generativity of LLMs introduce a systemic vulnerability,…

Multiagent Systems · Computer Science 2026-02-24 Jiye Wang , Shiduo Yang , Jiayu Qin , Jianbin Li , Yu Wang , Yuanhe Zhao , Kenan Guo

Large language models (LLMs) are increasingly being deployed as autonomous agents on behalf of institutions and individuals in economic, political, and social settings that involve negotiation. Yet this trend carries significant risks if…

Computer Science and Game Theory · Computer Science 2025-12-19 Manuel S. Ríos , Ruben F. Manrique , Nicanor Quijano , Luis F. Giraldo

We explore the ability of large language models (LLMs) to engage in subtle deception through strategically phrasing and intentionally manipulating information. This harmful behavior can be hard to detect, unlike blatant lying or…

Computation and Language · Computer Science 2025-10-02 Atharvan Dogra , Krishna Pillutla , Ameet Deshpande , Ananya B Sai , John Nay , Tanmay Rajpurohit , Ashwin Kalyan , Balaraman Ravindran

Sender-receiver games are simple models of information transmission that provide a formalism to study the evolution of honest signaling and deception between a sender and a receiver. In many practical scenarios, lies often affect groups of…

Physics and Society · Physics 2021-12-01 Aanjaneya Kumar , Sandeep Chowdhary , Valerio Capraro , Matjaz Perc

This study proposes a multi-agent language framework that enables continual strategy evolution without fine-tuning the language model's parameters. The core idea is to liberate the latent vectors of abstract concepts from traditional static…

Machine Learning · Computer Science 2026-01-06 Wenlong Tang

Resources are often limited, therefore it is essential how convincingly competitors present their claims for them. Beside a player's natural capacity, here overconfidence and bluffing may also play a decisive role and influence how to share…

Physics and Society · Physics 2016-12-06 Kun Li , Attila Szolnoki , Rui Cong , Long Wang

LLM-based agents are increasingly used for cybersecurity tasks, but most existing systems rely on fixed, human-designed scaffolds that struggle to adapt across diverse targets and failure modes. We introduce \textsc{CyberEvolver}, a…

Cryptography and Security · Computer Science 2026-05-27 Yihe Fan , Changyi Li , Lichen Xu , Xudong Pan , Jiarun Dai , Hong Geng , Min Yang

Large language models (LLMs) have improved significantly in their reasoning through extensive training on massive datasets. However, relying solely on additional data for improvement is becoming increasingly impractical, highlighting the…

Computation and Language · Computer Science 2025-10-01 Gaurav Srivastava , Zhenyu Bi , Meng Lu , Xuan Wang

Recent research on large language models (LLMs) has demonstrated their ability to understand and employ deceptive behavior, even without explicit prompting. However, such behavior has only been observed in rare, specialized cases and has…

Computation and Language · Computer Science 2025-06-24 Laurène Vaugrante , Francesca Carlon , Maluna Menke , Thilo Hagendorff