English
Related papers

Related papers: DeceptGuard :A Constitutional Oversight Framework …

200 papers

Safe deployment of Large Language Model (LLM) agents in autonomous settings requires reliable oversight mechanisms. A central challenge is detecting scheming, where agents covertly pursue misaligned goals. One approach to mitigating such…

Computation and Language · Computer Science 2026-03-03 Simon Storf , Rich Barton-Cooper , James Peters-Gill , Marius Hobbhahn

Detecting deception in an increasingly digital world is both a critical and challenging task. In this study, we present a comprehensive evaluation of the automated deception detection capabilities of Large Language Models (LLMs) and Large…

Computation and Language · Computer Science 2025-06-12 Md Messal Monem Miah , Adrita Anika , Xi Shi , Ruihong Huang

Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may pursue hidden objectives while maintaining superficially…

Machine Learning · Computer Science 2026-05-26 Nesreen K. Ahmed , Nima Nafisi

Modern large language models rely on chain-of-thought (CoT) reasoning to achieve impressive performance, yet the same mechanism can amplify deceptive alignment, situations in which a model appears aligned while covertly pursuing misaligned…

Artificial Intelligence · Computer Science 2025-05-27 Jiaming Ji , Wenqi Chen , Kaile Wang , Donghai Hong , Sitong Fang , Boyuan Chen , Jiayi Zhou , Juntao Dai , Sirui Han , Yike Guo , Yaodong Yang

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to…

Computation and Language · Computer Science 2026-02-06 Yang Xu , Xuanming Zhang , Samuel Yeh , Jwala Dhamala , Ousmane Dia , Rahul Gupta , Sharon Li

Large Language Models (LLMs) are increasingly vulnerable to adversarial attacks that can subtly manipulate their outputs. While various defense mechanisms have been proposed, many operate as black boxes, lacking transparency in their…

Cryptography and Security · Computer Science 2025-11-19 Shaowei Guan , Yu Zhai , Zhengyu Zhang , Yanze Wang , Hin Chi Kwok

Large Language Models (LLMs) have been demonstrating strong reasoning capability with their chain-of-thoughts (CoT), which are routinely used by humans to judge answer quality. This reliance creates a powerful yet fragile basis for trust.…

Machine Learning · Computer Science 2026-05-22 Wei Shen , Han Wang , Haoyu Li , Huan Zhang

While Large Language Models (LLMs) have achieved remarkable performance, they remain vulnerable to jailbreak. The integration of Large Language Models (LLMs) with external tools via protocols such as the Model Context Protocol (MCP)…

Cryptography and Security · Computer Science 2026-01-09 Wenpeng Xing , Zhonghao Qi , Yupeng Qin , Yilin Li , Caini Chang , Jiahui Yu , Changting Lin , Zhenzhen Xie , Meng Han

Large Language Model (LLM) agents increasingly operate across domains such as robotics, virtual assistants, and web automation. However, their stochastic decision-making introduces safety risks that are difficult to anticipate during…

Artificial Intelligence · Computer Science 2026-03-30 Haoyu Wang , Christopher M. Poskitt , Jiali Wei , Jun Sun

Recent advances in Large Language Models (LLMs) have incorporated planning and reasoning capabilities, enabling models to outline steps before execution and provide transparent reasoning paths. This enhancement has reduced errors in…

Computation and Language · Computer Science 2025-01-31 Sudarshan Kamath Barkur , Sigurd Schacht , Johannes Scholl

Multimodal deception detection aims to identify deceptive behavior by analyzing audiovisual cues for forensics and security. In these high-stakes settings, investigators need verifiable evidence connecting audiovisual cues to final…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiajian Huang , Dongliang Zhu , Zitong YU , Hui Ma , Jiayu Zhang , Chunmei Zhu , Xiaochun Cao

Large language models can deceive by subtly manipulating truthful information -- omitting key facts, shifting focus, or obscuring meaning -- making such behavior difficult to detect. Existing black-box methods rely on coarse-grained…

Computation and Language · Computer Science 2026-05-20 Linyue Cai , Samuel Yeh , Jwala Dhamala , Rahul Gupta , Sharon Li

Large Language Models (LLMs) exhibit impressive general-purpose capabilities but also introduce serious safety risks, particularly the potential for deception as models acquire increased agency and human oversight diminishes. In this work,…

Artificial Intelligence · Computer Science 2026-03-10 Matthew Lyle Olson , Neale Ratzlaff , Musashi Hinck , Tri Nguyen , Vasudev Lal , Joseph Campbell , Simon Stepputtis , Shao-Yen Tseng

As Large Language Models (LLMs) transition into autonomous agentic roles, the risk of deception-defined behaviorally as the systematic provision of false information to satisfy external incentives-poses a significant challenge to AI safety.…

Computation and Language · Computer Science 2026-03-10 Arash Marioriyad , Ali Nouri , Mohammad Hossein Rohban , Mahdieh Soleymani Baghshah

As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely…

Artificial Intelligence · Computer Science 2026-02-09 Yichen Wu , Qianqian Gao , Xudong Pan , Geng Hong , Min Yang

Large language models (LLMs) remain vulnerable to jailbreak prompts that are fluent and semantically coherent, and therefore difficult to detect with standard heuristics. A particularly challenging failure mode occurs when an attacker tries…

Artificial Intelligence · Computer Science 2026-02-24 Amirhossein Farzam , Majid Behabahani , Mani Malek , Yuriy Nevmyvaka , Guillermo Sapiro

Large language models (LLMs) excel at complex reasoning but can still exhibit harmful behaviors. Current alignment strategies typically embed safety into model weights, making these controls implicit, static, and difficult to modify. This…

Computation and Language · Computer Science 2025-10-15 Xuanming Zhang , Yuxuan Chen , Samuel Yeh , Sharon Li

While Large Language Model (LLM) capabilities have scaled, safety guardrails remain largely stateless, treating multi-turn dialogues as a series of disconnected events. This lack of temporal awareness facilitates a "Safety Gap" where…

Artificial Intelligence · Computer Science 2026-02-20 Justin Albrethsen , Yash Datta , Kunal Kumar , Sharath Rajasekar

Detecting content generated by large language models (LLMs) is crucial for preventing misuse and building trustworthy AI systems. Although existing detection methods perform well, their robustness in out-of-distribution (OOD) scenarios is…

Computation and Language · Computer Science 2025-08-19 Xin Chen , Junchao Wu , Shu Yang , Runzhe Zhan , Zeyu Wu , Ziyang Luo , Di Wang , Min Yang , Lidia S. Chao , Derek F. Wong

Web agents powered by vision-language models (VLMs) enable autonomous interaction with web environments by perceiving and acting on both visual and textual webpage content to accomplish user-specified tasks. However, they are highly…

Cryptography and Security · Computer Science 2026-04-15 Yulin Chen , Tri Cao , Haoran Li , Yue Liu , Yibo Li , Yufei He , Le Minh Khoi , Yangqiu Song , Shuicheng Yan , Bryan Hooi
‹ Prev 1 2 3 10 Next ›