English
Related papers

Related papers: Evaluating Large Language Models in a Complex Hidd…

200 papers

We evaluate Large Language Models (LLMs) in repeated game-theoretic settings to assess whether strategic performance reflects genuine reasoning or reliance on memorized patterns. We consider two canonical games, Prisoner's Dilemma (PD) and…

Computation and Language · Computer Science 2026-05-25 Dimitrios Georgousis , Maria Lymperaiou , Angeliki Dimitriou , Giorgos Filandrianos , Giorgos Stamou

Recent advancements in Large Language Models (LLMs) have not only showcased impressive creative capabilities but also revealed emerging agentic behaviors that exploit linguistic ambiguity in adversarial settings. In this study, we…

Computation and Language · Computer Science 2025-04-04 Seunghyun Yoo

Recent studies have investigated whether large language models (LLMs) can support obscured communication, which is characterized by core aspects such as inferring subtext and evading suspicions. To conduct the investigation, researchers…

Artificial Intelligence · Computer Science 2025-10-08 Byungjun Kim , Dayeon Seo , Minju Kim , Bugeun Kim

Large Language Models (LLMs) interact with millions of people worldwide in applications such as customer support, education and healthcare. However, their ability to produce deceptive outputs, whether intentionally or inadvertently, poses…

Computation and Language · Computer Science 2025-10-17 Marwa Abdulhai , Ryan Cheng , Aryansh Shrivastava , Natasha Jaques , Yarin Gal , Sergey Levine

In this thesis, I evaluate the performance of Large Language Models (LLMs) on the Law School Admissions Test (LSAT), specifically the Logic Games section of the test. I focus on this section because it presents a complex logical reasoning…

Computation and Language · Computer Science 2024-10-01 Saumya Malik

Machines driven by large language models (LLMs) have the potential to augment humans across various tasks, a development with profound implications for business settings where effective communication, collaboration, and stakeholder trust…

Human-Computer Interaction · Computer Science 2025-07-28 Paweł Niszczota , Tomasz Grzegorczyk , Alexander Pastukhov

Humans act via a nuanced process that depends both on rational deliberation and also on identity and contextual factors. In this work, we study how large language models (LLMs) can simulate human action in the context of social dilemma…

Computation and Language · Computer Science 2026-02-03 Suhong Moon , Minwoo Kang , Joseph Suh , Mustafa Safdari , John Canny

Large language models (LLMs) are increasingly deployed to support human decision-making. This use of LLMs has concerning implications, especially when their prescriptions affect the welfare of others. To gauge how LLMs make social…

Computers and Society · Computer Science 2026-01-16 Saptarshi Pal , Abhishek Mallela , Christian Hilbe , Lenz Pracher , Chiyu Wei , Feng Fu , Santiago Schnell , Martin A Nowak

This research critically navigates the intricate landscape of AI deception, concentrating on deceptive behaviours of Large Language Models (LLMs). My objective is to elucidate this issue, examine the discourse surrounding it, and…

Computation and Language · Computer Science 2024-03-18 Linge Guo

Strategic reasoning enables agents to cooperate, communicate, and compete with other agents in diverse situations. Existing approaches to solving strategic games rely on extensive training, yielding strategies that do not generalize to new…

Artificial Intelligence · Computer Science 2023-05-31 Kanishk Gandhi , Dorsa Sadigh , Noah D. Goodman

Humans are capable of strategically deceptive behavior: behaving helpfully in most situations, but then behaving very differently in order to pursue alternative objectives when given the opportunity. If an AI system learned such a deceptive…

The evaluation of open-ended responses in serious games presents a unique challenge, as correctness is often subjective. Large Language Models (LLMs) are increasingly being explored as evaluators in such contexts, yet their accuracy and…

Computation and Language · Computer Science 2025-04-18 Andrés Isaza-Giraldo , Paulo Bala , Lucas Pereira

As AI systems increasingly assume roles where trust and alignment with human values are essential, understanding when and why they engage in deception has become a critical research priority. We introduce The Traitors, a multi-agent…

Artificial Intelligence · Computer Science 2025-12-16 Pedro M. P. Curvo

As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely…

Artificial Intelligence · Computer Science 2026-02-09 Yichen Wu , Qianqian Gao , Xudong Pan , Geng Hong , Min Yang

Large Language Models (LLMs) are widely deployed in reasoning, planning, and decision-making tasks, making their trustworthiness critical. A significant and underexplored risk is intentional deception, where an LLM deliberately fabricates…

Machine Learning · Computer Science 2026-05-04 Zhaomin Wu , Mingzhe Du , See-Kiong Ng , Bingsheng He

Large Language Models (LLMs) have shown remarkable promise in communicating with humans. Their potential use as artificial partners with humans in sociological experiments involving conversation is an exciting prospect. But how viable is…

Artificial Intelligence · Computer Science 2025-02-04 James Flamino , Mohammed Shahid Modi , Boleslaw K. Szymanski , Brendan Cross , Colton Mikolajczyk

Large Language Models (LLMs) often produce outputs that -- though plausible -- can lack consistency and reliability, particularly in ambiguous or complex scenarios. Challenges arise from ensuring that outputs align with both factual…

Artificial Intelligence · Computer Science 2024-10-03 Weitong Zhang , Chengqi Zang , Bernhard Kainz

Deception and persuasion play a critical role in long-horizon dialogues between multiple parties, especially when the interests, goals, and motivations of the participants are not aligned. Such complex tasks pose challenges for current…

Computation and Language · Computer Science 2023-11-13 Simon Stepputtis , Joseph Campbell , Yaqi Xie , Zhengyang Qi , Wenxin Sharon Zhang , Ruiyi Wang , Sanketh Rangreji , Michael Lewis , Katia Sycara

Large language models (LLMs) are increasingly used both to make decisions in domains such as health, education and law, and to simulate human behavior. Yet how closely LLMs mirror actual human decision-making remains poorly understood. This…

Artificial Intelligence · Computer Science 2025-11-26 Andrea Cera Palatsi , Samuel Martin-Gutierrez , Ana S. Cardenal , Max Pellert

Confirmation bias, the tendency to seek evidence that supports rather than challenges one's belief, hinders one's reasoning ability. We examine whether large language models (LLMs) exhibit confirmation bias by adapting the rule-discovery…

Computation and Language · Computer Science 2026-04-06 Ayush Rajesh Jhaveri , Anthony GX-Chen , Ilia Sucholutsky , Eunsol Choi