English
Related papers

Related papers: Should I Trust You? Detecting Deception in Negotia…

200 papers

Recent advances in Large Language Models (LLMs) have incorporated planning and reasoning capabilities, enabling models to outline steps before execution and provide transparent reasoning paths. This enhancement has reduced errors in…

Computation and Language · Computer Science 2025-01-31 Sudarshan Kamath Barkur , Sigurd Schacht , Johannes Scholl

In order for humans to confidently decide where to employ RL agents for real-world tasks, a human developer must validate that the agent will perform well at test-time. Some policy interpretability methods facilitate this by capturing the…

Machine Learning · Computer Science 2022-03-22 Julius Frost , Olivia Watkins , Eric Weiner , Pieter Abbeel , Trevor Darrell , Bryan Plummer , Kate Saenko

Deceptive games are games where the reward structure or other aspects of the game are designed to lead the agent away from a globally optimal policy. While many games are already deceptive to some extent, we designed a series of games in…

Artificial Intelligence · Computer Science 2018-02-06 Damien Anderson , Matthew Stephenson , Julian Togelius , Christian Salge , John Levine , Jochen Renz

AI models might use deceptive strategies as part of scheming or misaligned behaviour. Monitoring outputs alone is insufficient, since the AI might produce seemingly benign outputs while their internal reasoning is misaligned. We thus…

Machine Learning · Computer Science 2025-02-06 Nicholas Goldowsky-Dill , Bilal Chughtai , Stefan Heimersheim , Marius Hobbhahn

Deception is a technique to mislead human or computer systems by manipulating beliefs and information. For the applications of cyber deception, non-cooperative games become a natural choice of models to capture the adversarial interactions…

Cryptography and Security · Computer Science 2019-02-12 Tao Zhang , Linan Huang , Jeffrey Pawlick , Quanyan Zhu

Humans are capable of strategically deceptive behavior: behaving helpfully in most situations, but then behaving very differently in order to pursue alternative objectives when given the opportunity. If an AI system learned such a deceptive…

Are frontier AI systems becoming more capable? Certainly. Yet such progress is not an unalloyed blessing but rather a Trojan horse: behind their performance leaps lie more insidious and destructive safety risks, namely deception. Unlike…

Artificial Intelligence · Computer Science 2026-05-28 Sitong Fang , Shiyi Hou , Kaile Wang , Boyuan Chen , Donghai Hong , Jiayi Zhou , Josef Dai , Yaodong Yang , Jiaming Ji

As conversational AI systems become increasingly integrated into everyday life, they raise pressing concerns about user autonomy, trust, and the commercial interests that influence their behavior. To address these concerns, this paper…

Computers and Society · Computer Science 2026-01-07 Jacob Erickson

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to…

Computation and Language · Computer Science 2026-02-06 Yang Xu , Xuanming Zhang , Samuel Yeh , Jwala Dhamala , Ousmane Dia , Rahul Gupta , Sharon Li

Deception detection is a task with many applications both in direct physical and in computer-mediated communication. Our focus is on automatic deception detection in text across cultures. We view culture through the prism of the…

Computation and Language · Computer Science 2021-05-27 Katerina Papantoniou , Panagiotis Papadakos , Theodore Patkos , Giorgos Flouris , Ion Androutsopoulos , Dimitris Plexousakis

Defensive deception is a promising approach for cyber defense. Via defensive deception, the defender can anticipate attacker actions; it can mislead or lure attacker, or hide real resources. Although defensive deception is increasingly…

Cryptography and Security · Computer Science 2021-05-11 Mu Zhu , Ahmed H. Anwar , Zelin Wan , Jin-Hee Cho , Charles Kamhoua , Munindar P. Singh

Prior studies on deception in language-based AI agents typically assess whether the agent produces a false statement about a topic, or makes a binary choice prompted by a goal, rather than allowing open-ended deceptive behavior to emerge in…

Artificial Intelligence · Computer Science 2026-02-11 Satvik Golechha , Adrià Garriga-Alonso

Large Language Models (LLMs) are widely deployed in reasoning, planning, and decision-making tasks, making their trustworthiness critical. A significant and underexplored risk is intentional deception, where an LLM deliberately fabricates…

Machine Learning · Computer Science 2026-05-04 Zhaomin Wu , Mingzhe Du , See-Kiong Ng , Bingsheng He

Deception plays critical roles in economics and technology, especially in emerging interactions in cyberspace. Holistic models of deception are needed in order to analyze interactions and to design mechanisms that improve them. Game theory…

Cryptography and Security · Computer Science 2018-04-19 Jeffrey Pawlick , Edward Colbert , Quanyan Zhu

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

Large Language Models (LLMs) can generate highly persuasive text, raising concerns about their misuse for propaganda, manipulation, and other harmful purposes. This leads us to our central question: Is LLM-generated persuasion more…

Computation and Language · Computer Science 2026-04-22 Arkadiusz Modzelewski , Paweł Golik , Anna Kołos , Giovanni Da San Martino

Corporate mergers and acquisitions (M&A) account for billions of dollars of investment globally every year, and offer an interesting and challenging domain for artificial intelligence. However, in these highly sensitive domains, it is…

Computation and Language · Computer Science 2020-10-26 Linyi Yang , Eoin M. Kenny , Tin Lok James Ng , Yi Yang , Barry Smyth , Ruihai Dong

Enabling humans to identify potential flaws in an agent's decision making is an important Explainable AI application. We consider identifying such flaws in a planning-based deep reinforcement learning (RL) agent for a complex real-time…

Artificial Intelligence · Computer Science 2021-09-30 Kin-Ho Lam , Zhengxian Lin , Jed Irvine , Jonathan Dodge , Zeyad T Shureih , Roli Khanna , Minsuk Kahng , Alan Fern

Communicating in natural language is a powerful tool in multi-agent settings, as it enables independent agents to share information in partially observable settings and allows zero-shot coordination with humans. However, most prior works…

Artificial Intelligence · Computer Science 2025-02-11 Bidipta Sarkar , Warren Xia , C. Karen Liu , Dorsa Sadigh

Audio has become an increasingly crucial biometric modality due to its ability to provide an intuitive way for humans to interact with machines. It is currently being used for a range of applications, including person authentication to…

Sound · Computer Science 2023-07-14 Rishabh Ranjan , Mayank Vatsa , Richa Singh