English
Related papers

Related papers: Experiments with Detecting and Mitigating AI Decep…

200 papers

As ongoing research explores the ability of AI agents to be insider threats and act against company interests, we showcase the abilities of such agents to act against human well being in service of corporate authority. Building on Agentic…

Artificial Intelligence · Computer Science 2026-04-10 Thomas Rivasseau

In order to be useful in the real world, AI agents need to plan and act in the presence of others, who may include adversarial and cooperative entities. In this paper, we consider the problem where an autonomous agent needs to act in a…

Artificial Intelligence · Computer Science 2020-01-27 Anagha Kulkarni , Siddharth Srivastava , Subbarao Kambhampati

Cyber deception is one of the key approaches used to mislead attackers by hiding or providing inaccurate system information. There are two main factors limiting the real-world application of existing cyber deception approaches. The first…

Cryptography and Security · Computer Science 2020-08-14 Dayong Ye , Tianqing Zhu , Shen Sheng , Wanlei Zhou

Deception is a common defense mechanism against adversaries with an information disadvantage. It can force such adversaries to select suboptimal policies for a defender's benefit. We consider a setting where an adversary tries to learn the…

Systems and Control · Electrical Eng. & Systems 2026-02-20 Filippos Fotiadis , Aris Kanellopoulos , Kyriakos G. Vamvoudakis , Ufuk Topcu

AI agents, specifically powered by large language models, have demonstrated exceptional capabilities in various applications where precision and efficacy are necessary. However, these agents come with inherent risks, including the potential…

Cryptography and Security · Computer Science 2025-03-04 Ishaan Domkundwar , Mukunda N S , Ishaan Bhola , Riddhik Kochhar

Deceptive games are games where the reward structure or other aspects of the game are designed to lead the agent away from a globally optimal policy. While many games are already deceptive to some extent, we designed a series of games in…

Artificial Intelligence · Computer Science 2018-02-06 Damien Anderson , Matthew Stephenson , Julian Togelius , Christian Salge , John Levine , Jochen Renz

Humans and machines interact more frequently than ever and our societies are becoming increasingly hybrid. A consequence of this hybridisation is the degradation of societal trust due to the prevalence of AI-enabled deception. Yet, despite…

Multiagent Systems · Computer Science 2024-06-12 Stefan Sarkadi

The concept of cyber deception has been receiving emerging attention. The development of cyber defensive deception techniques requires interdisciplinary work, among which cognitive science plays an important role. In this work, we adopt a…

Cryptography and Security · Computer Science 2023-09-26 Yinan Hu , Quanyan Zhu

Balancing exploration and conservatism in the constrained setting is an important problem if we are to use reinforcement learning for meaningful tasks in the real world. In this paper, we propose a principled algorithm for safe exploration…

Artificial Intelligence · Computer Science 2023-04-24 Alexander W. Goodall , Francesco Belardinelli

An increasingly common socio-technical problem is people being taken in by offers that sound ``too good to be true'', where persuasion and trust shape decision-making. This paper investigates how \abr{ai} can help detect these deceptive…

Computation and Language · Computer Science 2025-06-06 Wichayaporn Wongkamjan , Yanze Wang , Feng Gu , Denis Peskoff , Jonathan K. Kummerfeld , Jonathan May , Jordan Lee Boyd-Graber

Deception is virtually ubiquitous in warfare, and should be a central consideration for military operations research. However, studies of agent behaviour in simulated operations have typically neglected to include explicit models of…

Multiagent Systems · Computer Science 2021-09-08 Lyndon Benke , Michael Papasimeon , Tim Miller

Within the framework of Multi-Agent Reinforcement Learning, Social Learning is a new class of algorithms that enables agents to reshape the reward function of other agents with the goal of promoting cooperation and achieving higher global…

Machine Learning · Computer Science 2021-06-11 Paul Chelarescu

This research critically navigates the intricate landscape of AI deception, concentrating on deceptive behaviours of Large Language Models (LLMs). My objective is to elucidate this issue, examine the discourse surrounding it, and…

Computation and Language · Computer Science 2024-03-18 Linge Guo

Automated verbal deception detection using methods from Artificial Intelligence (AI) has been shown to outperform humans in disentangling lies from truths. Research suggests that transparency and interpretability of computational methods…

Human-Computer Interaction · Computer Science 2026-04-10 Riccardo Loconte , Merylin Monaro , Pietro Pietrini , Bruno Verschuere , Bennett Kleinberg

As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely…

Artificial Intelligence · Computer Science 2026-02-09 Yichen Wu , Qianqian Gao , Xudong Pan , Geng Hong , Min Yang

Currently the Dempster-Shafer based algorithm and Uniform Random Probability based algorithm are the preferred method of resolving security games, in which defenders are able to identify attackers and only strategy remained ambiguous.…

Artificial Intelligence · Computer Science 2015-08-11 Hossein Khani , Mohsen Afsharchi

Deception is being increasingly explored as a cyberdefense strategy to protect operational systems. We are studying implementation of deception-in-depth strategies with initially three logical layers: network, host, and data. We draw ideas…

Cryptography and Security · Computer Science 2024-12-24 Jason Landsborough , Neil C. Rowe , Thuy D. Nguyen , Sunny Fugate

Playing games with cheaters is not fun, and in a multi-billion-dollar video game industry with hundreds of millions of players, game developers aim to improve the security and, consequently, the user experience of their games by preventing…

Artificial Intelligence · Computer Science 2022-05-17 Anssi Kanervisto , Tomi Kinnunen , Ville Hautamäki

Deception is a crucial tool in the cyberdefence repertoire, enabling defenders to leverage their informational advantage to reduce the likelihood of successful attacks. One way deception can be employed is through obscuring, or masking,…

Computer Science and Game Theory · Computer Science 2022-06-22 Junlin Wu , Charles Kamhoua , Murat Kantarcioglu , Yevgeniy Vorobeychik

In this short note, we propose a unified framework that bridges three areas: (1) a flipped perspective on the Turing Test, the "dual Turing test", in which a human judge's goal is to identify an AI rather than reward a machine for…

Machine Learning · Computer Science 2025-07-23 Alberto Messina