English
Related papers

Related papers: Differentiable Belief-based Opponent Shaping

200 papers

Opponent modelling has proven effective in enhancing the decision-making of the controlled agent by constructing models of opponent agents. However, existing methods often rely on access to the observations and actions of opponents, a…

Artificial Intelligence · Computer Science 2024-03-25 Jing Sun , Shuo Chen , Cong Zhang , Yining Ma , Jie Zhang

Providing reinforcement learning agents with informationally rich human knowledge can dramatically improve various aspects of learning. Prior work has developed different kinds of shaping methods that enable agents to learn efficiently in…

Human-Computer Interaction · Computer Science 2018-11-13 Chao Yu , Tianpei Yang , Wenxuan Zhu , Dongxu wang , Guangliang Li

In AI-assisted decision-making, it is crucial but challenging for humans to appropriately rely on AI, especially in high-stakes domains such as finance and healthcare. This paper addresses this problem from a human-centered perspective by…

Human-Computer Interaction · Computer Science 2025-02-21 Takehiro Takayanagi , Ryuji Hashimoto , Chung-Chi Chen , Kiyoshi Izumi

Reward shaping (RS) is a powerful method in reinforcement learning (RL) for overcoming the problem of sparse or uninformative rewards. However, RS typically relies on manually engineered shaping-reward functions whose construction is…

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

Designing cyber defense systems to account for cognitive biases in human decision making has demonstrated significant success in improving performance against human attackers. However, much of the attention in this area has focused on…

Artificial Intelligence · Computer Science 2025-05-16 Tailia Malloy , Cleotilde Gonzalez

Optimally trading-off exploration and exploitation is the holy grail of reinforcement learning as it promises maximal data-efficiency for solving any task. Bayes-optimal agents achieve this, but obtaining the belief-state and performing…

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

Machine Learning · Computer Science 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

The ability to model the mental states of others is crucial to human social intelligence, and can offer similar benefits to artificial agents with respect to the social dynamics induced in multi-agent settings. We present a method of…

Machine Learning · Computer Science 2023-07-20 Ini Oguntola , Joseph Campbell , Simon Stepputtis , Katia Sycara

Human cooperation depends on how accurately we infer others' motives--how much they value fairness, generosity, or self-interest from the choices they make. We model that process in binary dictator games, which isolate moral trade-offs…

Neurons and Cognition · Quantitative Biology 2025-11-12 Gregory Stanley , Jun Zhang , Rick Lewis

Modeling social interactions based on individual behavior has always been an area of interest, but prior literature generally presumes rational behavior. Thus, such models may miss out on capturing the effects of biases humans are…

Artificial Intelligence · Computer Science 2019-03-11 Nanda Kishore Sreenivas , Shrisha Rao

In multi-agent reinforcement learning, multiple agents learn simultaneously while interacting with a common environment and each other. Since the agents adapt their policies during learning, not only the behavior of a single agent becomes…

Artificial Intelligence · Computer Science 2022-04-13 Yuan Tian , Klaus-Rudolf Kladny , Qin Wang , Zhiwu Huang , Olga Fink

A deep reinforcement learning based multi-objective autonomous braking system is presented. The design of the system is formulated in a continuous action space and seeks to maximize both pedestrian safety and perception as well as passenger…

Robotics · Computer Science 2019-07-02 Rafael Vasquez , Bilal Farooq

The performance of multi-agent reinforcement learning (MARL) in partially observable environments depends on effectively aggregating information from observations, communications, and reward signals. While most existing multi-agent systems…

Multiagent Systems · Computer Science 2025-11-04 Qinwei Huang , Stefan Wang , Simon Khan , Garrett Katz , Qinru Qiu

Reinforcement learning algorithms are typically limited to learning a single solution for a specified task, even though diverse solutions often exist. Recent studies showed that learning a set of diverse solutions is beneficial because…

Machine Learning · Statistics 2022-04-14 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

In fighting games, individual players of the same skill level often exhibit distinct strategies from one another through their gameplay. Despite this, the majority of AI agents for fighting games have only a single strategy for each "level"…

Machine Learning · Computer Science 2022-11-08 Emily Halina , Matthew Guzdial

In this paper, we consider an adversarial scenario where one agent seeks to achieve an objective and its adversary seeks to learn the agent's intentions and prevent the agent from achieving its objective. The agent has an incentive to try…

Optimization and Control · Mathematics 2018-05-09 Melkior Ornik , Ufuk Topcu

As deep learning models are increasingly deployed in high-risk applications, robust defenses against adversarial attacks and reliable performance guarantees become paramount. Moreover, accuracy alone does not provide sufficient assurance or…

Machine Learning · Computer Science 2025-06-10 Jie Bao , Chuangyin Dang , Rui Luo , Hanwei Zhang , Zhixin Zhou

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

Machine Learning · Computer Science 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Active inference is a first principles approach for understanding the brain in particular, and sentient agents in general, with the single imperative of minimizing free energy. As such, it provides a computational account for modelling…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Stefano Ferraro , Toon Van de Maele , Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt