English
Related papers

Related papers: Stochastic Dynamic Games in Belief Space

200 papers

Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a…

Artificial Intelligence · Computer Science 2011-06-02 M. Hauskrecht

In multi-agent autonomous systems, deception is a fundamental concept which characterizes the exploitation of unbalanced information to mislead victims into choosing oblivious actions. This effectively alters the system's long term…

Systems and Control · Electrical Eng. & Systems 2025-08-27 Michael Tang , Miroslav Krstic , Jorge Poveda

We study observation-based strategies for partially-observable Markov decision processes (POMDPs) with omega-regular objectives. An observation-based strategy relies on partial information about the history of a play, namely, on the past…

Logic in Computer Science · Computer Science 2015-05-14 Krishnendu Chatterjee , Laurent Doyen , Thomas A. Henzinger

We study the interpersonal trust of a population of agents, asking whether chance may decide if a population ends up in a high trust or low trust state. We model this by a discrete time, random matching stochastic coordination game. Agents…

Physics and Society · Physics 2024-05-20 Benedikt V. Meylahn , Arnoud V. den Boer , Michel Mandjes

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

The framework of uncoupled online learning in multiplayer games has made significant progress in recent years. In particular, the development of time-varying games has considerably expanded its modeling capabilities. However, current regret…

Computer Science and Game Theory · Computer Science 2025-08-18 Aymeric Capitaine , Etienne Boursier , Eric Moulines , Michael I. Jordan , Alain Durmus

Although risk awareness is fundamental to an online operating agent, it has received less attention in the challenging continuous domain and under partial observability. This paper presents a novel formulation and solution for risk-averse…

Artificial Intelligence · Computer Science 2023-02-22 Andrey Zhitnikov , Vadim Indelman

Traditionally, an agent's beliefs would come from what the agent can see, hear, or sense. In the modern world, beliefs are often based on the data available to the agents. In this work, we investigate a dynamic logic of such beliefs that…

Logic in Computer Science · Computer Science 2025-11-04 Junli Jiang , Pavel Naumov , Wenxuan Zhang

Although research has produced promising results demonstrating the utility of active inference (AIF) in Markov decision processes (MDPs), there is relatively less work that builds AIF models in the context of environments and problems that…

Robotics · Computer Science 2024-09-24 Viet Dung Nguyen , Zhizhuo Yang , Christopher L. Buckley , Alexander Ororbia

Although dynamic games provide a rich paradigm for modeling agents' interactions, solving these games for real-world applications is often challenging. Many real-world interactive settings involve general nonlinear state and input…

Robotics · Computer Science 2023-08-08 Maulik Bhatt , Yixuan Jia , Negar Mehr

Under what circumstances can a system be said to have beliefs and goals, and how do such agency-related features relate to its physical state? Recent work has proposed a notion of interpretation map, a function that maps the state of a…

Artificial Intelligence · Computer Science 2025-07-14 Martin Biehl , Nathaniel Virgo

Noisy sensing, imperfect control, and environment changes are defining characteristics of many real-world robot tasks. The partially observable Markov decision process (POMDP) provides a principled mathematical framework for modeling and…

Robotics · Computer Science 2022-09-22 Mikko Lauri , David Hsu , Joni Pajarinen

Trust in autonomy is essential for effective human-robot collaboration and user adoption of autonomous systems such as robot assistants. This paper introduces a computational model which integrates trust into robot decision-making.…

Robotics · Computer Science 2018-11-26 Min Chen , Stefanos Nikolaidis , Harold Soh , David Hsu , Siddhartha Srinivasa

Stochastic optimal control and games have a wide range of applications, from finance and economics to social sciences, robotics, and energy management. Many real-world applications involve complex models that have driven the development of…

Optimization and Control · Mathematics 2024-03-12 Ruimeng Hu , Mathieu Laurière

Within the context of video games the notion of perfectly rational agents can be undesirable as it leads to uninteresting situations, where humans face tough adversarial decision makers. Current frameworks for stochastic games and…

Artificial Intelligence · Computer Science 2019-01-09 Jordi Grau-Moya , Felix Leibfried , Haitham Bou-Ammar

Motivated by the recent applications of game-theoretical learning techniques to the design of distributed control systems, we study a class of control problems that can be formulated as potential games with continuous action sets, and we…

Optimization and Control · Mathematics 2014-12-03 Steven Perkins , Panayotis Mertikopoulos , David S. Leslie

A central question in multi-agent strategic games deals with learning the underlying utilities driving the agents' behaviour. Motivated by the increasing availability of large data-sets, we develop an unifying data-driven technique to…

Optimization and Control · Mathematics 2024-05-27 Anna M. Maddux , Nicolò Pagan , Giuseppe Belgioioso , Florian Dörfler

We consider a finite horizon dynamic game with two players who observe their types privately and take actions, which are publicly observed. Players' types evolve as independent, controlled linear Gaussian processes and players incur…

Computer Science and Game Theory · Computer Science 2016-06-17 Deepanshu Vasal , Achilleas Anastasopoulos

The ability to accurately predict others' behavior is central to the safety and efficiency of interactive robotics. Unfortunately, robots often lack access to key information on which these predictions may hinge, such as other agents'…

Robotics · Computer Science 2023-11-02 Haimin Hu , David Isele , Sangjae Bae , Jaime F. Fisac

Autonomous vehicles (AVs) need to interact with other traffic participants who can be either cooperative or aggressive, attentive or inattentive. Such different characteristics can lead to quite different interactive behaviors. Hence, to…

Robotics · Computer Science 2021-01-18 Jinning Li , Liting Sun , Wei Zhan , Masayoshi Tomizuka