English
Related papers

Related papers: Partially Observable Stochastic Games with Neural …

200 papers

Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural…

Computational Complexity · Computer Science 2022-07-21 Tobias Winkler , Maximilian Weininger

This paper extends the framework of partially observable Markov decision processes (POMDPs) to multi-agent settings by incorporating the notion of agent models into the state space. Agents maintain beliefs over physical states of the…

Artificial Intelligence · Computer Science 2011-09-13 P. Doshi , P. J. Gmytrasiewicz

Learning in games provides a powerful framework to design control policies for self-interested agents that may be coupled through their dynamics, costs, or constraints. We consider the case where the dynamics of the coupled system can be…

Systems and Control · Electrical Eng. & Systems 2024-09-18 Mostafa M. Shibl , Vijay Gupta

Simple Stochastic Games (SSGs) were introduced by Anne Condon in 1990, as the simplest version of Stochastic Games for which there is no known polynomial-time algorithm. Condon showed that Stochastic Games are polynomial-time reducible to…

Computational Complexity · Computer Science 2024-02-06 Avi Rudich , Isaac Rudich , Rachel Rue

In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their…

Optimization and Control · Mathematics 2024-06-18 Gokce Dayanikli , Mathieu Lauriere

This paper proposes an online learning method of Gaussian process state-space model (GP-SSM). GP-SSM is a probabilistic representation learning scheme that represents unknown state transition and/or measurement models as Gaussian processes…

Robotics · Computer Science 2024-10-30 Soon-Seo Park , Young-Jin Park , Youngjae Min , Han-Lim Choi

Game theory is playing more and more important roles in understanding complex systems and in investigating intelligent machines with various uncertainties. As a starting point, we consider the classical two-player zero-sum linear-quadratic…

Optimization and Control · Mathematics 2022-04-20 Nian Liu , Lei Guo

Probabilistic model checking for stochastic games enables formal verification of systems that comprise competing or collaborating entities operating in a stochastic environment. Despite good progress in the area, existing approaches focus…

Logic in Computer Science · Computer Science 2019-07-09 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos

Trajectory planning involving multi-agent interactions has been a long-standing challenge in the field of robotics, primarily burdened by the inherent yet intricate interactions among agents. While game-theoretic methods are widely…

Robotics · Computer Science 2025-07-17 Zhenmin Huang , Yusen Xie , Benshan Ma , Shaojie Shen , Jun Ma

In this article, we introduce a neuro-symbolic approach that combines a low-level perception task performed by a neural network with a high-level reasoning task performed by a possibilistic rule-based system. The goal is to be able to…

Artificial Intelligence · Computer Science 2025-04-10 Ismaïl Baaj , Pierre Marquis

Normal-form games (NFGs) are the fundamental model of strategic interaction. We study their representation using neural networks. We describe the inherent equivariance of NFGs -- any permutation of strategies describes an equivalent game --…

Computer Science and Game Theory · Computer Science 2024-02-14 Siqi Liu , Luke Marris , Georgios Piliouras , Ian Gemp , Nicolas Heess

The state of the art in solving nonconvex nonsmooth games under uncertainty remains in its infancy. Existing studies primarily rely on stringent growth conditions or local convexity-like properties, making the development of alternative…

Optimization and Control · Mathematics 2026-03-09 Zhuoyu Xiao

This work presents a novel policy iteration algorithm to tackle nonzero-sum stochastic impulse games arising naturally in many applications. Despite the obvious impact of solving such problems, there are no suitable numerical methods…

Optimization and Control · Mathematics 2020-06-29 René Aïd , Francisco Bernal , Mohamed Mnif , Diego Zabaljauregui , Jorge P. Zubelli

Optimizing with group sparsity is significant in enhancing model interpretability in machining learning applications, e.g., feature selection, compressed sensing and model compression. However, for large-scale stochastic training problems,…

Optimization and Control · Mathematics 2021-02-16 Tianyi Chen , Guanyi Wang , Tianyu Ding , Bo Ji , Sheng Yi , Zhihui Zhu

Securing networked infrastructures is important in the real world. The problem of deploying security resources to protect against an attacker in networked domains can be modeled as Network Security Games (NSGs). Unfortunately, existing…

Artificial Intelligence · Computer Science 2021-06-03 Wanqi Xue , Youzhi Zhang , Shuxin Li , Xinrun Wang , Bo An , Chai Kiat Yeo

In imperfect-information games, agents must make decisions based on partial knowledge of the game state. The Belief Stochastic Game model addresses this challenge by delegating state estimation to the game model itself. This allows agents…

Artificial Intelligence · Computer Science 2025-08-20 Achille Morenville , Éric Piette

Mean field game theory studies the behavior of a large number of interacting individuals in a game theoretic setting and has received a lot of attention in the past decade (Lasry and Lions, Japanese journal of mathematics, 2007). In this…

Optimization and Control · Mathematics 2019-10-31 Martin Frank , Michael Herty , Torsten Trimborn

Decision-making for autonomous driving is challenging, considering the complex interactions among multiple traffic agents (e.g., autonomous vehicles (AVs), human drivers, and pedestrians) and the computational load needed to evaluate these…

Systems and Control · Electrical Eng. & Systems 2023-11-13 Mushuang Liu , Ilya Kolmanovsky , H. Eric Tseng , Suzhou Huang , Dimitar Filev , Anouck Girard

This paper introduces a class of continuous-time, finite-player stochastic general-sum differential games that admit solutions through an exact linear PDE system. We formulate a distribution planning game utilizing the cross-log-likelihood…

Optimization and Control · Mathematics 2026-04-10 Monika Tomar , Takashi Tanaka

In this paper, we tackle the problem of transferring policy from multiple partially observable source environments to a partially observable target environment modeled as predictive state representation. This is an entirely new approach…

Machine Learning · Computer Science 2017-02-09 Sri Ramana Sekharan , Ramkumar Natarajan , Siddharthan Rajasekaran