English
Related papers

Related papers: How to Exhibit More Predictable Behaviors

200 papers

Autonomous agents that drive on roads shared with human drivers must reason about the nuanced interactions among traffic participants. This poses a highly challenging decision making problem since human behavior is influenced by a multitude…

Robotics · Computer Science 2023-03-30 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

Partially observable stochastic games provide a rich mathematical paradigm for modeling multi-agent dynamic decision making under uncertainty and partial information. However, they generally do not admit closed-form solutions and are…

Optimization and Control · Mathematics 2020-04-15 Yanling Chang , Chelsea C. White

We present a method for active inference with partial observations in stochastic systems through incentive design, also known as the leader-follower game. Consider a leader agent who aims to infer a follower agent's type given a finite set…

Systems and Control · Electrical Eng. & Systems 2025-02-12 Xinyi Wei , Chongyang Shi , Shuo Han , Ahmed H. Hemida , Charles A. Kamhoua , Jie Fu

Although both data availability and the demand for accurate forecasts are increasing, collaboration between stakeholders is often constrained by data ownership and competitive interests. In contrast to recent proposals within cooperative…

Machine Learning · Computer Science 2026-05-14 Michael Vitali , Pierre Pinson

Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works, and then use this learned model to plan coordinated sequences of actions to bring about desired outcomes.…

Machine Learning · Computer Science 2020-01-01 Karl Schmeckpeper , Annie Xie , Oleh Rybkin , Stephen Tian , Kostas Daniilidis , Sergey Levine , Chelsea Finn

This paper investigates manipulation of multiple unknown objects in a crowded environment. Because of incomplete knowledge due to unknown objects and occlusions in visual observations, object observations are imperfect and action success is…

Robotics · Computer Science 2014-07-09 Joni Pajarinen , Ville Kyrki

In standard Reinforcement Learning (RL) settings, the interaction between the agent and the environment is typically modeled as a Markov Decision Process (MDP), which assumes that the agent observes the system state instantaneously, selects…

Machine Learning · Computer Science 2025-06-18 John Wikman , Alexandre Proutiere , David Broman

We consider the multi-agent reinforcement learning setting with imperfect information in which each agent is trying to maximize its own utility. The reward function depends on the hidden state (or goal) of both agents, so the agents must…

Artificial Intelligence · Computer Science 2018-03-28 Roberta Raileanu , Emily Denton , Arthur Szlam , Rob Fergus

We consider a setting where one has to organize one or several group activities for a set of agents. Each agent will participate in at most one activity, and her preferences over activities depend on the number of participants in the…

Computer Science and Game Theory · Computer Science 2014-02-03 Andreas Darmann , Edith Elkind , Sascha Kurz , Jérôme Lang , Joachim Schauer , Gerhard Woeginger

Present bias, the tendency to overvalue immediate rewards while undervaluing future ones, is a well-known barrier to achieving long-term goals. As artificial intelligence and behavioral economics increasingly focus on this phenomenon, the…

Computer Science and Game Theory · Computer Science 2024-09-18 Yasunori Akagi , Hideaki Kim , Takeshi Kurashima

Markov Decision Process (MDP) presents a mathematical framework to formulate the learning processes of agents in reinforcement learning. MDP is limited by the Markovian assumption that a reward only depends on the immediate state and…

Machine Learning · Computer Science 2024-06-04 Bohao Qu , Xiaofeng Cao , Jielong Yang , Hechang Chen , Chang Yi , Ivor W. Tsang , Yew-Soon Ong

Partially Observable Markov Decision Process (POMDP) is a framework applicable to many real world problems. In this work, we propose an approach to solve POMDPs with multimodal belief by relying on a policy that solves the fully observable…

Machine Learning · Computer Science 2022-07-26 András Attila Sulyok , Kristóf Karacs

Information gathering while interacting with other agents under sensing and motion uncertainty is critical in domains such as driving, service robots, racing, or surveillance. The interests of agents may be at odds with others, resulting in…

Robotics · Computer Science 2021-05-14 Wilko Schwarting , Alyssa Pierson , Sertac Karaman , Daniela Rus

General purpose intelligent learning agents cycle through (complex,non-MDP) sequences of observations, actions, and rewards. On the other hand, reinforcement learning is well-developed for small finite state Markov Decision Processes…

Artificial Intelligence · Computer Science 2009-12-30 Marcus Hutter

We examine the tuning of cooperative behavior in repeated multi-agent games using an analytically tractable, continuous-time, nonlinear model of opinion dynamics. Each modeled agent updates its real-valued opinion about each available…

Physics and Society · Physics 2021-11-24 Shinkyu Park , Anastasia Bizyaeva , Mari Kawakatsu , Alessio Franci , Naomi Ehrich Leonard

Deciding which sensing capabilities to deploy on an agent in uncertain domains is a fundamental engineering challenge, in which one balances task achievability against the high costs of hardware and processing. This problem has previously…

Artificial Intelligence · Computer Science 2026-05-22 Adrian Zvizdenco , Arthur Conrado Veiga Bosquetti , Alberto Lluch Lafuente , Christoph Matheja

We analyze the dynamics of a forecasting game which exhibits the phenomenon of information cascades. Each agent aims at correctly predicting a binary variable and he/she can either look for independent information or herd on the choice of…

Trading and Market Microstructure · Quantitative Finance 2009-11-13 A. Veglio , M. Marsili

Multi-agent trajectory forecasting in autonomous driving requires an agent to accurately anticipate the behaviors of the surrounding vehicles and pedestrians, for safe and reliable decision-making. Due to partial observability in these…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Seong Hyeon Park , Gyubok Lee , Manoj Bhat , Jimin Seo , Minseok Kang , Jonathan Francis , Ashwin R. Jadhav , Paul Pu Liang , Louis-Philippe Morency

Reinforcement learning is commonly concerned with problems of maximizing accumulated rewards in Markov decision processes. Oftentimes, a certain goal state or a subset of the state space attain maximal reward. In such a case, the…

Artificial Intelligence · Computer Science 2024-08-23 Pavel Osinenko , Grigory Yaremenko , Georgiy Malaniya , Anton Bolychev , Alexander Gepperth

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

Machine Learning · Computer Science 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun