English
Related papers

Related papers: Learning Cooperation and Online Planning Through S…

200 papers

Effective decision-making in autonomous driving relies on accurate inference of other traffic agents' future behaviors. To achieve this, we propose an online belief-update-based behavior prediction model and an efficient planner for…

Robotics · Computer Science 2024-06-19 Zhiyu Huang , Chen Tang , Chen Lv , Masayoshi Tomizuka , Wei Zhan

We present a new model-based reinforcement learning algorithm, Cooperative Prioritized Sweeping, for efficient learning in multi-agent Markov decision processes. The algorithm allows for sample-efficient learning on large problems by…

Machine Learning · Computer Science 2020-01-22 Eugenio Bargiacchi , Timothy Verstraeten , Diederik M. Roijers , Ann Nowé

Lazy graph search algorithms are efficient at solving motion planning problems where edge evaluation is the computational bottleneck. These algorithms work by lazily computing the shortest potentially feasible path, evaluating edges along…

Robotics · Computer Science 2021-10-12 Mohak Bhardwaj , Sanjiban Choudhury , Byron Boots , Siddhartha Srinivasa

Devising intelligent robots or agents that interact with humans is a major challenge for artificial intelligence. In such contexts, agents must constantly adapt their decisions according to human activities and modify their goals. In this…

Artificial Intelligence · Computer Science 2018-10-26 Damien Pellier , Mickaël Vanneufville , Humbert Fiorino , Marc Métivier , Bruno Bouzy

This work tackles the problem of robust zero-shot planning in non-stationary stochastic environments. We study Markov Decision Processes (MDPs) evolving over time and consider Model-Based Reinforcement Learning algorithms in this setting.…

Machine Learning · Computer Science 2020-01-16 Erwan Lecarpentier , Emmanuel Rachelson

Modern large-scale computing deployments consist of complex applications running over machine clusters. An important issue in these is the offering of elasticity, i.e., the dynamic allocation of resources to applications to meet fluctuating…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-13 Konstantinos Lolos , Ioannis Konstantinou , Verena Kantere , Nectarios Koziris

Simultaneous localization and Planning (SLAP) is a crucial ability for an autonomous robot operating under uncertainty. In its most general form, SLAP induces a continuous POMDP (partially-observable Markov decision process), which needs to…

In many real-world planning problems with factored, mixed discrete and continuous state and action spaces such as Reservoir Control, Heating Ventilation, and Air Conditioning, and Navigation domains, it is difficult to obtain a model of the…

Artificial Intelligence · Computer Science 2020-07-16 Ga Wu , Buser Say , Scott Sanner

We study the problem of offline imitation learning in Markov decision processes (MDPs), where the goal is to learn a well-performing policy given a dataset of state-action pairs generated by an expert policy. Complementing a recent line of…

Machine Learning · Computer Science 2026-01-09 Antoine Moulin , Gergely Neu , Luca Viano

Interactive partially observable Markov decision processes (I-POMDP) provide a formal framework for planning for a self-interested agent in multiagent settings. An agent operating in a multiagent environment must deliberate about the…

Multiagent Systems · Computer Science 2015-04-06 Ekhlas Sonu , Yingke Chen , Prashant Doshi

We consider online planning in Markov decision processes (MDPs). In online planning, the agent focuses on its current state only, deliberates about the set of possible policies from that state onwards and, when interrupted, uses the outcome…

Artificial Intelligence · Computer Science 2012-12-20 Zohar Feldman , Carmel Domshlak

This paper presents two new approaches to decomposing and solving large Markov decision problems (MDPs), a partial decoupling method and a complete decoupling method. In these approaches, a large, stochastic decision problem is divided into…

Artificial Intelligence · Computer Science 2013-02-01 Ron Parr

Decision making in multi-agent systems (MAS) is a great challenge due to enormous state and joint action spaces as well as uncertainty, making centralized control generally infeasible. Decentralized control offers better scalability and…

Artificial Intelligence · Computer Science 2019-01-28 Thomy Phan , Kyrill Schmid , Lenz Belzner , Thomas Gabor , Sebastian Feld , Claudia Linnhoff-Popien

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

Interpretable reinforcement learning policies are essential for high-stakes decision-making, yet optimizing decision tree policies in Markov Decision Processes (MDPs) remains challenging. We propose SPOT, a novel method for computing…

Machine Learning · Computer Science 2025-10-23 Xuyuan Xiong , Pedro Chumpitaz-Flores , Kaixun Hua , Cheng Hua

General-purpose agents require fine-grained controls and rich sensory inputs to perform a wide range of tasks. However, this complexity often leads to intractable decision-making. Traditionally, agents are provided with task-specific action…

Machine Learning · Computer Science 2024-06-25 Rafael Rodriguez-Sanchez , George Konidaris

In this paper, we propose a reinforcement learning algorithm to solve a multi-agent Markov decision process (MMDP). The goal, inspired by Blackwell's Approachability Theorem, is to lower the time average cost of each agent to below a…

Systems and Control · Electrical Eng. & Systems 2023-11-22 Keshav P. Keval , Vivek S. Borkar

Optimal decision making with limited or no information in stochastic environments where multiple agents interact is a challenging topic in the realm of artificial intelligence. Reinforcement learning (RL) is a popular approach for arriving…

Machine Learning · Computer Science 2019-01-08 Roi Ceren

For efficiency reasons, manycore systems are increasingly heterogeneous, which makes the mapping of complex workloads a key problem with a high optimization potential. Constraints express the application requirements like which core type to…

Multiagent Systems · Computer Science 2022-04-15 Volker Wenzel , Lars Bauer , Wolfgang Schröder-Preikschat , Jörg Henkel

Motivated by the recent discovery of a statistical and computational reduction from contextual bandits to offline regression (Simchi-Levi and Xu, 2021), we address the general (stochastic) Contextual Markov Decision Process (CMDP) problem…

Machine Learning · Computer Science 2024-05-29 Jian Qian , Haichen Hu , David Simchi-Levi