English
Related papers

Related papers: Conformal Off-Policy Prediction for Multi-Agent Sy…

200 papers

Offline reinforcement learning provides a viable approach to obtain advanced control strategies for dynamical systems, in particular when direct interaction with the environment is not available. In this paper, we introduce a conceptual…

Machine Learning · Computer Science 2024-01-04 Marc Weber , Phillip Swazinna , Daniel Hein , Steffen Udluft , Volkmar Sterzing

Multi-agent path planning (MAPP) is the problem of planning collision-free trajectories from start to goal locations for a team of agents. This work explores a relatively unexplored setting of MAPP where streams of agents have to go through…

Multiagent Systems · Computer Science 2023-06-30 Kazumi Kasaura , Ryo Yonetani , Mai Nishimura

Population protocols are a distributed computation model in which a collection of anonymous, finite-state agents interact in randomly chosen pairs and update their states according to a fixed transition function. The computation is defined…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Michael Blondin , Michaël Cadilhac , Benjamin Courchesne , Lucie Guillou , Corto Mascle , Isa Vialard

The Off-Policy Evaluation (OPE) problem consists of evaluating the performance of counterfactual policies with data collected by another one. To solve the OPE problem, we resort to estimators, which aim to estimate in the most accurate way…

Machine Learning · Computer Science 2024-11-12 Nicolò Felicioni , Michael Benigni , Maurizio Ferrari Dacrema

Policy-based methods have achieved remarkable success in solving challenging reinforcement learning problems. Among these methods, off-policy policy gradient methods are particularly important due to that they can benefit from off-policy…

Machine Learning · Computer Science 2024-05-07 Wenjia Meng , Qian Zheng , Long Yang , Yilong Yin , Gang Pan

Rigorous uncertainty quantification is essential for the safe deployment of autonomous systems in unconstrained environments. Conformal Prediction (CP) provides a distribution-free framework for this task, yet its standard formulations rely…

Machine Learning · Computer Science 2026-05-14 Renukanandan Tumu , Aditya Singh , Rahul Mangharam

In real-world problems, uncertainties (e.g., errors in the measurement, precision errors) often lead to poor performance of numerical algorithms when not explicitly taken into account. This is also the case for control problems, where…

Optimization and Control · Mathematics 2020-12-18 Carlos Ignacio Hernández Castellanos , Sina Ober-Blöbaum , Sebastian Peitz

Conformal prediction can be used to construct prediction sets that cover the true outcome with a desired probability, but can sometimes lead to large prediction sets that are costly in practice. The most useful outcome is a singleton…

Machine Learning · Statistics 2026-02-05 Tao Wang , Yan Sun , Edgar Dobriban

Stochastic Human Trajectory Prediction (HTP) using generative modeling has emerged as a significant area of research. Although state-of-the-art models excel in optimizing the accuracy of individual agents, they often struggle to generate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Qingze Liu , Alen Mrdovic , Danrui Li , Mathew Schwartz , Sejong Yoon , Mubbasir Kapadia

In this paper, we propose a distributed off-policy actor critic method to solve multi-agent reinforcement learning problems. Specifically, we assume that all agents keep local estimates of the global optimal policy parameter and update…

Machine Learning · Computer Science 2019-03-25 Yan Zhang , Michael M. Zavlanos

Off-policy Evaluation (OPE) methods are crucial tools for evaluating policies in high-stakes domains such as healthcare, where direct deployment is often infeasible, unethical, or expensive. When deployment environments are expected to…

Machine Learning · Computer Science 2022-09-20 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

Partially observable Markov decision processes (POMDPs) form a prominent model for uncertainty in sequential decision making. We are interested in constructing algorithms with theoretical guarantees to determine whether the agent has a…

Artificial Intelligence · Computer Science 2024-12-17 Marius Belly , Nathanaël Fijalkow , Hugo Gimbert , Florian Horn , Guillermo A. Pérez , Pierre Vandenhove

We consider off-policy evaluation (OPE), which evaluates the performance of a new policy from observed data collected from previous experiments, without requiring the execution of the new policy. This finds important applications in areas…

Machine Learning · Computer Science 2020-08-18 Yihao Feng , Tongzheng Ren , Ziyang Tang , Qiang Liu

Reliable multi-agent trajectory prediction is crucial for the safe planning and control of autonomous systems. Compared with single-agent cases, the major challenge in simultaneously processing multiple agents lies in modeling complex…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dekai Zhu , Guangyao Zhai , Yan Di , Fabian Manhardt , Hendrik Berkemeyer , Tuan Tran , Nassir Navab , Federico Tombari , Benjamin Busam

Game theory serves as a powerful tool for distributed optimization in multi-agent systems in different applications. In this paper we consider multi-agent systems that can be modeled by means of potential games whose potential function…

Optimization and Control · Mathematics 2018-04-13 Tatiana Tatarenko

Autonomous vehicle software is typically structured as a modular pipeline of individual components (e.g., perception, prediction, and planning) to help separate concerns into interpretable sub-tasks. Even when end-to-end training is…

Machine Learning · Computer Science 2022-04-29 Rowan McAllister , Blake Wulfe , Jean Mercat , Logan Ellis , Sergey Levine , Adrien Gaidon

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

Signal Processing · Electrical Eng. & Systems 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone

Temporally extended actions improve the ability to explore and plan in single-agent settings. In multi-agent settings, the exponential growth of the joint state space with the number of agents makes coordinated behaviours even more…

Machine Learning · Computer Science 2026-04-21 Raul D. Steleac , Mohan Sridharan , David Abel

Off-policy evaluation (OPE) is the problem of estimating the value of a target policy from samples obtained via different policies. Recently, applying OPE methods for bandit problems has garnered attention. For the theoretical guarantees of…

Machine Learning · Computer Science 2020-10-26 Masahiro Kato , Kenshi Abe , Kaito Ariu , Shota Yasui

Coordination among connected and autonomous vehicles (CAVs) is advancing due to developments in control and communication technologies. However, much of the current work is based on oversimplified and unrealistic task-specific assumptions,…

Multiagent Systems · Computer Science 2024-10-25 Rui Du , Kai Zhao , Jinlong Hou , Qiang Zhang , Peter Zhang