English
Related papers

Related papers: Ergodic Control Strategy for Multi-Agent Environme…

200 papers

Traditional methods plan feasible paths for multiple agents in the stochastic environment. However, the methods' iterations with the changes in the environment result in computation complexities, especially for the decentralized agents…

Robotics · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen , Jinhu Lü

Ergodic Optimization is the process of finding invariant probability measures that maximize the integral of a given function. It has been conjectured that "most" functions are optimized by measures supported on a periodic orbit, and it has…

Dynamical Systems · Mathematics 2015-03-17 Anthony Quas , Jason Siefken

We study the emergence of cooperative behaviors in reinforcement learning agents by introducing a challenging competitive multi-agent soccer environment with continuous simulated physics. We demonstrate that decentralized, population-based…

Artificial Intelligence · Computer Science 2021-05-21 Siqi Liu , Guy Lever , Josh Merel , Saran Tunyasuvunakool , Nicolas Heess , Thore Graepel

Self-organized criticality (SOC) is widely proposed as a fundamental mechanism for collective behavior, yet its role in objective-driven, heterogeneous adaptive systems underpinning real complex systems remains less understood. We introduce…

Adaptation and Self-Organizing Systems · Physics 2026-04-20 Nixie Sapphira Lesmana , Ling Feng , Kan Chen , Choy Heng Lai

The goal of this paper is to study a Mean Field Game (MFG) system stemming from the harvesting of resources. Modelling the latter through a reaction-diffusion equation and the harvesters as competing rational agents, we are led to a…

Analysis of PDEs · Mathematics 2024-06-11 Ziad Kobeissi , Idriss Mazari-Fouquer , Domènec Ruiz-Balet

In any Markov chain Monte Carlo analysis, rapid convergence of the chain to its target probability distribution is of practical and theoretical importance. A chain that converges at a geometric rate is geometrically ergodic. In this paper,…

Computation · Statistics 2012-10-05 Alicia A. Johnson , Owen Burbank

In order to solve complex, long-horizon tasks, intelligent robots need to carry out high-level, abstract planning and reasoning in conjunction with motion planning. However, abstract models are typically lossy and plans or policies computed…

Artificial Intelligence · Computer Science 2020-06-02 Naman Shah , Deepak Kala Vasudevan , Kislay Kumar , Pranav Kamojjhala , Siddharth Srivastava

In several social choice problems, agents collectively make decisions over the allocation of multiple divisible and heterogeneous resources with capacity constraints to maximize utilitarian social welfare. The agents are constrained through…

Optimization and Control · Mathematics 2023-11-02 Syed Eqbal Alam , Fabian Wirth , Jia Yuan Yu , Robert Shorten

We present an algorithm to explore an orthogonal polygon using a team of $p$ robots. This algorithm combines ideas from information-theoretic exploration algorithms and computational geometry based exploration algorithms. We show that the…

Robotics · Computer Science 2020-04-16 Aravind Preshant Premkumar , Kevin Yu , Pratap Tokekar

We propose a distributed deployment solution for a group of mobile agents that should provide a service for a dense set of targets. The agents are heterogeneous in a sense that their quality of service (QoS), modeled as a spatial Gaussian…

Systems and Control · Electrical Eng. & Systems 2020-09-28 Yi-Fan Chung , Solmaz S. Kia

We consider the problem of dynamically allocating tasks to multiple agents under time window constraints and task completion uncertainty. Our objective is to minimize the number of unsuccessful tasks at the end of the operation horizon. We…

Robotics · Computer Science 2020-07-28 Shushman Choudhury , Jayesh K. Gupta , Mykel J. Kochenderfer , Dorsa Sadigh , Jeannette Bohg

We consider a model of nomadic agents exploring and competing for time-varying location-specific resources, arising in crowdsourced transportation services, online communities, and in traditional location based economic activity. This model…

Computer Science and Game Theory · Computer Science 2016-02-23 Pu Yang , Krishnamurthy Iyer , Peter Frazier

Precise coordinated planning over a forward time window enables safe and highly efficient motion when many robots must work together in tight spaces, but this would normally require centralised control of all devices which is difficult to…

Robotics · Computer Science 2023-01-27 Aalok Patwardhan , Riku Murai , Andrew J. Davison

In this paper, we present algorithms for synthesizing controllers to distribute a group (possibly swarms) of homogeneous robots (agents) over heterogeneous tasks which are operated in parallel. We present algorithms as well as analysis for…

Robotics · Computer Science 2021-06-28 Devesh K. Jha

We provide a probabilistic analysis of the banker algorithm when transition probabilities may depend on time and space. The transition probabilities evolve, as time goes by, along the trajectory of an ergodic Markovian environment, whereas…

Probability · Mathematics 2007-05-23 Francis Comets , Francois Delarue , Rene Schott

We consider a class of $N$-player games and mean-field games of singular controls with ergodic performance criterion, providing a benchmark case for irreversible investment games featuring mean-field interaction and strategic…

Optimization and Control · Mathematics 2025-04-30 Federico Cannerozzi , Giorgio Ferrari

In ergodic singular stochastic control problems, a decision-maker can instantaneously adjust the evolution of a state variable using a control of bounded variation, with the goal of minimizing a long-term average cost functional. The cost…

Optimization and Control · Mathematics 2025-10-14 Alessandro Calvia , Federico Cannerozzi , Giorgio Ferrari

Learning-based techniques are increasingly effective at controlling complex systems using data-driven models. However, most work done so far has focused on learning individual tasks or control laws. Hence, it is still a largely unaddressed…

Systems and Control · Electrical Eng. & Systems 2020-05-08 Alexandre Capone , Armin Lederer , Jonas Umlauft , Sandra Hirche

We introduce a novel distributed sampled-data control method tailored for heterogeneous multi-agent systems under a global spatio-temporal task with acyclic dependencies. Specifically, we consider the global task as a conjunction of…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Gregorio Marchesini , Siyuan Liu , Lars Lindemann , Dimos V. Dimarogonas

Spatial task allocation in systems such as multi-robot delivery or ride-sharing requires balancing efficiency with fair service across tasks. Greedy assignment policies that match each agent to its highest-preference or lowest-cost task can…

Multiagent Systems · Computer Science 2026-01-23 Yao Liu , Sampad Mohanty , Elizabeth Ondula , Bhaskar Krishnamachari