English
Related papers

Related papers: CODA: Coordination via On-Policy Diffusion for Mul…

200 papers

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

Multi-objective Reinforcement Learning (MORL) seeks to develop policies that simultaneously optimize multiple conflicting objectives, but it requires extensive online interactions. Offline MORL provides a promising solution by training on…

Machine Learning · Computer Science 2025-05-28 Yifu Yuan , Zhenrui Zheng , Zibin Dong , Jianye Hao

In recent years, advances in underwater networking and multi-agent reinforcement learning (MARL) have significantly expanded multi-autonomous underwater vehicle (AUV) applications in marine exploration and target tracking. However, current…

Networking and Internet Architecture · Computer Science 2026-04-01 Jiaao Ma , Chuan Lin , Guangjie Han , Shengchao Zhu , Zhenyu Wang , Chen An

Multiagent reinforcement learning algorithms (MARL) have been demonstrated on complex tasks that require the coordination of a team of multiple agents to complete. Existing works have focused on sharing information between agents via…

Machine Learning · Computer Science 2019-03-18 Samir Wadhwania , Dong-Ki Kim , Shayegan Omidshafiei , Jonathan P. How

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

Decentralized combinatorial optimization in evolving multi-agent systems poses significant challenges, requiring agents to balance long-term decision-making, short-term optimized collective outcomes, while preserving autonomy of interactive…

Multiagent Systems · Computer Science 2025-09-23 Chuhao Qin , Evangelos Pournaras

Multi-agent systems require effective coordination between groups and individuals to achieve common goals. However, current multi-agent reinforcement learning (MARL) methods primarily focus on improving individual policies and do not…

Multiagent Systems · Computer Science 2023-07-31 Jingqing Ruan , Xiaotian Hao , Dong Li , Hangyu Mao

Offline multi-agent reinforcement learning (MARL) is increasingly recognized as crucial for effectively deploying RL algorithms in environments where real-time interaction is impractical, risky, or costly. In the offline setting, learning…

Machine Learning · Computer Science 2024-08-26 Jihwan Oh , Sungnyun Kim , Gahee Kim , Sunghwan Kim , Se-Young Yun

Offline reinforcement learning (RL) aims to learn policies from pre-existing datasets without further interactions, making it a challenging task. Q-learning algorithms struggle with extrapolation errors in offline settings, while supervised…

Artificial Intelligence · Computer Science 2025-01-03 Zhengbang Zhu , Minghuan Liu , Liyuan Mao , Bingyi Kang , Minkai Xu , Yong Yu , Stefano Ermon , Weinan Zhang

Enhancing diverse human decision-making processes in an urban environment is a critical issue across various applications, including ride-sharing vehicle dispatching, public transportation management, and autonomous driving. Offline…

Machine Learning · Computer Science 2024-06-21 Xinbo Zhao , Yingxue Zhang , Xin Zhang , Yu Yang , Yiqun Xie , Yanhua Li , Jun Luo

Cooperative multi-agent reinforcement learning (MARL) has made prominent progress in recent years. For training efficiency and scalability, most of the MARL algorithms make all agents share the same policy or value network. However, in many…

Machine Learning · Computer Science 2022-11-07 Mingyu Yang , Jian Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Connected and autonomous vehicles across land, water, and air must often operate in dynamic, unpredictable environments with limited communication, no centralized control, and partial observability. These real-world constraints pose…

Multiagent Systems · Computer Science 2025-11-18 Hung Du , Hy Nguyen , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

As robots become more integrated in society, their ability to coordinate with other robots and humans on multi-modal tasks (those with multiple valid solutions) is crucial. Such behaviors can be learned from expert demonstrations via…

Robotics · Computer Science 2026-05-15 Dayi Dong , Maulik Bhatt , Seoyeon Choi , Negar Mehr

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning credit to individual…

Machine Learning · Computer Science 2024-01-01 Ziyan Wang , Yali Du , Yudi Zhang , Meng Fang , Biwei Huang

Multi-agent reinforcement learning (MARL) provides a framework for problems involving multiple interacting agents. Despite apparent similarity to the single-agent case, multi-agent problems are often harder to train and analyze…

Machine Learning · Computer Science 2024-04-04 Michał Zawalski , Błażej Osiński , Henryk Michalewski , Piotr Miłoś

Drawing upon recent advances in language model alignment, we formulate offline Reinforcement Learning as a two-stage optimization problem: First pretraining expressive generative policies on reward-free behavior datasets, then fine-tuning…

Machine Learning · Computer Science 2024-10-31 Huayu Chen , Kaiwen Zheng , Hang Su , Jun Zhu

Offline multi-agent reinforcement learning (MARL) is an exciting direction of research that uses static datasets to find optimal control policies for multi-agent systems. Though the field is by definition data-driven, efforts have thus far…

Machine Learning · Computer Science 2024-09-19 Claude Formanek , Louise Beyers , Callum Rhys Tilbury , Jonathan P. Shock , Arnu Pretorius

Being difficult to scale poses great problems in multi-agent coordination. Multi-agent Reinforcement Learning (MARL) algorithms applied in small-scale multi-agent systems are hard to extend to large-scale ones because the latter is far more…

Artificial Intelligence · Computer Science 2022-02-22 Zixuan Cao , Mengzhi Shi , Zhanbo Zhao , Xiujun Ma

Recent advances in offline Reinforcement Learning (RL) have proven that effective policy learning can benefit from imposing conservative constraints on pre-collected datasets. However, such static datasets often exhibit distribution bias,…

Machine Learning · Computer Science 2026-05-15 Yunpeng Qing , Yixiao Chi , Shuo Chen , Shunyu Liu , Kexuan Zhou , Sixu Lin , Litao Liu , Changqing Zou