English
Related papers

Related papers: CHDP: Cooperative Hybrid Diffusion Policies for Re…

200 papers

Collaborative 3D object detection holds significant importance in the field of autonomous driving, as it greatly enhances the perception capabilities of each individual agent by facilitating information exchange among multiple agents.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Zhe Huang , Shuo Wang , Yongcai Wang , Lei Wang

Markov Decision Process (MDP) presents a mathematical framework to formulate the learning processes of agents in reinforcement learning. MDP is limited by the Markovian assumption that a reward only depends on the immediate state and…

Machine Learning · Computer Science 2024-06-04 Bohao Qu , Xiaofeng Cao , Jielong Yang , Hechang Chen , Chang Yi , Ivor W. Tsang , Yew-Soon Ong

We present an algorithm for obtaining an optimal control policy for hybrid dynamical systems in cluttered environments. To the best of our knowledge, this is the first attempt to have a locally optimal solution for this specific problem…

Robotics · Computer Science 2017-10-17 Shushman Choudhury , Yifan Hou , Gilwoo Lee , Siddhartha S. Srinivasa

As a robot senses and selects actions, the world keeps changing. This inference delay creates a gap of tens to hundreds of milliseconds between the observed state and the state at execution. In this work, we take the natural generalization…

Robotics · Computer Science 2026-03-25 Aileen Liao , Dong-Ki Kim , Max Olan Smith , Ali-akbar Agha-mohammadi , Shayegan Omidshafiei

Achieving mission objectives in a realistic simulation of aerial combat is highly challenging due to imperfect situational awareness and nonlinear flight dynamics. In this work, we introduce a novel 3D multi-agent air combat environment and…

Robotics · Computer Science 2025-10-23 Ardian Selmonaj , Giacomo Del Rio , Adrian Schneider , Alessandro Antonucci

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

Discrete-continuous hybrid action space is a natural setting in many practical problems, such as robot control and game AI. However, most previous Reinforcement Learning (RL) works only demonstrate the success in controlling with either…

Machine Learning · Computer Science 2022-03-17 Boyan Li , Hongyao Tang , Yan Zheng , Jianye Hao , Pengyi Li , Zhen Wang , Zhaopeng Meng , Li Wang

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

Robotics · Computer Science 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

This paper presents a comparative analysis of discrete and continuous action spaces within the contexts of reservoir management and inventory control problems. We explore the computational trade-offs between discrete action discretizations…

Optimization and Control · Mathematics 2025-11-05 Sravani Boddepalli , Prathamesh Kothavale

Many real-world control problems involve both discrete decision variables - such as the choice of control modes, gear switching or digital outputs - as well as continuous decision variables - such as velocity setpoints, control gains or…

The research of extending deep reinforcement learning (drl) to multi-agent field has solved many complicated problems and made great achievements. However, almost all these studies only focus on discrete or continuous action space and there…

Machine Learning · Computer Science 2022-09-01 Hongzhi Hua , Guixuan Wen , Kaigui Wu

We study reinforcement learning for controlled diffusion processes with unbounded continuous state spaces, bounded continuous actions, and polynomially growing rewards: settings that arise naturally in finance, economics, and operations…

Machine Learning · Computer Science 2025-12-18 Hanqing Jin , Renyuan Xu , Yanzhao Yang

We tackle the problem of generalization to unseen configurations for dynamic tasks in the real world while learning from high-dimensional image input. The family of nonlinear dynamical system-based methods have successfully demonstrated…

Machine Learning · Computer Science 2021-07-13 Shikhar Bahl , Abhinav Gupta , Deepak Pathak

Although many real-world stochastic planning problems are more naturally formulated by hybrid models with both discrete and continuous variables, current state-of-the-art methods cannot adequately address these problems. We present the…

Artificial Intelligence · Computer Science 2012-07-19 Carlos E. Guestrin , Milos Hauskrecht , Branislav Kveton

While imitation learning provides a simple and effective framework for policy learning, acquiring consistent actions during robot execution remains a challenging task. Existing approaches primarily focus on either modifying the action…

Robotics · Computer Science 2024-07-24 Xiao Liu , Fabian Weigend , Yifan Zhou , Heni Ben Amor

We present AnchorDP3, a diffusion policy framework for dual-arm robotic manipulation that achieves state-of-the-art performance in highly randomized environments. AnchorDP3 integrates three key innovations: (1) Simulator-Supervised Semantic…

Robotics · Computer Science 2025-06-26 Ziyan Zhao , Ke Fan , He-Yang Xu , Ning Qiao , Bo Peng , Wenlong Gao , Dongjiang Li , Hui Shen

Contact-rich assembly is fundamental in robotics but poses significant challenges due to uncertainties in relative poses, such as misalignments and small clearances in peg-in-hole tasks. Existing approaches typically address search and…

Imitation learning powered by generative models has proven effective for modeling complex single-agent behaviors. However, teaching multi-agent systems, like multiple arms or vehicles, to coordinate through imitation learning is hindered by…

Robotics · Computer Science 2026-05-18 Lasse Peters , Laura Ferranti , Andrea Bajcsy , Javier Alonso-Mora

Trajectory optimization is a fundamental problem in robotics. While optimization of continuous control trajectories is well developed, many applications require both discrete and continuous, i.e., hybrid, controls. Finding an optimal…

Robotics · Computer Science 2017-03-03 Joni Pajarinen , Ville Kyrki , Michael Koval , Siddhartha Srinivasa , Jan Peters , Gerhard Neumann