English
Related papers

Related papers: DreamControl-v2: Simpler and Scalable Autonomous H…

200 papers

Reinforcement Learning (RL) is increasingly used in autonomous driving (AD) and shows clear advantages. However, most RL-based AD methods overlook policy structure design. An RL policy that only outputs short-timescale vehicle control…

Robotics · Computer Science 2025-11-25 Guizhe Jin , Zhuoren Li , Bo Leng , Ran Yu , Lu Xiong , Chen Sun

We present a novel approach named OmniControl for incorporating flexible spatial control signals into a text-conditioned human motion generation model based on the diffusion process. Unlike previous methods that can only control the pelvis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yiming Xie , Varun Jampani , Lei Zhong , Deqing Sun , Huaizu Jiang

There has been substantial progress in humanoid robots, with new skills continuously being taught, ranging from navigation to manipulation. While these abilities may seem impressive, the teaching methods often remain inefficient. To enhance…

Robotics · Computer Science 2025-01-29 Josua Spisak , Matthias Kerzel , Stefan Wermter

Traditional approaches to quadruped control frequently employ simplified, hand-derived models. This significantly reduces the capability of the robot since its effective kinematic range is curtailed. In addition, kinodynamic constraints are…

Learning an accurate model of the environment is essential for model-based control tasks. Existing methods in robotic visuomotor control usually learn from data with heavily labelled actions, object entities or locations, which can be…

Robotics · Computer Science 2021-07-27 Haoqi Yuan , Ruihai Wu , Andrew Zhao , Haipeng Zhang , Zihan Ding , Hao Dong

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

We introduce Distribution Contractive Reinforcement Learning (DICE-RL), a framework that uses reinforcement learning (RL) as a "distribution contraction" operator to refine pretrained generative robot policies. DICE-RL turns a pretrained…

Robotics · Computer Science 2026-03-12 Zhanyi Sun , Shuran Song

High-level autonomous driving requires motion planners capable of modeling multimodal future uncertainties while remaining robust in closed-loop interactions. Although diffusion-based planners are effective at modeling complex trajectory…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hao Gao , Shaoyu Chen , Yifan Zhu , Yuehao Song , Wenyu Liu , Qian Zhang , Xinggang Wang

Autonomous drone racing has risen as a challenging robotic benchmark for testing the limits of learning, perception, planning, and control. Expert human pilots are able to fly a drone through a race track by mapping pixels from a single…

Robotics · Computer Science 2026-04-13 Angel Romero , Ashwin Shenai , Ismail Geles , Elie Aljalbout , Davide Scaramuzza

The rapid advancement of humanoid robotics has intensified the need for robust and adaptable controllers to enable stable and efficient locomotion across diverse platforms. However, developing such controllers remains a significant…

Robotics · Computer Science 2025-12-02 Yunfeng Lin , Minghuan Liu , Yufei Xue , Ming Zhou , Yong Yu , Jiangmiao Pang , Weinan Zhang

Autonomous Underwater Vehicles (AUVs) are indispensable for marine exploration; yet, their control is hindered by nonlinear hydrodynamics, time-varying disturbances, and localization uncertainty. Traditional controllers provide only limited…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Jingzehua Xu , Weiyi Liu , Weihang Zhang , Zhuofan Xi , Guanwen Xie , Shuai Zhang , Yi Li

Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Nithin Gopalakrishnan Nair , Vishal M Patel

Nonprehensile manipulation, such as pushing objects across cluttered environments, presents a challenging control problem due to complex contact dynamics and long-horizon planning requirements. In this work, we propose HeRD, a hierarchical…

Robotics · Computer Science 2025-12-12 Steven Caro , Stephen L. Smith

Generative control policies have recently unlocked major progress in robotics. These methods produce action sequences via diffusion or flow matching, with training data provided by demonstrations. But existing methods come with two key…

Robotics · Computer Science 2026-03-09 Vince Kurtz , Joel W. Burdick

Dexterous manipulation with anthropomorphic robot hands remains a challenging problem in robotics because of the high-dimensional state and action spaces and complex contacts. Nevertheless, skillful closed-loop manipulation is required to…

Robotics · Computer Science 2022-12-06 Malte Mosbach , Kara Moraw , Sven Behnke

Predicting human motion plays a crucial role in ensuring a safe and effective human-robot close collaboration in intelligent remanufacturing systems of the future. Existing works can be categorized into two groups: those focusing on…

Robotics · Computer Science 2023-08-01 Sibo Tian , Minghui Zheng , Xiao Liang

Developing robot controllers capable of achieving dexterous nonprehensile manipulation, such as pushing an object on a table, is challenging. The underactuated and hybrid-dynamics nature of the problem, further complicated by the…

Robotics · Computer Science 2023-08-07 Juan Del Aguila Ferrandis , João Moura , Sethu Vijayakumar

Diffusion strategies have advanced visual motor control by progressively denoising high-dimensional action sequences, providing a promising method for robot manipulation. However, as task complexity increases, the success rate of existing…

Robotics · Computer Science 2026-01-21 Weize Xie , Yi Ding , Ying He , Leilei Wang , Binwen Bai , Zheyi Zhao , Chenyang Wang , F. Richard Yu

This paper investigates the application of Deep Reinforcement (DRL) Learning to address motion control challenges in drones for additive manufacturing (AM). Drone-based additive manufacturing promises flexible and autonomous material…

Robotics · Computer Science 2025-04-15 Gaurav Shetty , Mahya Ramezani , Hamed Habibi , Holger Voos , Jose Luis Sanchez-Lopez

Accurate modeling of robot dynamics is essential for model-based control, yet remains challenging under distributional shifts and real-time constraints. In this work, we formulate system identification as an in-context meta-learning problem…

Machine Learning · Computer Science 2026-04-21 Angelo Moroncelli , Matteo Rufolo , Gunes Cagin Aydin , Asad Ali Shahid , Loris Roveda