English
Related papers

Related papers: RPL: Learning Robust Humanoid Perceptive Locomotio…

200 papers

Legged robots can outperform wheeled machines for most navigation tasks across unknown and rough terrains. For such tasks, visual feedback is a fundamental asset to provide robots with terrain-awareness. However, robust dynamic locomotion…

Deep reinforcement learning (RL) has been shown to be effective in producing approximate solutions to some vehicle routing problems (VRPs), especially when using policies generated by encoder-decoder attention mechanisms. While these…

Machine Learning · Computer Science 2024-12-31 Joshua Levin , Randall Correll , Takanori Ide , Takafumi Suzuki , Saito Takaho , Alan Arai

This study presents an emotion-aware navigation framework -- EmoBipedNav -- using deep reinforcement learning (DRL) for bipedal robots walking in socially interactive environments. The inherent locomotion constraints of bipedal robots…

Robotics · Computer Science 2026-01-21 Wei Zhu , Abirath Raju , Abdulaziz Shamsah , Anqi Wu , Seth Hutchinson , Ye Zhao

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

Machine Learning · Computer Science 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu

Deployment in hazardous environments requires robots to understand the risks associated with their actions and movements to prevent accidents. Despite its importance, these risks are not explicitly modeled by currently deployed locomotion…

Robotics · Computer Science 2024-05-06 Lukas Schneider , Jonas Frey , Takahiro Miki , Marco Hutter

Legged robots are physically capable of traversing a wide range of challenging environments, but designing controllers that are sufficiently robust to handle this diversity has been a long-standing challenge in robotics. Reinforcement…

Robotics · Computer Science 2021-10-12 Laura Smith , J. Chase Kew , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Off-road autonomous driving poses significant challenges such as navigating unmapped, variable terrain with uncertain and diverse dynamics. Addressing these challenges requires effective long-horizon planning and adaptable control.…

All-weather autonomy is critical for autonomous driving, which necessitates reliable localization across diverse scenarios. While LiDAR place recognition is widely deployed for this task, its performance degrades in adverse weather.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zhangshuo Qi , Jingyi Xu , Luqi Cheng , Shichen Wen , Guangming Xiong

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

Machine Learning · Computer Science 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Perceptive locomotion for legged robots requires anticipating and adapting to complex, dynamic environments. Model Predictive Control (MPC) serves as a strong baseline, providing interpretable motion planning with constraint enforcement,…

Robotics · Computer Science 2026-03-17 Aditya Shirwatkar , Satyam Gupta , Shishir Kolathaya

Humanoid robots have demonstrated impressive motor skills in a wide range of tasks, yet whole-body control for humanlike long-time, dynamic fighting remains particularly challenging due to the stringent requirements on agility and…

Robotics · Computer Science 2026-04-24 Yucheng Xin , Jiacheng Bao , Yubo Dong , Xueqian Wang , Bin Zhao , Xuelong Li , Junbo Tan , Dong Wang

Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proximal Policy…

Robotics · Computer Science 2025-11-24 Yusuf Baran Ates , Omer Morgul

This study introduces a robust planning framework that utilizes a model predictive control (MPC) approach, enhanced by incorporating signal temporal logic (STL) specifications. This marks the first-ever study to apply STL-guided trajectory…

Robotics · Computer Science 2024-11-20 Zhaoyuan Gu , Yuntian Zhao , Yipu Chen , Rongming Guo , Jennifer K. Leestma , Gregory S. Sawicki , Ye Zhao

With the rapid development of embodied intelligence, locomotion control of quadruped robots on complex terrains has become a research hotspot. Unlike traditional locomotion control approaches focusing solely on velocity tracking, we pursue…

Robotics · Computer Science 2025-03-07 Xiangyu Miao , Jun Sun , Hang Lai , Xinpeng Di , Jiahang Cao , Yong Yu , Weinan Zhang

Sim-to-real reinforcement learning (RL) for humanoid robots with high-gear ratio actuators remains challenging due to complex actuator dynamics and the absence of torque sensors. To address this, we propose a novel RL framework leveraging…

Robotics · Computer Science 2025-04-14 Sotaro Katayama , Yuta Koda , Norio Nagatsuka , Masaya Kinoshita

Hexapod robots are potentially suitable for carrying out tasks in cluttered environments since they are stable, compact, and light weight. They also have multi-joint legs and variable height bodies that make them good candidates for tasks…

Robotics · Computer Science 2024-12-17 Tomson Qu , Dichen Li , Avideh Zakhor , Wenhao Yu , Tingnan Zhang

Developing robust locomotion controllers for bipedal robots with closed kinematic chains presents unique challenges, particularly since most reinforcement learning (RL) approaches simplify these parallel mechanisms into serial models during…

Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches,…

Despite advances in Multimodal LLMs (MLLMs), their ability to reason over 3D structures and temporal dynamics remains limited, constrained by weak 4D perception and temporal understanding. Existing 3D and 4D Video Question Answering (VQA)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chiao-An Yang , Ryo Hachiuma , Sifei Liu , Subhashree Radhakrishnan , Raymond A. Yeh , Yu-Chiang Frank Wang , Min-Hung Chen

This paper presents a deep learning framework that is capable of solving partially observable locomotion tasks based on our novel interpretation of Recurrent Deterministic Policy Gradient (RDPG). We study on bias of sampled error measure…

Artificial Intelligence · Computer Science 2020-02-11 Doo Re Song , Chuanyu Yang , Christopher McGreavy , Zhibin Li