English
Related papers

Related papers: Coupling Vision and Proprioception for Navigation …

200 papers

For full-size humanoid robots, even with recent advances in reinforcement learning-based control, achieving reliable locomotion on complex terrains, such as long staircases, remains challenging. In such settings, limited perception,…

Robotics · Computer Science 2025-12-09 Haolin Song , Hongbo Zhu , Tao Yu , Yan Liu , Mingqi Yuan , Wengang Zhou , Hua Chen , Houqiang Li

This paper addresses the problem of legged locomotion in non-flat terrain. As legged robots such as quadrupeds are to be deployed in terrains with geometries which are difficult to model and predict, the need arises to equip them with the…

Robotics · Computer Science 2020-02-03 Vassilios Tsounis , Mitja Alge , Joonho Lee , Farbod Farshidian , Marco Hutter

Legged robot locomotion requires the planning of stable reference trajectories, especially while traversing uneven terrain. The proposed trajectory optimization framework is capable of generating dynamically stable base and footstep…

Robotics · Computer Science 2021-03-24 Oguzhan Cebe , Carlo Tiseo , Guiyang Xin , Hsiu-chin Lin , Joshua Smith , Michael Mistry

Control policy learning for modular robot locomotion has previously been limited to proprioceptive feedback and flat terrain. This paper develops policies for modular systems with vision traversing more challenging environments. These…

Robotics · Computer Science 2023-05-02 Julian Whitman , Howie Choset

This work is on vision-based planning strategies for legged robots that separate locomotion planning into foothold selection and pose adaptation. Current pose adaptation strategies optimize the robot's body pose relative to given footholds.…

Robotics · Computer Science 2023-03-06 Shamel Fahmi , Victor Barasuol , Domingo Esteban , Octavio Villarreal , Claudio Semini

We propose VLM-Social-Nav, a novel Vision-Language Model (VLM) based navigation approach to compute a robot's motion in human-centered environments. Our goal is to make real-time decisions on robot actions that are socially compliant with…

Robotics · Computer Science 2024-11-27 Daeun Song , Jing Liang , Amirreza Payandeh , Amir Hossain Raj , Xuesu Xiao , Dinesh Manocha

Humans can routinely follow a trajectory defined by a list of images/landmarks. However, traditional robot navigation methods require accurate mapping of the environment, localization, and planning. Moreover, these methods are sensitive to…

Robotics · Computer Science 2019-05-30 Noriaki Hirose , Fei Xia , Roberto Martin-Martin , Amir Sadeghian , Silvio Savarese

Planning whole-body motions while taking into account the terrain conditions is a challenging problem for legged robots since the terrain model might produce many local minima. Our coupled planning method uses stochastic and…

Robotics · Computer Science 2020-06-30 Carlos Mastalli , Ioannis Havoutis , Michele Focchi , Darwin G. Caldwell , Claudio Semini

This study proposes an integrated task and motion planning method for dynamic locomotion in partially observable environments with multi-level safety guarantees. This layered planning framework is composed of a high-level symbolic task…

Robotics · Computer Science 2020-09-14 Jonas Warnke , Abdulaziz Shamsah , Yingke Li , Ye Zhao

Traversing risky terrains with sparse footholds presents significant challenges for legged robots, requiring precise foot placement in safe areas. To acquire comprehensive exteroceptive information, prior studies have employed motion…

Robotics · Computer Science 2025-03-04 Ruiqi Yu , Qianshi Wang , Yizhen Wang , Zhicheng Wang , Jun Wu , Qiuguo Zhu

Bridging the gap between embodied intelligence and embedded deployment remains a key challenge in intelligent robotic systems, where perception, reasoning, and planning must operate under strict constraints on computation, memory, energy,…

Robotics · Computer Science 2026-05-19 Kuan Xu , Ruimeng Liu , Yizhuo Yang , Denan Liang , Tongxing Jin , Shenghai Yuan , Chen Wang , Lihua Xie

Learned Neural Network based policies have shown promising results for robot navigation. However, most of these approaches fall short of being used on a real robot due to the extensive simulated training they require. These simulations lack…

Robotics · Computer Science 2019-08-30 Ayzaan Wahid , Alexander Toshev , Marek Fiser , Tsang-Wei Edward Lee

Accurate full-body motion prediction is essential for the safe, autonomous navigation of legged robots, enabling critical capabilities like limb-level collision checking in cluttered environments. Simplified kinematic models often fail to…

Robotics · Computer Science 2025-10-28 Abhijeet M. Kulkarni , Ioannis Poulakakis , Guoquan Huang

Legged robots can traverse a wide variety of terrains, some of which may be challenging for wheeled robots, such as stairs or highly uneven surfaces. However, quadruped robots face stability challenges on slippery surfaces. This can be…

Recently, biped robot walking technology has been significantly developed, mainly in the context of a bland walking scheme. To emulate human walking, robots need to step on the positions they see in unknown spaces accurately. In this paper,…

Robotics · Computer Science 2025-10-15 Bingquan Li , Ning Wang , Tianwei Zhang , Zhicheng He , Yucong Wu

We present AMCO, a novel navigation method for quadruped robots that adaptively combines vision-based and proprioception-based perception capabilities. Our approach uses three cost maps: general knowledge map; traversability history map;…

Legged locomotion in constrained spaces (called crawl spaces) is challenging. In crawl spaces, current proprioceptive locomotion learning methods are difficult to achieve traverse because only ground features are inferred. In this study, a…

Robotics · Computer Science 2025-12-05 Bida Ma , Nuo Xu , Chenkun Qi , Xin Liu , Yule Mo , Jinkai Wang , Chunpeng Lu

Compact quadrupedal robots are proving increasingly suitable for deployment in real-world scenarios. Their smaller size fosters easy integration into human environments. Nevertheless, real-time locomotion on uneven terrains remains…

Robotics · Computer Science 2026-02-20 Davide Plozza , Patricia Apostol , Paul Joseph , Simon Schläpfer , Michele Magno

Seeing-eye robots are very useful tools for guiding visually impaired people, potentially producing a huge societal impact given the low availability and high cost of real guide dogs. Although a few seeing-eye robot systems have already…

Robotics · Computer Science 2023-10-13 David DeFazio , Eisuke Hirota , Shiqi Zhang

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone