English
Related papers

Related papers: Learning a State Representation and Navigation in …

200 papers

We focus on the problem of teaching a robot to solve tasks presented sequentially, i.e., in a continual learning scenario. The robot should be able to solve all tasks it has encountered, without forgetting past tasks. We provide preliminary…

Machine Learning · Computer Science 2019-06-12 René Traoré , Hugo Caselles-Dupré , Timothée Lesort , Te Sun , Natalia Díaz-Rodríguez , David Filliat

Being able to explore unknown environments is a requirement for fully autonomous robots. Many learning-based methods have been proposed to learn an exploration strategy. In the frontier-based exploration, learning algorithms tend to learn…

Robotics · Computer Science 2021-06-18 Zhaoting Li , Tingguang Li , Jiankun Wang , Max Q. -H. Meng

Quadruped platforms have become an active topic of research due to their high mobility and traversability in rough terrain. However, it is highly challenging to determine whether the clattered environment could be passed by the robot and…

Robotics · Computer Science 2022-09-22 Ildar Babataev , Aleksey Fedoseev , Nipun Weerakkodi , Elena Nazarova , Dzmitry Tsetserukou

Autonomous nano-drones (~10 cm in diameter), thanks to their ultra-low power TinyML-based brains, are capable of coping with real-world environments. However, due to their simplified sensors and compute units, they are still far from the…

Robotics · Computer Science 2024-04-04 Luca Crupi , Elia Cereda , Daniele Palossi

Visual Teach-and-Repeat Navigation is a direct solution for mobile robot to be deployed in unknown environments. However, robust trajectory repeat navigation still remains challenged due to environmental changing and dynamic objects. In…

Robotics · Computer Science 2025-10-13 Jikai Wang , Yunqi Cheng , Kezhi Wang , Zonghai Chen

Previous studies have successfully demonstrated agile and robust locomotion in challenging terrains for quadrupedal robots. However, the bipedal locomotion mode for quadruped robots remains unverified. This paper explores the adaptation of…

Quadrupedal robots have demonstrated exceptional locomotion capabilities through Reinforcement Learning (RL), including extreme parkour maneuvers. However, integrating locomotion skills with navigation in quadrupedal robots has not been…

Robotics · Computer Science 2025-09-09 Dewei Wang , Chenjia Bai , Chenhui Li , Jiyuan Shi , Yan Ding , Chi Zhang , Bin Zhao

Many reinforcement learning (RL) tasks provide the agent with high-dimensional observations that can be simplified into low-dimensional continuous states. To formalize this process, we introduce the concept of a DeepMDP, a parameterized…

Machine Learning · Computer Science 2019-06-07 Carles Gelada , Saurabh Kumar , Jacob Buckman , Ofir Nachum , Marc G. Bellemare

Learning to navigate in unstructured environments is a challenging task for robots. While reinforcement learning can be effective, it often requires extensive data collection and can pose risk. Learning from expert demonstrations, on the…

Robotics · Computer Science 2024-12-31 Nimrod Curtis , Osher Azulay , Avishai Sintov

Navigation research is attracting renewed interest with the advent of learning-based methods. However, this new line of work is largely disconnected from well-established classic navigation approaches. In this paper, we take a step towards…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Dmytro Mishkin , Alexey Dosovitskiy , Vladlen Koltun

This paper presents a safety-critical locomotion control framework for quadrupedal robots. Our goal is to enable quadrupedal robots to safely navigate in cluttered environments. To tackle this, we introduce exponential Discrete Control…

Robotics · Computer Science 2023-08-10 Qiayuan Liao , Zhongyu Li , Akshay Thirugnanam , Jun Zeng , Koushil Sreenath

This paper considers the problem of safe autonomous navigation in unknown environments, relying on local obstacle sensing. We consider a control-affine nonlinear robot system subject to bounded input noise and rely on feedback linearization…

Systems and Control · Electrical Eng. & Systems 2020-05-15 Zhichao Li , Thai Duong , Nikolay Atanasov

Humans train robots to complete tasks in one environment, and expect robots to perform those same tasks in new environments. As humans, we know which aspects of the environment (i.e., the state) are relevant to the task. But there are also…

Robotics · Computer Science 2026-03-09 Sagar Parekh , Preston Culbertson , Dylan P. Losey

In reinforcement learning (RL), state representations are key to dealing with large or continuous state spaces. While one of the promises of deep learning algorithms is to automatically construct features well-tuned for the task they try to…

Machine Learning · Computer Science 2023-06-21 Charline Le Lan , Stephen Tu , Mark Rowland , Anna Harutyunyan , Rishabh Agarwal , Marc G. Bellemare , Will Dabney

A grand goal in AI is to build a robot that can accurately navigate based on natural language instructions, which requires the agent to perceive the scene, understand and ground language, and act in the real-world environment. One key…

Computation and Language · Computer Science 2019-04-09 Hao Tan , Licheng Yu , Mohit Bansal

In this paper, we present a framework rooted in control and planning that enables quadrupedal robots to traverse challenging terrains with discrete footholds using visual feedback. Navigating discrete terrain is challenging for quadrupeds…

Robotics · Computer Science 2022-03-07 Ayush Agrawal , Shuxiao Chen , Akshara Rai , Koushil Sreenath

Representation learning algorithms are designed to learn abstract features that characterize data. State representation learning (SRL) focuses on a particular kind of representation learning where learned features are in low dimension,…

Artificial Intelligence · Computer Science 2018-10-30 Timothée Lesort , Natalia Díaz-Rodríguez , Jean-François Goudou , David Filliat

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

Machine Learning · Computer Science 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

End-to-end learning for autonomous navigation has received substantial attention recently as a promising method for reducing modeling error. However, its data complexity, especially around generalization to unseen environments, is high. We…

Robotics · Computer Science 2019-04-04 Xiangyun Meng , Nathan Ratliff , Yu Xiang , Dieter Fox

Differentiable simulators provide analytic gradients, enabling more sample-efficient learning algorithms and paving the way for data intensive learning tasks such as learning from images. In this work, we demonstrate that locomotion…