English
Related papers

Related papers: Learning to Navigate: Exploiting Deep Networks to …

200 papers

Learning from demonstration for motion planning is an ongoing research topic. In this paper we present a model that is able to learn the complex mapping from raw 2D-laser range findings and a target position to the required steering…

Robotics · Computer Science 2018-11-07 Mark Pfeiffer , Michael Schaeuble , Juan Nieto , Roland Siegwart , Cesar Cadena

How much does having visual priors about the world (e.g. the fact that the world is 3D) assist in learning to perform downstream motor tasks (e.g. navigating a complex environment)? What are the consequences of not utilizing such visual…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Alexander Sax , Jeffrey O. Zhang , Bradley Emi , Amir Zamir , Silvio Savarese , Leonidas Guibas , Jitendra Malik

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

Progress in Embodied AI has made it possible for end-to-end-trained agents to navigate in photo-realistic environments with high-level reasoning and zero-shot or language-conditioned behavior, but benchmarks are still dominated by…

Recently, mobile robots have become important tools in various industries, especially in logistics. Deep reinforcement learning emerged as an alternative planning method to replace overly conservative approaches and promises more efficient…

Robotics · Computer Science 2021-09-27 Linh Kästner , Teham Buiyan , Xinlin Zhao , Lei Jiao , Zhengcheng Shen , Jens Lambrecht

Breakthroughs in machine learning in the last decade have led to `digital intelligence', i.e. machine learning models capable of learning from vast amounts of labeled data to perform several digital tasks such as speech recognition, face…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Devendra Singh Chaplot

This work proposes a novel hybrid approach for vision-only navigation of mobile robots, which combines advances of both deep learning approaches and classical model-based planning algorithms. Today, purely data-driven end-to-end models are…

Robotics · Computer Science 2025-07-29 Sergey Bakulin , Timur Akhtyamov , Denis Fatykhov , German Devchich , Gonzalo Ferrer

We train embodied neural networks to plan and navigate unseen complex 3D environments, emphasising real-world deployment. Rather than requiring prior knowledge of the agent or environment, the planner learns to model the state transitions…

Robotics · Computer Science 2022-06-03 Shu Ishida , João F. Henriques

Conventional approaches to vision-and-language navigation (VLN) are trained end-to-end but struggle to perform well in freely traversable environments. Inspired by the robotics community, we propose a modular approach to VLN using…

Robotics · Computer Science 2020-12-11 Kevin Chen , Junshen K. Chen , Jo Chuang , Marynel Vázquez , Silvio Savarese

Recent research on deep learning, a set of machine learning techniques able to learn deep architectures, has shown how robotic perception and action greatly benefits from these techniques. In terms of spacecraft navigation and control…

Systems and Control · Computer Science 2016-10-28 Carlos Sánchez-Sánchez , Dario Izzo

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

Mobile robotics is a research area that has witnessed incredible advances for the last decades. Robot navigation is an essential task for mobile robots. Many methods are proposed for allowing robots to navigate within different…

Robotics · Computer Science 2021-02-18 Omar Mohamed , Zeyad Mohsen , Mohamed Wageeh , Mohamed Hegazy

Visual navigation is essential for many applications in robotics, from manipulation, through mobile robotics to automated driving. Deep reinforcement learning (DRL) provides an elegant map-free approach integrating image processing,…

Robotics · Computer Science 2020-10-22 Jonáš Kulhánek , Erik Derner , Robert Babuška

This work presents a case study of a learning-based approach for target driven map-less navigation. The underlying navigation model is an end-to-end neural network which is trained using a combination of expert demonstrations, imitation…

End-to-end trained neural networks (NNs) are a compelling approach to autonomous vehicle control because of their ability to learn complex tasks without manual engineering of rule-based decisions. However, challenging road conditions,…

Artificial Intelligence · Computer Science 2021-11-24 Alexander Amini , Ava Soleimany , Sertac Karaman , Daniela Rus

Visual navigation models based on deep learning can learn effective policies when trained on large amounts of visual observations through reinforcement learning. Unfortunately, collecting the required experience in the real world requires…

Robotics · Computer Science 2020-10-27 Marco Rosano , Antonino Furnari , Luigi Gulino , Giovanni Maria Farinella

We propose an end-to-end deep learning model for translating free-form natural language instructions to a high-level plan for behavioral robot navigation. We use attention models to connect information from both the user instructions and a…

Computation and Language · Computer Science 2018-10-02 Xiaoxue Zang , Ashwini Pokle , Marynel Vázquez , Kevin Chen , Juan Carlos Niebles , Alvaro Soto , Silvio Savarese

Navigation is one of the most heavily studied problems in robotics, and is conventionally approached as a geometric mapping and planning problem. However, real-world navigation presents a complex set of physical challenges that defies…

Robotics · Computer Science 2022-12-14 Sergey Levine , Dhruv Shah

Visual navigation tasks in real-world environments often require both self-motion and place recognition feedback. While deep reinforcement learning has shown success in solving these perception and decision-making problems in an end-to-end…

Robotics · Computer Science 2020-03-03 Marvin Chancán , Michael Milford

This paper highlights the significance of including memory structures in neural networks when the latter are used to learn perception-action loops for autonomous robot navigation. Traditional navigation approaches rely on global maps of the…

Robotics · Computer Science 2017-05-24 Steven W Chen , Nikolay Atanasov , Arbaaz Khan , Konstantinos Karydis , Daniel D. Lee , Vijay Kumar