English
Related papers

Related papers: MIND-Stack: Modular, Interpretable, End-to-End Dif…

200 papers

We introduce MoNet, a novel functionally modular network for self-supervised and interpretable end-to-end learning. By leveraging its functional modularity with a latent-guided contrastive loss function, MoNet efficiently learns…

Machine Learning · Computer Science 2024-06-06 Hyunki Seong , David Hyunchul Shim

Autonomous driving systems have a pipeline of perception, decision, planning, and control. The decision module processes information from the perception module and directs the execution of downstream planning and control modules. On the…

Artificial Intelligence · Computer Science 2021-05-07 Junning Huang , Sirui Xie , Jiankai Sun , Qiurui Ma , Chunxiao Liu , Jianping Shi , Dahua Lin , Bolei Zhou

In recent years, Deep Reinforcement Learning emerged as a promising approach for autonomous navigation of ground vehicles and has been utilized in various areas of navigation such as cruise control, lane changing, or obstacle avoidance.…

Robotics · Computer Science 2023-02-07 Linh Kästner , Marvin Meusel , Teham Bhuiyan , Jens Lambrecht

Over the last few years, we have witnessed tremendous progress on many subtasks of autonomous driving, including perception, motion forecasting, and motion planning. However, these systems often assume that the car is accurately localized…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 John Phillips , Julieta Martinez , Ioan Andrei Bârsan , Sergio Casas , Abbas Sadat , Raquel Urtasun

By transforming identification and control for nonlinear system into optimization problems, a novel optimization method named state transition algorithm (STA) is introduced to solve the problems. In the proposed STA, a solution to a…

Optimization and Control · Mathematics 2015-11-18 Xiaojun Zhou , Chunhua Yang , Weihua Gui

Visual topological navigation has been revitalized recently thanks to the advancement of deep learning that substantially improves robot perception. However, the scalability and reliability issue remain challenging due to the complexity and…

Robotics · Computer Science 2020-03-20 Xiangyun Meng , Nathan Ratliff , Yu Xiang , Dieter Fox

Semantic navigation is necessary to deploy mobile robots in uncontrolled environments like our homes, schools, and hospitals. Many learning-based approaches have been proposed in response to the lack of semantic understanding of the…

Robotics · Computer Science 2022-12-05 Theophile Gervet , Soumith Chintala , Dhruv Batra , Jitendra Malik , Devendra Singh Chaplot

Deep learning has been used to demonstrate end-to-end neural network learning for autonomous vehicle control from raw sensory input. While LiDAR sensors provide reliably accurate information, existing end-to-end driving solutions are mainly…

Robotics · Computer Science 2021-05-21 Zhijian Liu , Alexander Amini , Sibo Zhu , Sertac Karaman , Song Han , Daniela Rus

Although neural networks have seen tremendous success as predictive models in a variety of domains, they can be overly confident in their predictions on out-of-distribution (OOD) data. To be viable for safety-critical applications, like…

Robotics · Computer Science 2022-11-17 Masha Itkina , Mykel J. Kochenderfer

End-to-end autonomous driving aims to produce planning trajectories from raw sensors directly. Currently, most approaches integrate perception, prediction, and planning modules into a fully differentiable network, promising great…

Robotics · Computer Science 2025-12-23 Pengxuan Yang , Yupeng Zheng , Qichao Zhang , Kefei Zhu , Zebin Xing , Qiao Lin , Yun-Fu Liu , Zhiguo Su , Dongbin Zhao

In this study, a modular, data-free pipeline for multi-label intention recognition is proposed for agentic AI applications in transportation. Unlike traditional intent recognition systems that depend on large, annotated corpora and often…

Machine Learning · Computer Science 2025-11-06 Xiaocai Zhang , Hur Lim , Ke Wang , Zhe Xiao , Jing Wang , Kelvin Lee , Xiuju Fu , Zheng Qin

This paper presents a vision-based modularized drone racing navigation system that uses a customized convolutional neural network (CNN) for the perception module to produce high-level navigation commands and then leverages a…

Robotics · Computer Science 2021-05-28 Tianqi Wang , Dong Eui Chang

Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Zhengyuan Yang , Yixuan Zhang , Jerry Yu , Junjie Cai , Jiebo Luo

End-to-end learning from sensory data has shown promising results in autonomous driving. While employing many sensors enhances world perception and should lead to more robust and reliable behavior of autonomous vehicles, it is challenging…

Robotics · Computer Science 2020-09-21 Shihong Fang , Anna Choromanska

The autonomous driving community has witnessed a rapid growth in approaches that embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle motion plans, instead of concentrating on individual tasks such as…

Robotics · Computer Science 2024-08-16 Li Chen , Penghao Wu , Kashyap Chitta , Bernhard Jaeger , Andreas Geiger , Hongyang Li

Off-road autonomous navigation demands reliable 3D perception for robust obstacle detection in challenging unstructured terrain. While LiDAR is accurate, it is costly and power-intensive. Monocular depth estimation using foundation models…

Sparse neural systems are gaining traction for efficient continual learning due to their modularity and low interference. Architectures such as Sparse Distributed Memory Multi-Layer Perceptrons (SDMLP) construct task-specific subnetworks…

Machine Learning · Computer Science 2025-12-18 Huiyan Xue , Xuming Ran , Yaxin Li , Qi Xu , Enhui Li , Yi Xu , Qiang Zhang

Efficiently utilizing procured power and optimizing performance of scientific applications under power and energy constraints are challenging. The HPC PowerStack defines a software stack to manage power and energy of high-performance…

In this paper we propose a novel end-to-end learnable network that performs joint perception, prediction and motion planning for self-driving vehicles and produces interpretable intermediate representations. Unlike existing neural motion…

Robotics · Computer Science 2020-08-14 Abbas Sadat , Sergio Casas , Mengye Ren , Xinyu Wu , Pranaab Dhawan , Raquel Urtasun

The worldwide economy and environmental sustainability depend on eff icient and reliable supply chains, in which container shipping plays a crucial role as an environmentally friendly mode of transport. Liner shipping companies seek to…

Optimization and Control · Mathematics 2025-04-08 Jaike Van Twiller , Djordje Grbic , Rune Møller Jensen