English
Related papers

Related papers: MIND-Stack: Modular, Interpretable, End-to-End Dif…

200 papers

In recent years, considerable progress has been made towards a vehicle's ability to operate autonomously. An end-to-end approach attempts to achieve autonomous driving using a single, comprehensive software component. Recent breakthroughs…

Robotics · Computer Science 2019-05-17 Hege Haavaldsen , Max Aasboe , Frank Lindseth

Global navigation information and local scene understanding are two crucial components of autonomous driving systems. However, our experimental results indicate that many end-to-end autonomous driving systems tend to over-rely on local…

Robotics · Computer Science 2026-04-15 Zhihua Hua , Junli Wang , Pengfei LI , Qihao Jin , Bo Zhang , Kehua Sheng , Yilun Chen , Zhongxue Gan , Wenchao Ding

Pioneers of autonomous vehicles (AVs) promised to revolutionize the driving experience and driving safety. However, milestones in AVs have materialized slower than forecast. Two culprits are (1) the lack of verifiability of proposed…

Robotics · Computer Science 2023-03-14 R. Spencer Hallyburton , Shucheng Zhang , Miroslav Pajic

State-of-the-art approaches for autonomous driving integrate multiple sub-tasks of the overall driving task into a single pipeline that can be trained in an end-to-end fashion by passing latent representations between the different modules.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Simon Doll , Niklas Hanselmann , Lukas Schneider , Richard Schulz , Marius Cordts , Markus Enzweiler , Hendrik P. A. Lensch

Multisensory polices are known to enhance both state estimation and target tracking. However, in the space of end-to-end sensorimotor control, this multi-sensor outlook has received limited attention. Moreover, systematic ways to make…

Robotics · Computer Science 2017-11-02 Guan-Horng Liu , Avinash Siravuru , Sai Prabhakar , Manuela Veloso , George Kantor

End-to-end autonomous driving has made impressive progress in recent years. Existing methods usually adopt the decoupled encoder-decoder paradigm, where the encoder extracts hidden features from raw sensor data, and the decoder outputs the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xiaosong Jia , Penghao Wu , Li Chen , Jiangwei Xie , Conghui He , Junchi Yan , Hongyang Li

We present a modular, full-stack autonomy system for lunar surface navigation and mapping developed for the Lunar Autonomy Challenge. Operating in a GNSS-denied, visually challenging environment, our pipeline integrates semantic…

Robotics · Computer Science 2026-03-19 Adam Dai , Asta Wu , Keidai Iiyama , Guillem Casadesus Vila , Kaila Coimbra , Thomas Deng , Grace Gao

Controlling spacecraft near asteroids in deep space comes with many challenges. The delays involved necessitate heavy usage of limited onboard computation resources while fuel efficiency remains a priority to support the long loiter times…

Robotics · Computer Science 2025-02-04 Patrick Quinn , George Nehma , Madhur Tiwari

As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as…

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

Predicting driver intentions is a difficult and crucial task for advanced driver assistance systems. Traditional confidence measures on predictions often ignore the way predicted trajectories affect downstream decisions for safe driving. In…

Vision-based robotics often separates the control loop into one module for perception and a separate module for control. It is possible to train the whole system end-to-end (e.g. with deep RL), but doing it "from scratch" comes with a high…

Robotics · Computer Science 2020-11-16 Bryan Chen , Alexander Sax , Gene Lewis , Iro Armeni , Silvio Savarese , Amir Zamir , Jitendra Malik , Lerrel Pinto

A novel hierarchical Deep Neural Network (DNN) model is presented to address the task of end-to-end driving. The model consists of a master classifier network which determines the driving task required from an input stereo image and directs…

Machine Learning · Computer Science 2020-12-03 Jose Solomon , Francois Charette

End-to-end autonomous driving has been recently seen rapid development, exerting a profound influence on both industry and academia. However, the existing work places excessive focus on ego-vehicle status as their sole learning objectives…

Robotics · Computer Science 2025-08-08 Rui Yu , Xianghang Zhang , Runkai Zhao , Huaicheng Yan , Meng Wang

The performance of autonomous systems heavily relies on their ability to generate a robust representation of the environment. Deep neural networks have greatly improved vision-based perception systems but still fail in challenging…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Jörg Wagner , Volker Fischer , Michael Herman , Sven Behnke

Standard decoding approaches rely on model-based channel estimation methods to compensate for varying channel effects, which degrade in performance whenever there is a model mismatch. Recently proposed Deep learning based neural decoders…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan

Large Reasoning Models (LRMs) achieve strong performance on complex tasks by leveraging long Chain-of-Thought (CoT), but often suffer from overthinking, leading to excessive reasoning steps and high inference latency. Existing CoT…

Computation and Language · Computer Science 2026-04-13 Yi Sui , Chaozhuo Li , Dawei Song

Advances in hybrid bonding and packaging have driven growing interest in 3D DRAM-stacked accelerators with higher memory bandwidth and capacity. As LLMs scale to hundreds of billions or trillions of parameters, distributed inference across…

Recent research on automotive driving developed an efficient end-to-end learning mode that directly maps visual input to control commands. However, it models distinct driving variations in a single network, which increases learning…

Robotics · Computer Science 2019-12-02 Huifang Ma , Yue Wang , Rong Xiong , Sarath Kodagoda , Li Tang

In autonomous driving, end-to-end (E2E) driving systems that predict control commands directly from sensor data have achieved significant advancements. For safe driving in unexpected scenarios, these systems may additionally rely on human…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Seo Hyun Kim , Jin Bok Park , Do Yeon Koo , Hogun Park , Il Yong Chun