English
Related papers

Related papers: Multi-task UNet architecture for end-to-end autono…

200 papers

Transformer is a popularly used neural network architecture, especially for language understanding. We introduce an extended and unified architecture that can be used for tasks involving a variety of modalities like image, text, videos,…

Machine Learning · Computer Science 2020-07-06 Subhojeet Pramanik , Priyanka Agrawal , Aman Hussain

As autonomous driving technology continues to advance, end-to-end models have attracted considerable attention owing to their superior generalisation capability. Nevertheless, such learning-based systems entail numerous safety risks…

Robotics · Computer Science 2025-05-22 Hongrui Kou , Zhouhang Lyu , Ziyu Wang , Cheng Wang , Yuxin Zhang

Lane topology, which is usually modeled by a centerline graph, is essential for high-level autonomous driving. For a high-quality graph, both topology connectivity and spatial continuity of centerline segments are critical. However, most of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yunhui Han , Kun Yu , Zhiwei Li

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to…

Machine Learning · Computer Science 2022-05-26 Lijun Zhang , Xiao Liu , Hui Guan

Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception,…

Robotics · Computer Science 2023-12-12 Hemanth Manjunatha , Panagiotis Tsiotras

Online corner case detection is crucial for ensuring safety in autonomous driving vehicles. Current autonomous driving approaches can be categorized into modular approaches and end-to-end approaches. To leverage the advantages of both, we…

Artificial Intelligence · Computer Science 2024-09-04 Gemb Kaljavesi , Xiyan Su , Frank Diermeyer

This paper introduces the Emirates Multi-Task (EMT) dataset, designed to support multi-task benchmarking within a unified framework. It comprises over 30,000 frames from a dash-camera perspective and 570,000 annotated bounding boxes,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Nadya Abdel Madjid , Murad Mebrahtu , Abdulrahman Ahmad , Abdelmoamen Nasser , Bilal Hassan , Naoufel Werghi , Jorge Dias , Majid Khonji

Multimodal multitask learning has attracted an increasing interest in recent years. Singlemodal models have been advancing rapidly and have achieved astonishing results on various tasks across multiple domains. Multimodal learning offers…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Ye Xue , Diego Klabjan , Jean Utke

Depth completion is a crucial task in autonomous driving, aiming to convert a sparse depth map into a dense depth prediction. Due to its potentially rich semantic information, RGB image is commonly fused to enhance the completion effect.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Moyun Liu , Bing Chen , Youping Chen , Jingming Xie , Lei Yao , Yang Zhang , Joey Tianyi Zhou

Deep convolutional neural networks (CNNs) have been shown to perform extremely well at a variety of tasks including subtasks of autonomous driving such as image segmentation and object classification. However, networks designed for these…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Yiqi Hou , Sascha Hornauer , Karl Zipser

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura

In this paper, we propose a multi-task convolutional neural network (CNN) architecture optimized for a low power automotive grade SoC. We introduce a network based on a unified architecture where the encoder is shared among the two tasks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Thomas Boulay , Said El-Hachimi , Mani Kumar Surisetti , Pullarao Maddu , Saranya Kandan

Traditional autonomous driving methods adopt a modular design, decomposing tasks into sub-tasks. In contrast, end-to-end autonomous driving directly outputs actions from raw sensor data, avoiding error accumulation. However, training an…

Robotics · Computer Science 2024-11-22 Zeyu Dong , Yimin Zhu , Yansong Li , Kevin Mahon , Yu Sun

End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often build on separate modules for perception and planning…

Robotics · Computer Science 2026-03-17 David Holtz , Niklas Hanselmann , Simon Doll , Marius Cordts , Bernt Schiele

Controller networks in today's automotive systems consist of more than 100 ECUs connected by various bus protocols. Seamless operation of the entire system requires a well-orchestrated interaction of these ECUs. Consequently, to ensure…

Systems and Control · Electrical Eng. & Systems 2020-04-29 Max J. Friese , Dirk Nowotka

In city, information about urban objects such as water supply, railway lines, power lines, buildings, roads, etc., is necessary for city planning. In particular, information about the spread of these objects, locations and capacity is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Sahil Gangurde

We propose an end-to-end Multitask Learning Transformer framework, named MulT, to simultaneously learn multiple high-level vision tasks, including depth estimation, semantic segmentation, reshading, surface normal estimation, 2D keypoint…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Deblina Bhattacharjee , Tong Zhang , Sabine Süsstrunk , Mathieu Salzmann

Cooperatively utilizing both ego-vehicle and infrastructure sensor data via V2X communication has emerged as a promising approach for advanced autonomous driving. However, current research mainly focuses on improving individual modules,…

Robotics · Computer Science 2024-12-25 Haibao Yu , Wenxian Yang , Jiaru Zhong , Zhenwei Yang , Siqi Fan , Ping Luo , Zaiqing Nie

Road traffic accidents remain a significant global concern, with the majority attributed to human factors such as driver distraction and fatigue. This study proposes a camera-based approach to derive useful indicators to assess driver…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Carmelo Scribano , Giovanni Cappelletti , Elia Giacobazzi , Giorgia Franchini , Paolo Burgio , Marko Bertogna

A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from…

Machine Learning · Computer Science 2018-11-19 Rhiannon Michelmore , Marta Kwiatkowska , Yarin Gal