English
Related papers

Related papers: MUSES: The Multi-Sensor Semantic Perception Datase…

200 papers

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Recent advances in integrated sensing and communication (ISAC) unmanned aerial vehicles (UAVs) have enabled their widespread deployment in critical applications such as emergency management. This paper investigates the challenge of…

Information Theory · Computer Science 2025-03-26 Ziji Guo , Haonan Tong , Zhilong Zhang , Danpu Liu

Extensive evaluation of perception systems is crucial for ensuring the safety of intelligent vehicles in complex driving scenarios. Conventional performance metrics such as precision, recall and the F1-score assess the overall detection…

Robotics · Computer Science 2025-12-18 Jörg Gamerdinger , Sven Teufel , Stephan Amann , Lukas Marc Listl , Oliver Bringmann

This paper presents a novel multimodal perception system for a real open environment. The proposed system includes an embedded computation platform, cameras, ultrasonic sensors, GPS, and IMU devices. Unlike the traditional frameworks, our…

Robotics · Computer Science 2024-12-03 Yuyang Sha

This work addresses the problem of semantic scene understanding under foggy road conditions. Although marked progress has been made in semantic scene understanding over the recent years, it is mainly concentrated on clear weather outdoor…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Martin Hahner , Dengxin Dai , Christos Sakaridis , Jan-Nico Zaech , Luc Van Gool

We present a new traffic dataset, METEOR, which captures traffic patterns and multi-agent driving behaviors in unstructured scenarios. METEOR consists of more than 1000 one-minute videos, over 2 million annotated frames with bounding boxes…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Rohan Chandra , Xijun Wang , Mridul Mahajan , Rahul Kala , Rishitha Palugulla , Chandrababu Naidu , Alok Jain , Dinesh Manocha

Deep neural networks (DNN) which are employed in perception systems for autonomous driving require a huge amount of data to train on, as they must reliably achieve high performance in all kinds of situations. However, these DNN are usually…

Robotics · Computer Science 2023-08-01 Daniel Bogdoll , Svenja Uhlemeyer , Kamil Kowol , J. Marius Zöllner

Autonomous systems have advanced significantly, but challenges persist in accident-prone environments where robust decision-making is crucial. A single vehicle's limited sensor range and obstructed views increase the likelihood of…

Artificial Intelligence · Computer Science 2025-09-24 Rui Liu , Zikang Wang , Peng Gao , Yu Shen , Pratap Tokekar , Ming Lin

The growing demand for robust scene understanding in mobile robotics and autonomous driving has highlighted the importance of integrating multiple sensing modalities. By combining data from diverse sensors like cameras and LIDARs, fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Depanshu Sani , Saket Anand

With the gradual maturity of 5G technology,autonomous driving technology has attracted moreand more attention among the research commu-nity. Autonomous driving vehicles rely on the co-operation of artificial intelligence, visual comput-ing,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Lichao Wang , Lanxin Lei , Hongli Song , Weibao Wang

This paper addresses the limitations of current datasets for 3D vision tasks in terms of accuracy, size, realism, and suitable imaging modalities for photometrically challenging objects. We propose a novel annotation and acquisition…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 HyunJun Jung , Patrick Ruhkamp , Nassir Navab , Benjamin Busam

The open road poses many challenges to autonomous perception, including poor visibility from extreme weather conditions. Models trained on good-weather datasets frequently fail at detection in these out-of-distribution settings. To aid…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Aboli Marathe , Deva Ramanan , Rahee Walambe , Ketan Kotecha

All-day and all-weather navigation is a critical capability for autonomous driving, which requires proper reaction to varied environmental conditions and complex agent behaviors. Recently, with the rise of deep learning, end-to-end control…

Robotics · Computer Science 2020-11-03 Peide Cai , Sukai Wang , Yuxiang Sun , Ming Liu

Perceiving the environment and its changes over time corresponds to two fundamental yet heterogeneous types of information: semantics and motion. Previous end-to-end autonomous driving works represent both types of information in a single…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yinzhe Shen , Omer Sahin Tas , Kaiwen Wang , Royden Wagner , Christoph Stiller

Autonomous driving technology nowadays targets to level 4 or beyond, but the researchers are faced with some limitations for developing reliable driving algorithms in diverse challenges. To promote the autonomous vehicles to spread widely,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Hyeonjae Jeon , Junghyun Seo , Taesoo Kim , Sungho Son , Jungki Lee , Gyeungho Choi , Yongseob Lim

Intelligent Transportation Systems (ITS) allow a drastic expansion of the visibility range and decrease occlusions for autonomous driving. To obtain accurate detections, detailed labeled sensor data for training is required. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Walter Zimmer , Christian Creß , Huu Tung Nguyen , Alois C. Knoll

This paper presents a novel approach for learning self-awareness models for autonomous vehicles. The proposed technique is based on the availability of synchronized multi-sensor dynamic data related to different maneuvering tasks performed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , Carlo S. Regazzoni

Data-intensive machine learning based techniques increasingly play a prominent role in the development of future mobility solutions - from driver assistance and automation functions in vehicles, to real-time traffic management systems…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Christian Creß , Walter Zimmer , Leah Strand , Venkatnarayanan Lakshminarasimhan , Maximilian Fortkord , Siyi Dai , Alois Knoll

Multi-modal systems have the capacity of producing more reliable results than systems with a single modality in road detection due to perceiving different aspects of the scene. We focus on using raw sensor inputs instead of, as it is…

Robotics · Computer Science 2023-08-24 Erkan Milli , Özgür Erkent , Asım Egemen Yılmaz

Driven by deep learning techniques, perception technology in autonomous driving has developed rapidly in recent years, enabling vehicles to accurately detect and interpret surrounding environment for safe and efficient navigation. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Shanliang Yao , Runwei Guan , Xiaoyu Huang , Zhuoxiao Li , Xiangyu Sha , Yong Yue , Eng Gee Lim , Hyungjoon Seo , Ka Lok Man , Xiaohui Zhu , Yutao Yue