English
Related papers

Related papers: Exploring Contextual Representation and Multi-Moda…

200 papers

Context awareness is an essential part of mobile and ubiquitous computing. Its goal is to unveil situational information about mobile users like locations and activities. The sensed context can enable many services like navigation, AR, and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Xiaochen Liu

High infraction rates remain the primary bottleneck for end-to-end (E2E) autonomous driving, as evidenced by the low driving scores on the CARLA Leaderboard. Despite collision-related infractions being the dominant failure mode in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Alex Koran , Dimitrios Sinodinos , Hadi Hojjati , Takuya Nanri , Fangge Chen , Narges Armanfard

Navigating safely in urban environments remains a challenging problem for autonomous vehicles. Occlusion and limited sensor range can pose significant challenges to safely navigate among pedestrians and other vehicles in the environment.…

Robotics · Computer Science 2019-07-19 Ming-Yuan Yu , Ram Vasudevan , Matthew Johnson-Roberson

Autonomous driving is an emerging technology that has advanced rapidly over the last decade. Modern transportation is expected to benefit greatly from a wise decision-making framework of autonomous vehicles, including the improvement of…

Artificial Intelligence · Computer Science 2023-12-20 Yuyang Xia , Shuncheng Liu , Quanlin Yu , Liwei Deng , You Zhang , Han Su , Kai Zheng

In recent times, there has been a growing focus on end-to-end autonomous driving technologies. This technology involves the replacement of the entire driving pipeline with a single neural network, which has a simpler structure and faster…

Robotics · Computer Science 2023-10-27 Hongkuan Zhou , Aifen Sui , Letian Shi , Yinxian Li

Autonomous driving technology has the potential to transform transportation, but its wide adoption depends on the development of interpretable and transparent decision-making systems. Scene captioning, which generates natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Felix Brandstaetter , Erik Schuetz , Katharina Winter , Fabian Flohr

The key to achieving autonomous driving lies in topology-aware perception, the structured understanding of the driving environment with an emphasis on lane topology and road semantics. This survey systematically reviews four core research…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yixiao Chen , Ruining Yang , Xin Chen , Jia He , Dongliang Xu , Yue Yao

Autonomous driving requires robust perception across diverse environmental conditions, yet 3D semantic occupancy prediction remains challenging under adverse weather and lighting. In this work, we present the first study combining 4D radar…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 David Ninfa , Andras Palffy , Holger Caesar

In autonomous vehicles, understanding the surrounding 3D environment of the ego vehicle in real-time is essential. A compact way to represent scenes while encoding geometric distances and semantic object information is via 3D semantic…

Robotics · Computer Science 2024-05-21 Samuel Sze , Lars Kunze

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

Human-Computer Interaction · Computer Science 2020-12-21 Darshana Rathnayake , Ashen de Silva , Dasun Puwakdandawa , Lakmal Meegahapola , Archan Misra , Indika Perera

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

The novelty of this study consists in a multi-modality approach to scene classification, where image and audio complement each other in a process of deep late fusion. The approach is demonstrated on a difficult classification problem,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Jordan J. Bird , Diego R. Faria , Cristiano Premebida , Anikó Ekárt , George Vogiatzis

Recent progress in advanced driver assistance systems and the race towards autonomous vehicles is mainly driven by two factors: (1) increasingly sophisticated algorithms that interpret the environment around the vehicle and react…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Marius Cordts , Timo Rehfeld , Lukas Schneider , David Pfeiffer , Markus Enzweiler , Stefan Roth , Marc Pollefeys , Uwe Franke

We demonstrate the need and potential of systematically integrated vision and semantics solutions for visual sensemaking in the backdrop of autonomous driving. A general neurosymbolic method for online visual sensemaking using answer set…

Artificial Intelligence · Computer Science 2020-12-29 Jakob Suchan , Mehul Bhatt , Srikrishna Varadarajan

With the rapid development of intelligent vehicles and Advanced Driving Assistance Systems (ADAS), a mixed level of human driver engagements is involved in the transportation system. Visual guidance for drivers is essential under this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Yongkang Liu , Ziran Wang , Kyungtae Han , Zhenyu Shou , Prashant Tiwari , John H. L. Hansen

The safe operation of autonomous vehicles (AVs) is highly dependent on their understanding of the surroundings. For this, the task of 3D semantic occupancy prediction divides the space around the sensors into voxels, and labels each voxel…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Yaoqi Huang , Hongyu Lyu , Nguyen Hoang Khoi Tran , Tzu-Yun Tseng , Stewart Worrall

Feature fusion modules from encoder and self-attention module have been adopted in semantic segmentation. However, the computation of these modules is costly and has operational limitations in real-time environments. In addition,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Jaehyun Park , Subin Lee , Eon Kim , Byeongjun Moon , Dabeen Yu , Yeonseung Yu , Junghwan Kim

A context-aware recommender system (CARS) applies sensing and analysis of user context to provide personalized services. The contextual information can be driven from sensors in order to improve the accuracy of the recommendations. Yet,…

Machine Learning · Computer Science 2022-08-10 Amit Livne , Eliad Shem Tov , Adir Solomon , Achiya Elyasaf , Bracha Shapira , Lior Rokach

Collaborative visual perception methods have gained widespread attention in the autonomous driving community in recent years due to their ability to address sensor limitation problems. However, the absence of explicit depth information…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Shaohong Wang , Bin Lu , Xinyu Xiao , Hanzhi Zhong , Bowen Pang , Tong Wang , Zhiyu Xiang , Hangguan Shan , Eryun Liu

Multi-modal fusion is a basic task of autonomous driving system perception, which has attracted many scholars' interest in recent years. The current multi-modal fusion methods mainly focus on camera data and LiDAR data, but pay little…

Robotics · Computer Science 2022-11-14 Yan Gong , Jianli Lu , Jiayi Wu , Wenzhuo Liu