English
Related papers

Related papers: Learning Road Scene-level Representations via Sema…

200 papers

Perceptual understanding of the scene and the relationship between its different components is important for successful completion of robotic tasks. Representation learning has been shown to be a powerful technique for this, but most of the…

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

Autonomous driving is becoming a reality, yet vehicles still need to rely on complex sensor fusion to understand the scene they act in. The ability to discern static environment and dynamic entities provides a comprehension of the road…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Lorenzo Berlincioni , Federico Becattini , Leonardo Galteri , Lorenzo Seidenari , Alberto Del Bimbo

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

In autonomous driving tasks, scene understanding is the first step towards predicting the future behavior of the surrounding traffic participants. Yet, how to represent a given scene and extract its features are still open research…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Ali Keysan , Andreas Look , Eitan Kosman , Gonca Gürsun , Jörg Wagner , Yu Yao , Barbara Rakitsch

Determining the traffic scenario space is a major challenge for the homologation and coverage assessment of automated driving functions. In contrast to current approaches that are mainly scenario-based and rely on expert knowledge, we…

Machine Learning · Computer Science 2020-07-16 Nick Harmening , Marin Biloš , Stephan Günnemann

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

For the offline safety assessment of automated vehicles, the most challenging and critical scenarios must be identified efficiently. Therefore, we present a new approach to define challenging scenarios based on a sensor setup model of the…

Robotics · Computer Science 2020-08-27 Thomas Ponn , Thomas Lanz , Frank Diermeyer

Driving in the dynamic, multi-agent, and complex urban environment is a difficult task requiring a complex decision policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid-level…

Robotics · Computer Science 2020-03-03 Eshagh Kargar , Ville Kyrki

For reliable autonomous robot navigation in urban settings, the robot must have the ability to identify semantically traversable terrains in the image based on the semantic understanding of the scene. This reasoning ability is based on…

Robotics · Computer Science 2024-12-30 Yunho Kim , Jeong Hyun Lee , Choongin Lee , Juhyeok Mun , Donghoon Youm , Jeongsoo Park , Jemin Hwangbo

Scene understanding is an essential technique in semantic segmentation. Although there exist several datasets that can be used for semantic segmentation, they are mainly focused on semantic image segmentation with large deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Byungju Kim , Junho Yim , Junmo Kim

For autonomous agents to successfully operate in the real world, anticipation of future events and states of their environment is a key competence. This problem can be formalized as a sequence prediction problem, where a number of…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Apratim Bhattacharyya , Mario Fritz , Bernt Schiele

Predicting the future location of vehicles is essential for safety-critical applications such as advanced driver assistance systems (ADAS) and autonomous driving. This paper introduces a novel approach to simultaneously predict both the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Yu Yao , Mingze Xu , Chiho Choi , David J. Crandall , Ella M. Atkins , Behzad Dariush

In the field of conditional autonomous driving technology, driver perceived risk prediction plays a crucial role in reducing traffic risks and ensuring passenger safety. This study introduces an innovative perceived risk prediction model…

Human-Computer Interaction · Computer Science 2025-03-07 Chenhao Yang , Siwei Huang , Chuan Hu

Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zhigang Sun , Zixu Wang , Lavdim Halilaj , Juergen Luettin

Representing diverse and plausible future trajectories is critical for motion forecasting in autonomous driving. However, efficiently capturing these trajectories in a compact set remains challenging. This study introduces a novel approach…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Abhishek Vivekanandan , J. Marius Zöllner

Semantic scene segmentation has primarily been addressed by forming representations of single images both with supervised and unsupervised methods. The problem of semantic segmentation in dynamic scenes has begun to recently receive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Li Ding , Jack Terwilliger , Rini Sherony , Bryan Reimer , Lex Fridman

Semantic segmentation was seen as a challenging computer vision problem few years ago. Due to recent advancements in deep learning, relatively accurate solutions are now possible for its use in automated driving. In this paper, the semantic…

Machine Learning · Statistics 2017-08-04 Mennatullah Siam , Sara Elkerdawy , Martin Jagersand , Senthil Yogamani

Semantic scene understanding is crucial for robotics and computer vision applications. In autonomous driving, 3D semantic segmentation plays an important role for enabling safe navigation. Despite significant advances in the field, the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Lucas Nunes , Rodrigo Marcuzzi , Jens Behley , Cyrill Stachniss