English
Related papers

Related papers: Semantic sensor fusion: from camera to sparse lida…

200 papers

State-of-the-art approaches for the semantic labeling of LiDAR point clouds heavily rely on the use of deep Convolutional Neural Networks (CNNs). However, transferring network architectures across different LiDAR sensor types represents a…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Florian Piewak , Peter Pinggera , Marius Zöllner

In this paper we introduce a novel way to predict semantic information from sparse, single-shot LiDAR measurements in the context of autonomous driving. In particular, we fuse learned features from complementary representations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Frank Bieder , Maximilian Link , Simon Romanski , Haohao Hu , Christoph Stiller

Unmanned aerial vehicles (UAVs) equipped with multiple complementary sensors have tremendous potential for fast autonomous or remote-controlled semantic scene analysis, e.g., for disaster examination. In this work, we propose a UAV system…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Simon Bultmann , Jan Quenzel , Sven Behnke

We propose an algorithm for automatic, targetless, extrinsic calibration of a LiDAR and camera system using semantic information. We achieve this goal by maximizing mutual information (MI) of semantic information between sensors, leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Peng Jiang , Philip Osteen , Srikanth Saripalli

LiDAR semantic segmentation plays a crucial role in enabling autonomous driving and robots to understand their surroundings accurately and robustly. A multitude of methods exist within this domain, including point-based, range-image-based,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Rong Li , ShiJie Li , Xieyuanli Chen , Teli Ma , Juergen Gall , Junwei Liang

The combination of data from multiple sensors, also known as sensor fusion or data fusion, is a key aspect in the design of autonomous robots. In particular, algorithms able to accommodate sensor fusion techniques enable increased accuracy,…

Robotics · Computer Science 2021-03-26 Li Qingqing , Jorge Peña Queralta , Tuan Nguyen Gia , Zhuo Zou , Tomi Westerlund

LIDAR sensors are usually used to provide autonomous vehicles with 3D representations of their environment. In ideal conditions, geometrical models could detect the road in LIDAR scans, at the cost of a manual tuning of numerical…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Edouard Capellier , Franck Davoine , Veronique Cherfaoui , You Li

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

Autonomous off-road navigation requires an accurate semantic understanding of the environment, often converted into a bird's-eye view (BEV) representation for various downstream tasks. While learning-based methods have shown success in…

Robotics · Computer Science 2024-03-06 Ohn Kim , Junwon Seo , Seongyong Ahn , Chong Hui Kim

Realistic vehicle sensor simulation is an important element in developing autonomous driving. As physics-based implementations of visual sensors like LiDAR are complex in practice, data-based approaches promise solutions. Using pairs of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Richard Marcus , Felix Gabel , Niklas Knoop , Marc Stamminger

3D object detection task from lidar or camera sensors is essential for autonomous driving. Pioneer attempts at multi-modality fusion complement the sparse lidar point clouds with rich semantic texture information from images at the cost of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bo Ju , Zhikang Zou , Xiaoqing Ye , Minyue Jiang , Xiao Tan , Errui Ding , Jingdong Wang

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

In a fully autonomous driving framework, where vehicles operate without human intervention, information sharing plays a fundamental role. In this context, new network solutions have to be designed to handle the large volumes of data…

Networking and Internet Architecture · Computer Science 2021-03-08 Andrea Varischio , Francesco Mandruzzato , Marcello Bullo , Marco Giordani , Paolo Testolina , Michele Zorzi

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While most prevalent methods progressively downscale the 3D point clouds and camera images and then fuse the high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zixuan Yin , Han Sun , Ningzhong Liu , Huiyu Zhou , Jiaquan Shen

This paper addresses the problem of holistic road scene understanding based on the integration of visual and range data. To achieve the grand goal, we propose an approach that jointly tackles object-level image segmentation and semantic…

Computer Vision and Pattern Recognition · Computer Science 2014-07-01 Wenqi Huang , Xiaojin Gong

This paper presents a fully unsupervised deep change detection approach for mobile robots with 3D LiDAR. In unstructured environments, it is infeasible to define a closed set of semantic classes. Instead, semantic segmentation is…

Robotics · Computer Science 2024-05-01 Alexander Krawciw , Jordy Sehn , Timothy D. Barfoot

Autonomous vehicles rely on camera, LiDAR, and radar sensors to navigate the environment. Adverse weather conditions like snow, rain, and fog are known to be problematic for both camera and LiDAR-based perception systems. Currently, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Aldi Piroli , Vinzenz Dallabetta , Johannes Kopp , Marc Walessa , Daniel Meissner , Klaus Dietmayer

Autonomous vehicles were experiencing rapid development in the past few years. However, achieving full autonomy is not a trivial task, due to the nature of the complex and dynamic driving environment. Therefore, autonomous vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Yaodong Cui , Ren Chen , Wenbo Chu , Long Chen , Daxin Tian , Ying Li , Dongpu Cao

Recent advancements in statistical learning and computational abilities have enabled autonomous vehicle technology to develop at a much faster rate. While many of the architectures previously introduced are capable of operating under highly…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 David Paz , Hengyuan Zhang , Qinru Li , Hao Xiang , Henrik Christensen

Although significant progress has been made, achieving place recognition in environments with perspective changes, seasonal variations, and scene transformations remains challenging. Relying solely on perception information from a single…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yan Pan , Jiapeng Xie , Jiajie Wu , Bo Zhou