English
Related papers

Related papers: Extrinsic Camera Calibration with Semantic Segment…

200 papers

To navigate through urban roads, an automated vehicle must be able to perceive and recognize objects in a three-dimensional environment. A high-level contextual understanding of the surroundings is necessary to plan and execute accurate…

Robotics · Computer Science 2020-03-05 Julie Stephany Berrio , Mao Shan , Stewart Worrall , James Ward , Eduardo Nebot

With information from multiple input modalities, sensor fusion-based algorithms usually out-perform their single-modality counterparts in robotics. Camera and LIDAR, with complementary semantic and depth information, are the typical choices…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Akio Kodaira , Yiyang Zhou , Pengwei Zang , Wei Zhan , Masayoshi Tomizuka

This paper presents an open source LiDAR-camera calibration toolbox that is general to LiDAR and camera projection models, requires only one pairing of LiDAR and camera data without a calibration target, and is fully automatic. For…

Robotics · Computer Science 2023-02-13 Kenji Koide , Shuji Oishi , Masashi Yokozuka , Atsuhiko Banno

Accurate extrinsic calibration between LiDAR and camera sensors is important for reliable perception in autonomous systems. In this paper, we present a novel multi-objective optimization framework that jointly minimizes the geometric…

Robotics · Computer Science 2025-06-26 Venkat Karramreddy , Rangarajan Ramanujam

In the field of SLAM (Simultaneous Localization And Mapping) for robot navigation, mapping the environment is an important task. In this regard the Lidar sensor can produce near accurate 3D map of the environment in the format of point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Aritra Mukherjee , Sourya Dipta Das , Jasorsi Ghosh , Ananda S. Chowdhury , Sanjoy Kumar Saha

Segmenting objects in an environment is a crucial task for autonomous driving and robotics, as it enables a better understanding of the surroundings of each agent. Although camera sensors provide rich visual details, they are vulnerable to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Huawei Sun , Bora Kunter Sahin , Georg Stettinger , Maximilian Bernhard , Matthias Schubert , Robert Wille

LiDARs are widely used for mapping and localization in dynamic environments. However, their high cost limits their widespread adoption. On the other hand, monocular localization in LiDAR maps using inexpensive cameras is a cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Daniele Cattaneo , Abhinav Valada

Estimating a scene's depth to achieve collision avoidance against moving pedestrians is a crucial and fundamental problem in the robotic field. This paper proposes a novel, low complexity network architecture for fast and accurate human…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shan An , Fangru Zhou , Mei Yang , Haogang Zhu , Changhong Fu , Konstantinos A. Tsintotas

Prior point cloud provides 3D environmental context, which enhances the capabilities of monocular camera in downstream vision tasks, such as 3D object detection, via data fusion. However, the absence of accurate and automated registration…

Robotics · Computer Science 2024-04-09 Yu Sheng , Lu Zhang , Xingchen Li , Yifan Duan , Yanyong Zhang , Yu Zhang , Jianmin Ji

Calibration of sensors is fundamental to robust performance for intelligent vehicles. In natural environments, disturbances can easily challenge calibration. One possibility is to use natural objects of known shape to recalibrate sensors.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yunhai Han , Yuhan Liu , David Paz , Henrik Christensen

The fusion of sensor data from heterogeneous sensors is crucial for robust perception in various robotics applications that involve moving platforms, for instance, autonomous vehicle navigation. In particular, combining camera and lidar…

Robotics · Computer Science 2020-03-10 Mao Shan , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

It is a crucial step to achieve effective semantic segmentation of lane marking during the construction of the lane level high-precision map. In recent years, many image semantic segmentation methods have been proposed. These methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Ruochen Yin , Biao Yu , Huapeng Wu , Yutao Song , Runxin Niu

Surveillance videos and images are used for a broad set of applications, ranging from traffic analysis to crime detection. Extrinsic camera calibration data is important for most analysis applications. However, security cameras are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Giacomo D'Amicantonio , Egor Bondarau , Peter H. N. De With

Semantic segmentation using deep neural networks has been widely explored to generate high-level contextual information for autonomous vehicles. To acquire a complete $180^\circ$ semantic understanding of the forward surroundings, we…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Wei Zhou , Alex Zyner , Stewart Worrall , Eduardo Nebot

Stereo cameras and dense stereo matching algorithms are core components for many robotic applications due to their abilities to directly obtain dense depth measurements and their robustness against changes in lighting conditions. However,…

Robotics · Computer Science 2019-03-27 Yonggen Ling , Shaojie Shen

Accurate 3D reconstruction using multi-camera RGB-D systems critically depends on precise extrinsic calibration to achieve proper alignment between captured views. In this paper, we introduce an iterative extrinsic calibration method that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Nahuel Garcia-D'Urso , Bernabe Sanchez-Sos , Jorge Azorin-Lopez , Andres Fuster-Guillo , Antonio Macia-Lillo , Higinio Mora-Mora

Camera calibration is a necessity in various tasks including 3D reconstruction, hand-eye coordination for a robotic interaction, autonomous driving, etc. In this work we propose a novel method to predict extrinsic (baseline, pitch, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Talha Hanif Butt , Murtaza Taj

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

In autonomous systems, sensor calibration is essential for safe and efficient navigation in dynamic environments. Accurate calibration is a prerequisite for reliable perception and planning tasks such as object detection and obstacle…

Robotics · Computer Science 2026-02-02 Ilir Tahiraj , Markus Edinger , Dominik Kulmer , Markus Lienkamp

Autonomous driving is a safety-critical application, and it is therefore a top priority that the accompanying assistance systems are able to provide precise information about the surrounding environment of the vehicle. Tasks such as 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Dan Halperin , Niklas Eisl