English
Related papers

Related papers: Validation & Exploration of Multimodal Deep-Learni…

200 papers

Camera calibration is a crucial technique which significantly influences the performance of many robotic systems. Robustness and high precision have always been the pursuit of diverse calibration methods. State-of-the-art calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Yesheng Zhang , Xu Zhao , Dahong Qian

Three-dimensional (3-D) synthetic aperture radar (SAR) is widely used in many security and industrial applications requiring high-resolution imaging of concealed or occluded objects. The ability to resolve intricate 3-D targets is essential…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Josiah Smith , Murat Torlak

Cameras and LiDAR are essential sensors for autonomous vehicles. The fusion of camera and LiDAR data addresses the limitations of individual sensors but relies on precise extrinsic calibration. Recently, numerous end-to-end calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ni Ou , Zhuo Chen , Xinru Zhang , Junzheng Wang

We introduce a discriminative multimodal descriptor based on a pair of sensor readings: a point cloud from a LiDAR and an image from an RGB camera. Our descriptor, named MinkLoc++, can be used for place recognition, re-localization and loop…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Jacek Komorowski , Monika Wysoczanska , Tomasz Trzcinski

This paper describes an optimized single-stage deep convolutional neural network to detect objects in urban environments, using nothing more than point cloud data. This feature enables our method to work regardless the time of the day and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Kazuki Minemura , Hengfui Liau , Abraham Monrroy , Shinpei Kato

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Reliable and accurate lane detection has been a long-standing problem in the field of autonomous driving. In recent years, many approaches have been developed that use images (or videos) as input and reason in image space. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Min Bai , Gellert Mattyus , Namdar Homayounfar , Shenlong Wang , Shrinidhi Kowshika Lakshmikanth , Raquel Urtasun

The primary requirement for cross-modal data fusion is the precise alignment of data from different sensors. However, the calibration between LiDAR point clouds and camera images is typically time-consuming and needs external calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Yuanchao Yue , Hui Yuan , Zhengxin Li , Shuai Li , Wei Zhang

Lidars and cameras play essential roles in autonomous driving, offering complementary information for 3D detection. The state-of-the-art fusion methods integrate them at the feature level, but they mostly rely on the learned soft…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Zixuan Yin , Han Sun , Ningzhong Liu , Huiyu Zhou , Jiaquan Shen

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool

Place recognition is critical for both offline mapping and online localization. However, current single-sensor based place recognition still remains challenging in adverse conditions. In this paper, a heterogeneous measurements based…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Huan Yin , Xuecheng Xu , Yue Wang , Rong Xiong

Camera localization, i.e., camera pose regression, represents an important task in computer vision since it has many practical applications such as in the context of intelligent vehicles and their localization. Having reliable estimates of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Matteo Vaghi , Augusto Luis Ballardini , Simone Fontana , Domenico Giorgio Sorrenti

Cameras and 2D laser scanners, in combination, are able to provide low-cost, light-weight and accurate solutions, which make their fusion well-suited for many robot navigation tasks. However, correct data fusion depends on precise…

Robotics · Computer Science 2019-08-02 Michelle Valente , Cyril Joly , Arnaud de La Fortelle

Chemical multisensor devices need calibration algorithms to estimate gas concentrations. Their possible adoption as indicative air quality measurements devices poses new challenges due to the need to operate in continuous monitoring modes…

Artificial Intelligence · Computer Science 2020-02-14 S. De Vito , E. Esposito , M. Salvato , O. Popoola , F. Formisano , R. Jones , G. Di Francia

Multiple lidars are prevalently used on mobile vehicles for rendering a broad view to enhance the performance of localization and perception systems. However, precise calibration of multiple lidars is challenging since the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Jianhao Jiao , Qinghai Liao , Yilong Zhu , Tianyu Liu , Yang Yu , Rui Fan , Lujia Wang , Ming Liu

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiment is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer…

Machine Learning · Statistics 2020-09-09 Saumya Bhatnagar , Won Chang , Seonjin Kim Jiali Wang

Collaborative robotic industrial cells are workspaces where robots collaborate with human operators. In this context, safety is paramount, and for that a complete perception of the space where the collaborative robot is inserted is…

Robotics · Computer Science 2022-10-20 Daniela Rato , Miguel Oliveira , Vítor Santos , Manuel Gomes , Angel Sappa

Sensor fusion is crucial for a performant and robust Perception system in autonomous vehicles, but sensor staleness, where data from different sensors arrives with varying delays, poses significant challenges. Temporal misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Meng Fan , Yifan Zuo , Patrick Blaes , Harley Montgomery , Subhasis Das

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

This paper presents a fully unsupervised deep change detection approach for mobile robots with 3D LiDAR. In unstructured environments, it is infeasible to define a closed set of semantic classes. Instead, semantic segmentation is…

Robotics · Computer Science 2024-05-01 Alexander Krawciw , Jordy Sehn , Timothy D. Barfoot