English
Related papers

Related papers: Deep Sensor Fusion with Pyramid Fusion Networks fo…

200 papers

In recent studies, numerous previous works emphasize the importance of semantic segmentation of LiDAR data as a critical component to the development of driver-assistance systems and autonomous vehicles. However, many state-of-the-art…

In this paper, we introduce Semi-SMD, a novel metric depth estimation framework tailored for surrounding cameras equipment in autonomous driving. In this work, the input data consists of adjacent surrounding frames and camera parameters. We…

Robotics · Computer Science 2025-09-10 Yusen Xie , Zhengmin Huang , Shaojie Shen , Jun Ma

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

Retaining spatial characteristics of panchromatic image and spectral information of multispectral bands is a critical issue in pansharpening. This paper proposes a pyramid based deep fusion framework that preserves spectral and spatial…

Image and Video Processing · Electrical Eng. & Systems 2021-02-18 Hannan Adeel , Syed Sohaib Ali , Muhammad Mohsin Riaz , Syed Abdul Mannan Kirmani , Muhammad Imran Qureshi , Junaid Imtiaz

The combination of data from multiple sensors, also known as sensor fusion or data fusion, is a key aspect in the design of autonomous robots. In particular, algorithms able to accommodate sensor fusion techniques enable increased accuracy,…

Robotics · Computer Science 2021-03-26 Li Qingqing , Jorge Peña Queralta , Tuan Nguyen Gia , Zhuo Zou , Tomi Westerlund

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

We consider the problem of segmentation and classification of high-resolution and hyperspectral remote sensing images. Unlike conventional natural (RGB) images, the inherent large scale and complex structures of remote sensing images pose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Qingsong Xu , Xin Yuan , Chaojun Ouyang , Yue Zeng

Autonomous driving requires robust perception across diverse environmental conditions, yet 3D semantic occupancy prediction remains challenging under adverse weather and lighting. In this work, we present the first study combining 4D radar…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 David Ninfa , Andras Palffy , Holger Caesar

Indoor scene understanding remains a fundamental challenge in robotics, with direct implications for downstream tasks such as navigation and manipulation. Traditional approaches often rely on closed-set recognition or loop closure, limiting…

Robotics · Computer Science 2025-06-10 Hongming Chen , Yiyang Lin , Ziliang Li , Biyu Ye , Yuying Zhang , Ximin Lyu

Semantic segmentation has made striking progress due to the success of deep convolutional neural networks. Considering the demands of autonomous driving, real-time semantic segmentation has become a research hotspot these years. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Lei Sun , Kailun Yang , Xinxin Hu , Weijian Hu , Kaiwei Wang

Existing LiDAR-Camera fusion methods have achieved strong results in 3D object detection. To address the sparsity of point clouds, previous approaches typically construct spatial pseudo point clouds via depth completion as auxiliary input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jijun Wang , Yan Wu , Yujian Mo , Junqiao Zhao , Jun Yan , Yinghao Hu

We address the problem of reconstructing 3D surfaces from depth and surface normal maps acquired by a sensor system based on a single perspective camera. Depth and normal maps can be obtained through techniques such as structured-light…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ondrej Hlinka , Georg Kaniak , Christian Kapeller

The safety of an automated vehicle hinges crucially upon the accuracy of perception and decision-making latency. Under these stringent requirements, future automated cars are usually equipped with multi-modal sensors such as cameras and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-15 Zhendong Wang , Xiaoming Zeng , Shuaiwen Leon Song , Yang Hu

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

Semantic segmentation is one of the core tasks in the field of computer vision, and its goal is to accurately classify each pixel in an image. The traditional Unet model achieves efficient feature extraction and fusion through an…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Xuan Li , Quanchao Lu , Yankaiqi Li , Muqing Li , Yijiashun Qi

Semantic grids are a useful representation of the environment around a robot. They can be used in autonomous vehicles to concisely represent the scene around the car, capturing vital information for downstream tasks like navigation or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Manuel Alejandro Diaz-Zapata , Özgür Erkent , Christian Laugier , Jilles Dibangoye , David Sierra González

In this paper, we propose an accurate and robust perception module for Autonomous Vehicles (AVs) for drivable space extraction. Perception is crucial in autonomous driving, where many deep learning-based methods, while accurate on benchmark…

We present a mapping system capable of constructing detailed instance-level semantic models of room-sized indoor environments by means of an RGB-D camera. In this work, we integrate deep-learning-based instance segmentation and…

Robotics · Computer Science 2019-11-22 Dinh-Cuong Hoang , Todor Stoyanov , Achim J. Lilienthal

In this paper, we present a novel neural network using multi scale feature fusion at various scales for accurate and efficient semantic image segmentation. We used ResNet based feature extractor, dilated convolutional layers in downsampling…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Abhinav Sagar , RajKumar Soundrapandiyan

In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot…

Robotics · Computer Science 2022-12-27 Thanh Nguyen Canh , Truong Son Nguyen , Cong Hoang Quach , Xiem HoangVan , Manh Duong Phung