English
Related papers

Related papers: Depth Matters: Multimodal RGB-D Perception for Rob…

200 papers

Existing deep learning-based image inpainting methods typically rely on convolutional networks with RGB images to reconstruct images. However, relying exclusively on RGB images may neglect important depth information, which plays a critical…

Image and Video Processing · Electrical Eng. & Systems 2025-05-09 Jin Hyun Park , Harine Choi , Praewa Pitiphat

Automated monitoring and analysis of passenger movement in safety-critical parts of transport infrastructures represent a relevant visual surveillance task. Recent breakthroughs in visual representation learning and spatial sensing opened…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Marco Wallner , Daniel Steininger , Verena Widhalm , Matthias Schörghuber , Csaba Beleznai

Deep neural networks designed for vision tasks are often prone to failure when they encounter environmental conditions not covered by the training data. Single-modal strategies are insufficient when the sensor fails to acquire information…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Osama Mazhar , Robert Babuska , Jens Kober

Semantic segmentation has made striking progress due to the success of deep convolutional neural networks. Considering the demands of autonomous driving, real-time semantic segmentation has become a research hotspot these years. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Lei Sun , Kailun Yang , Xinxin Hu , Weijian Hu , Kaiwei Wang

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

In this paper, we propose a neural network architecture for scale-invariant semantic segmentation using RGB-D images. We utilize depth information as an additional modality apart from color images only. Especially in an outdoor scene which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Mohammad Dawud Ansari , Alwi Husada , Didier Stricker

Autonomous driving systems rely heavily on robust sensor fusion to perceive complex envi- ronments. Traditional setups using RGB cameras and LiDAR often struggle in high-dynamic- range scenes or high-speed scenarios due to motion blur and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Mustafa Sakhaia , Kaung Sithua , Min Khant Soe Okea , Maciej Wielgosza

Augmenting RGB data with measured depth has been shown to improve the performance of a range of tasks in computer vision including object detection and semantic segmentation. Although depth sensors such as the Microsoft Kinect have…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yuanzhouhan Cao , Chunhua Shen , Heng Tao Shen

Image segmentation is a vital task for providing human assistance and enhancing autonomy in our daily lives. In particular, RGB-D segmentation-leveraging both visual and depth cues-has attracted increasing attention as it promises richer…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Aecheon Jung , Soyun Choi , Junhong Min , Sungeun Hong

Scene understanding for autonomous vehicles is a challenging computer vision task, with recent advances in convolutional neural networks (CNNs) achieving results that notably surpass prior traditional feature driven approaches. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Christopher J. Holder , Toby P. Breckon , Xiong Wei

Scene recognition with RGB images has been extensively studied and has reached very remarkable recognition levels, thanks to convolutional neural networks (CNN) and large scene datasets. In contrast, current RGB-D scene data is much more…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Xinhang Song , Luis Herranz , Shuqiang Jiang

Autonomous vehicles increasingly rely on cameras to provide the input for perception and scene understanding and the ability of these models to classify their environment and objects, under adverse conditions and image noise is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Andreas Papachristodoulou , Christos Kyrkou , Theocharis Theocharides

Scene understanding plays a critical role in enabling intelligence and autonomy in robotic systems. Traditional approaches often face challenges, including occlusions, ambiguous boundaries, and the inability to adapt attention based on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guodong Sun , Junjie Liu , Gaoyang Zhang , Bo Wu , Yang Zhang

Ground-truth RGBD data are fundamental for a wide range of computer vision applications; however, those labeled samples are difficult to collect and time-consuming to produce. A common solution to overcome this lack of data is to employ…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 L. Papa , P. Russo , I. Amerini

Dual-arm robots have great application prospects in intelligent manufacturing due to their human-like structure when deployed with advanced intelligence algorithm. However, the previous visuomotor policy suffers from perception deficiencies…

Robotics · Computer Science 2024-04-30 Jian Shen , Jiaxin Huang , Zhigong Song

Majority of the perception methods in robotics require depth information provided by RGB-D cameras. However, standard 3D sensors fail to capture depth of transparent objects due to refraction and absorption of light. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Luyang Zhu , Arsalan Mousavian , Yu Xiang , Hammad Mazhar , Jozef van Eenbergen , Shoubhik Debnath , Dieter Fox

LiDAR has become a standard sensor for autonomous driving applications as they provide highly precise 3D point clouds. LiDAR is also robust for low-light scenarios at night-time or due to shadows where the performance of cameras is…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Khaled El Madawy , Hazem Rashed , Ahmad El Sallab , Omar Nasr , Hanan Kamel , Senthil Yogamani

Scene recognition is one of the basic problems in computer vision research with extensive applications in robotics. When available, depth images provide helpful geometric cues that complement the RGB texture information and help to identify…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Andrea Ferreri , Silvia Bucci , Tatiana Tommasi

Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and…

Robotics · Computer Science 2022-09-20 Jaime Ruiz-Serra , Jack White , Stephen Petrie , Tatiana Kameneva , Chris McCarthy

RGB-D saliency detection integrates information from both RGB images and depth maps to improve prediction of salient regions under challenging conditions. The key to RGB-D saliency detection is to fully mine and fuse information at multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Yue Wang , Xu Jia , Lu Zhang , Yuke Li , James Elder , Huchuan Lu