English
Related papers

Related papers: Leveraging RGB-D Data with Cross-Modal Context Min…

200 papers

The use of RGB-D information for salient object detection has been extensively explored in recent years. However, relatively few efforts have been put towards modeling salient object detection in real-world human activity scenes with RGBD.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Deng-Ping Fan , Zheng Lin , Jia-Xing Zhao , Yun Liu , Zhao Zhang , Qibin Hou , Menglong Zhu , Ming-Ming Cheng

Scene understanding plays a critical role in enabling intelligence and autonomy in robotic systems. Traditional approaches often face challenges, including occlusions, ambiguous boundaries, and the inability to adapt attention based on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guodong Sun , Junjie Liu , Gaoyang Zhang , Bo Wu , Yang Zhang

The 3D scene understanding is mainly considered as a crucial requirement in computer vision and robotics applications. One of the high-level tasks in 3D scene understanding is semantic segmentation of RGB-Depth images. With the availability…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Fahimeh Fooladgar , Shohreh Kasaei

RGB-D saliency detection aims to fuse multi-modal cues to accurately localize salient regions. Existing works often adopt attention modules for feature modeling, with few methods explicitly leveraging fine-grained details to merge with…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Zongwei Wu , Guillaume Allibert , Fabrice Meriaudeau , Chao Ma , Cédric Demonceaux

In the last decade, the computer vision field has seen significant progress in multimodal data fusion and learning, where multiple sensors, including depth, infrared, and visual, are used to capture the environment across diverse spectral…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Martin Brenner , Napoleon H. Reyes , Teo Susnjak , Andre L. C. Barczak

The main purpose of RGB-D salient object detection (SOD) is how to better integrate and utilize cross-modal fusion information. In this paper, we explore these issues from a new perspective. We integrate the features of different modalities…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Youwei Pang , Lihe Zhang , Xiaoqi Zhao , Huchuan Lu

Object detection from RGB images is a long-standing problem in image processing and computer vision. It has applications in various domains including robotics, surveillance, human-computer interaction, and medical diagnosis. With the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Isaac Ronald Ward , Hamid Laga , Mohammed Bennamoun

Efficient RGB-D semantic segmentation has received considerable attention in mobile robots, which plays a vital role in analyzing and recognizing environmental information. According to previous studies, depth information can provide…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yang Zhang , Chenyun Xiong , Junjie Liu , Xuhui Ye , Guodong Sun

This work addresses the task of open world semantic segmentation using RGBD sensing to discover new semantic classes over time. Although there are many types of objects in the real-word, current semantic segmentation methods make a closed…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Yoshikatsu Nakajima , Byeongkeun Kang , Hideo Saito , Kris Kitani

Conventional RGB-D salient object detection methods aim to leverage depth as complementary information to find the salient regions in both modalities. However, the salient object detection results heavily rely on the quality of captured…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Yifan Zhao , Jiawei Zhao , Jia Li , Xiaowu Chen

We address the problem of glass surface segmentation with an RGB-D camera, with a focus on effectively fusing RGB and depth information. To this end, we propose a Weighted Feature Fusion (WFF) module that dynamically and adaptively combines…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Henghong Lin , Zihan Zhu , Tao Wang , Anastasia Ioannou , Yuanshui Huang

Automated monitoring and analysis of passenger movement in safety-critical parts of transport infrastructures represent a relevant visual surveillance task. Recent breakthroughs in visual representation learning and spatial sensing opened…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Marco Wallner , Daniel Steininger , Verena Widhalm , Matthias Schörghuber , Csaba Beleznai

Majority of the perception methods in robotics require depth information provided by RGB-D cameras. However, standard 3D sensors fail to capture depth of transparent objects due to refraction and absorption of light. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Luyang Zhu , Arsalan Mousavian , Yu Xiang , Hammad Mazhar , Jozef van Eenbergen , Shoubhik Debnath , Dieter Fox

Current approaches to 3D scene graph generation rely on dedicated depth sensors, such as LiDAR or RGB-D cameras, for metric 3D reconstruction. This limits deployment to specialized robotic platforms and excludes settings where only RGB…

Robotics · Computer Science 2026-05-19 Giorgia Modi , Davide Buoso , Giuseppe Averta , Daniele De Martini

This paper presents a novel deep neural network framework for RGB-D salient object detection by controlling the message passing between the RGB images and depth maps on the feature level and exploring the long-range semantic contexts and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Baian Chen , Zhilei Chen , Xiaowei Hu , Jun Xu , Haoran Xie , Mingqiang Wei , Jing Qin

This paper proposes a new glass segmentation method utilizing paired RGB and thermal images. Due to the large difference between the transmission property of visible light and that of the thermal energy through the glass where most glass is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Dong Huo , Jian Wang , Yiming Qian , Yee-Hong Yang

Transparent objects are common in our daily life and frequently handled in the automated production line. Robust vision-based robotic grasping and manipulation for these objects would be beneficial for automation. However, the majority of…

Robotics · Computer Science 2022-08-30 Hongjie Fang , Hao-Shu Fang , Sheng Xu , Cewu Lu

Salient object detection (SOD) has been well studied in recent years, especially using deep neural networks. However, SOD with RGB and RGB-D images is usually treated as two different tasks with different network structures that need to be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Peng Peng , Yong-Jie Li

Existing RGB-D saliency detection models do not explicitly encourage RGB and depth to achieve effective multi-modal learning. In this paper, we introduce a novel multi-stage cascaded learning framework via mutual information minimization to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Jing Zhang , Deng-Ping Fan , Yuchao Dai , Xin Yu , Yiran Zhong , Nick Barnes , Ling Shao

The extensive research leveraging RGB-D information has been exploited in salient object detection. However, salient visual cues appear in various scales and resolutions of RGB images due to semantic gaps at different feature levels.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Ze-yu Liu , Jian-wei Liu , Xin Zuo , Ming-fei Hu