English
Related papers

Related papers: Leveraging RGB-D Data with Cross-Modal Context Min…

200 papers

Given the widespread adoption of depth-sensing acquisition devices, RGB-D videos and related data/media have gained considerable traction in various aspects of daily life. Consequently, conducting salient object detection (SOD) in RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Ao Mou , Yukang Lu , Jiahao He , Dingyao Min , Keren Fu , Qijun Zhao

Recent advances in 3D semantic scene understanding have shown impressive progress in 3D instance segmentation, enabling object-level reasoning about 3D scenes; however, a finer-grained understanding is required to enable interactions with…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Alexey Bokhovkin , Vladislav Ishimtsev , Emil Bogomolov , Denis Zorin , Alexey Artemov , Evgeny Burnaev , Angela Dai

Visual place classification from a first-person-view monocular RGB image is a fundamental problem in long-term robot navigation. A difficulty arises from the fact that RGB image classifiers are often vulnerable to spatial and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Tomoya Iwasaki , Kanji Tanaka , Kenta Tsukahara

The integration of RGB and depth modalities significantly enhances the accuracy of segmenting complex indoor scenes, with depth data from RGB-D cameras playing a crucial role in this improvement. However, collecting an RGB-D dataset is more…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xinhua Xu , Hong Liu , Jianbing Wu , Jinfu Liu

Glass surfaces of transparent objects and mirrors are not able to be uniquely and explicitly characterized by their visual appearances because they contain the visual appearance of other reflected or transmitted surfaces as well. Detecting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Dongshen Han , Seungkyu Lee , Chaoning Zhang , Heechan Yoon , Hyukmin Kwon , Hyun-Cheol Kim , Hyon-Gon Choo

Camouflaged object detection (COD) presents a persistent challenge in accurately identifying objects that seamlessly blend into their surroundings. However, most existing COD models overlook the fact that visual systems operate within a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Xinran Liua , Lin Qia , Yuxuan Songa , Qi Wen

RGB-D cameras supply rich and dense visual and spatial information for various robotics tasks such as scene understanding, map reconstruction, and localization. Integrating depth and visual information can aid robots in localization and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Ali Tourani , Saad Ejaz , Hriday Bavle , Jose Luis Sanchez-Lopez , Holger Voos

Multi-modality of color and depth, i.e., RGB-D, is of great importance in recent research of indoor scene recognition. In this kind of data representation, depth map is able to describe the 3D structure of scenes and geometric relations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Qiong Liu , Ruofei Xiong , Xingzhen Chen , Muyao Peng , You Yang

Most of the existing visual SLAM methods heavily rely on a static world assumption and easily fail in dynamic environments. Some recent works eliminate the influence of dynamic objects by introducing deep learning-based semantic information…

Robotics · Computer Science 2022-01-10 Tete Ji , Chen Wang , Lihua Xie

How to effectively fuse cross-modal information is the key problem for RGB-D salient object detection. Early fusion and the result fusion schemes fuse RGB and depth information at the input and output stages, respectively, hence incur the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Nian Liu , Ni Zhang , Ling Shao , Junwei Han

Scene understanding is an active research area. Commercial depth sensors, such as Kinect, have enabled the release of several RGB-D datasets over the past few years which spawned novel methods in 3D scene understanding. More recently with…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Gilad Baruch , Zhuoyuan Chen , Afshin Dehghan , Tal Dimry , Yuri Feigin , Peter Fu , Thomas Gebauer , Brandon Joffe , Daniel Kurz , Arik Schwartz , Elad Shulman

The popularity and promotion of depth maps have brought new vigor and vitality into salient object detection (SOD), and a mass of RGB-D SOD algorithms have been proposed, mainly concentrating on how to better integrate cross-modality…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Chen Zhang , Runmin Cong , Qinwei Lin , Lin Ma , Feng Li , Yao Zhao , Sam Kwong

Collecting diverse sets of training images for RGB-D semantic image segmentation is not always possible. In particular, when robots need to operate in privacy-sensitive areas like homes, the collection is often limited to a small set of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Shijie Li , Rong Li , Juergen Gall

Augmenting RGB data with measured depth has been shown to improve the performance of a range of tasks in computer vision including object detection and semantic segmentation. Although depth sensors such as the Microsoft Kinect have…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yuanzhouhan Cao , Chunhua Shen , Heng Tao Shen

This paper presents a new multi-view RGB-D dataset of nine kitchen scenes, each containing several objects in realistic cluttered environments including a subset of objects from the BigBird dataset. The viewpoints of the scenes are densely…

Computer Vision and Pattern Recognition · Computer Science 2016-09-27 Georgios Georgakis , Md Alimoor Reza , Arsalan Mousavian , Phi-Hung Le , Jana Kosecka

The goal of our work is to complete the depth channel of an RGB-D image. Commodity-grade depth cameras often fail to sense depth for shiny, bright, transparent, and distant surfaces. To address this problem, we train a deep network that…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Yinda Zhang , Thomas Funkhouser

In this paper, we study the problem of salient object detection (SOD) for RGB-D images using both color and depth information.A major technical challenge in performing salient object detection fromRGB-D images is how to fully leverage the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Ao Luo , Xin Li , Fan Yang , Zhicheng Jiao , Hong Cheng , Siwei Lyu

Indoor robot navigation is often compromised by glass surfaces, which severely corrupt depth sensor measurements. While foundation models like Depth Anything 3 provide excellent geometric priors, they lack an absolute metric scale. We…

Robotics · Computer Science 2026-05-07 Jiamin Zheng , Jingwen Yu , Guangcheng Chen , Hong Zhang

In this paper we study the problem of object detection for RGB-D images using semantically rich image and depth features. We propose a new geocentric embedding for depth images that encodes height above ground and angle with gravity for…

Computer Vision and Pattern Recognition · Computer Science 2014-07-23 Saurabh Gupta , Ross Girshick , Pablo Arbeláez , Jitendra Malik

The increasing adoption of human-robot interaction presents opportunities for technology to positively impact lives, particularly those with visual impairments, through applications such as guide-dog-like assistive robotics. We present a…

Robotics · Computer Science 2024-08-27 Adam Scicluna , Cedric Le Gentil , Sheila Sutjipto , Gavin Paul