English
Related papers

Related papers: Leveraging RGB-D Data with Cross-Modal Context Min…

200 papers

Multi-sensor fusion has significant potential in perception tasks for both indoor and outdoor environments. Especially under challenging conditions such as adverse weather and low-light environments, the combined use of millimeter-wave…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Tieshuai Song , Jiandong Ye , Ao Guo , Guidong He , Bin Yang

As a newly emerging and significant topic in computer vision community, co-saliency detection aims at discovering the common salient objects in multiple related images. The existing methods often generate the co-saliency map through a…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Runmin Cong , Jianjun Lei , Huazhu Fu , Weisi Lin , Qingming Huang , Xiaochun Cao , Chunping Hou

There have been significant advancements in dynamic novel view synthesis in recent years. However, current deep learning models often require (1) prior models (e.g., SMPL human models), (2) heavy pre-processing, or (3) per-scene…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Shengze Wang , YoungJoong Kwon , Yuan Shen , Qian Zhang , Andrei State , Jia-Bin Huang , Henry Fuchs

Detecting glass regions is a challenging task due to the ambiguity of their transparency and reflection properties. These transparent glasses share the visual appearance of both transmitted arbitrary background scenes and reflected objects,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jing Hao , Moyun Liu , Kuo Feng Hung

Object detection is an essential task for autonomous robots operating in dynamic and changing environments. A robot should be able to detect objects in the presence of sensor noise that can be induced by changing lighting conditions for…

Robotics · Computer Science 2019-11-20 Oier Mees , Andreas Eitel , Wolfram Burgard

Depth maps contain geometric clues for assisting Salient Object Detection (SOD). In this paper, we propose a novel Cross-Modal Weighting (CMW) strategy to encourage comprehensive interactions between RGB and depth channels for RGB-D SOD.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Gongyang Li , Zhi Liu , Linwei Ye , Yang Wang , Haibin Ling

Stairs are common building structures in urban environments, and stair detection is an important part of environment perception for autonomous mobile robots. Most existing algorithms have difficulty combining the visual information from…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Chen Wang , Zhongcai Pei , Shuang Qiu , Zhiyong Tang

We present an effective method to progressively integrate and refine the cross-modality complementarities for RGB-D salient object detection (SOD). The proposed network mainly solves two challenging issues: 1) how to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Chongyi Li , Runmin Cong , Yongri Piao , Qianqian Xu , Chen Change Loy

Salient object detection on RGB-D images is an active topic in computer vision. Although the existing methods have achieved appreciable performance, there are still some challenges. The locality of convolutional neural network requires that…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xian Fang , Jinshao Zhu , Xiuli Shao , Hongpeng Wang

Scene recognition with RGB images has been extensively studied and has reached very remarkable recognition levels, thanks to convolutional neural networks (CNN) and large scene datasets. In contrast, current RGB-D scene data is much more…

Computer Vision and Pattern Recognition · Computer Science 2018-01-23 Xinhang Song , Luis Herranz , Shuqiang Jiang

With the rapid development of depth sensor, more and more RGB-D videos could be obtained. Identifying the foreground in RGB-D videos is a fundamental and important task. However, the existing salient object detection (SOD) works only focus…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Junhao Lin , Lei Zhu , Jiaxing Shen , Huazhu Fu , Qing Zhang , Liansheng Wang

Robust object recognition is a crucial ingredient of many, if not all, real-world robotics applications. This paper leverages recent progress on Convolutional Neural Networks (CNNs) and proposes a novel RGB-D architecture for object…

Computer Vision and Pattern Recognition · Computer Science 2015-08-19 Andreas Eitel , Jost Tobias Springenberg , Luciano Spinello , Martin Riedmiller , Wolfram Burgard

Image salient object detection (SOD) is an active research topic in computer vision and multimedia area. Fusing complementary information of RGB and depth has been demonstrated to be effective for image salient object detection which is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Bo Jiang , Zitai Zhou , Xiao Wang , Jin Tang , Bin Luo

The basis of many object manipulation algorithms is RGB-D input. Yet, commodity RGB-D sensors can only provide distorted depth maps for a wide range of transparent objects due light refraction and absorption. To tackle the perception…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Haoping Xu , Yi Ru Wang , Sagi Eppel , Alàn Aspuru-Guzik , Florian Shkurti , Animesh Garg

Detailed 3D reconstruction is an important challenge with application to robotics, augmented and virtual reality, which has seen impressive progress throughout the past years. Advancements were driven by the availability of depth cameras…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Andrea Nicastro , Ronald Clark , Stefan Leutenegger

Access to large, diverse RGB-D datasets is critical for training RGB-D scene understanding algorithms. However, existing datasets still cover only a limited number of views or a restricted scale of spaces. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Angel Chang , Angela Dai , Thomas Funkhouser , Maciej Halber , Matthias Nießner , Manolis Savva , Shuran Song , Andy Zeng , Yinda Zhang

Robotic research encounters a significant hurdle when it comes to the intricate task of grasping objects that come in various shapes, materials, and textures. Unlike many prior investigations that heavily leaned on specialized point-cloud…

Robotics · Computer Science 2024-03-15 Chang Liu , Kejian Shi , Kaichen Zhou , Haoxiao Wang , Jiyao Zhang , Hao Dong

In the RGB-D vision community, extensive research has been focused on designing multi-modal learning strategies and fusion structures. However, the complementary and fusion mechanisms in RGB-D models remain a black box. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Hao Chen , Haoran Zhou , Yunshu Zhang , Zheng Lin , Yongjian Deng

We propose a new deep learning architecture for the tasks of semantic segmentation and depth prediction from RGB-D images. We revise the state of art based on the RGB and depth feature fusion, where both modalities are assumed to be…

Artificial Intelligence · Computer Science 2018-12-18 Giorgio Giannone , Boris Chidlovskii

Given the diversity of devices and the product upgrades, cross-device research has become an urgent issue that needs to be tackled. To this end, we pioneer in probing the cross-device (cameras & robotics) grasping policy in the 3D open…

Robotics · Computer Science 2025-08-05 Weiguang Zhao , Chenru Jiang , Chengrui Zhang , Jie Sun , Yuyao Yan , Rui Zhang , Kaizhu Huang