English
Related papers

Related papers: Towards Fusing Point Cloud and Visual Representati…

200 papers

In recent years, point cloud representation has become one of the research hotspots in the field of computer vision, and has been widely used in many fields, such as autonomous driving, virtual reality, robotics, etc. Although deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Huang Zhang , Changshuo Wang , Shengwei Tian , Baoli Lu , Liping Zhang , Xin Ning , Xiao Bai

3D object recognition has attracted wide research attention in the field of multimedia and computer vision. With the recent proliferation of deep learning, various deep models with different representations have achieved the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Haoxuan You , Yifan Feng , Rongrong Ji , Yue Gao

Pre-training on large-scale unlabeled datasets contribute to the model achieving powerful performance on 3D vision tasks, especially when annotations are limited. However, existing rendering-based self-supervised frameworks are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Hao Liu , Minglin Chen , Yanni Ma , Haihong Xiao , Ying He

Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annotation scarcity,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Thenukan Pathmanathan , Kanchan Keisham , Thangarajah Akilan

We present a learning-based method for 6 DoF pose estimation of rigid objects in point cloud data. Many recent learning-based approaches use primarily RGB information for detecting objects, in some cases with an added refinement step using…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Frederik Hagelskjær , Anders Glent Buch

Implicit Neural Point Cloud (INPC) is a recent hybrid representation that combines the expressiveness of neural fields with the efficiency of point-based rendering, achieving state-of-the-art image quality in novel view synthesis. However,…

The quality of point clouds is often limited by noise introduced during their capture process. Consequently, a fundamental 3D vision task is the removal of noise, known as point cloud filtering or denoising. State-of-the-art learning based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Dasith de Silva Edirimuni , Xuequan Lu , Zhiwen Shao , Gang Li , Antonio Robles-Kelly , Ying He

Point cloud analysis (such as 3D segmentation and detection) is a challenging task, because of not only the irregular geometries of many millions of unordered points, but also the great variations caused by depth, viewpoint, occlusion, etc.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Tuo Feng , Wenguan Wang , Xiaohan Wang , Yi Yang , Qinghua Zheng

This work studies the problem of unsupervised RGB-D point cloud registration, which aims at training a robust registration model without ground-truth pose supervision. Existing methods usually leverages unposed RGB-D sequences and adopt a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Zhinan Yu , Zheng Qin , Yijie Tang , Yongjun Wang , Renjiao Yi , Chenyang Zhu , Kai Xu

Three dimensional (3D) object recognition is becoming a key desired capability for many computer vision systems such as autonomous vehicles, service robots and surveillance drones to operate more effectively in unstructured environments.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Chenxi Xiao , Juan Wachs

Masked Autoencoders learn strong visual representations and achieve state-of-the-art results in several independent modalities, yet very few works have addressed their capabilities in multi-modality settings. In this work, we focus on point…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Anthony Chen , Kevin Zhang , Renrui Zhang , Zihan Wang , Yuheng Lu , Yandong Guo , Shanghang Zhang

On robotics computer vision tasks, generating and annotating large amounts of data from real-world for the use of deep learning-based approaches is often difficult or even impossible. A common strategy for solving this problem is to apply…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Chengzhi Wu , Xuelei Bi , Julius Pfrommer , Alexander Cebulla , Simon Mangold , Jürgen Beyerer

Point cloud completion aims to recover complete 3D geometry from partial observations caused by limited viewpoints and occlusions. Existing learning-based works, including 3D Convolutional Neural Network (CNN)-based, point-based, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Jiangyuan Liu , Yuhao Zhao , Hongxuan Ma , Zhe Liu , Jian Wang , Wei Zou

Robust imitation learning for robot manipulation requires comprehensive 3D perception, yet many existing methods struggle in cluttered environments. Fixed camera view approaches are vulnerable to perspective changes, and 3D point cloud…

Robotics · Computer Science 2025-07-08 Daqi Huang , Zhehao Cai , Yuzhi Hao , Zechen Li , Chee-Meng Chew

Point cloud registration is a fundamental task in 3D computer vision. Most existing methods rely solely on geometric information for feature extraction and matching. Recently, several studies have incorporated color information from RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Congjia Chen , Yufu Qu

In point cloud compression, the quality of a reconstructed point cloud relies on both the global structure and the local context, with existing methods usually processing global and local information sequentially and lacking communication…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xuan Deng , Xingtao Wang , Xiandong Meng , Xiaopeng Fan , Debin Zhao

Semantic scene understanding from point clouds is particularly challenging as the points reflect only a sparse set of the underlying 3D geometry. Previous works often convert point cloud into regular grids (e.g. voxels or bird-eye view…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yinyu Nie , Ji Hou , Xiaoguang Han , Matthias Nießner

Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Shaoqing Xu , Dingfu Zhou , Jin Fang , Junbo Yin , Zhou Bin , Liangjun Zhang

Aligning partial views of a scene into a single whole is essential to understanding one's environment and is a key component of numerous robotics tasks such as SLAM and SfM. Recent approaches have proposed end-to-end systems that can…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Mohamed El Banani , Luya Gao , Justin Johnson

Point cloud analysis is a fundamental task in 3D computer vision. Most previous works have conducted experiments on synthetic datasets with well-aligned data; while real-world point clouds are often not pre-aligned. How to achieve rotation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Chen Zhao , Jiaqi Yang , Xin Xiong , Angfan Zhu , Zhiguo Cao , Xin Li