English
Related papers

Related papers: Cross-Modal Information-Guided Network using Contr…

200 papers

In this paper, we propose a simple and general framework for self-supervised point cloud representation learning. Human beings understand the 3D world by extracting two levels of information and establishing the relationship between them.…

Computer Vision and Pattern Recognition · Computer Science 2022-02-10 Kexue Fu , Peng Gao , Renrui Zhang , Hongsheng Li , Yu Qiao , Manning Wang

Pre-training has become a standard paradigm in many computer vision tasks. However, most of the methods are generally designed on the RGB image domain. Due to the discrepancy between the two-dimensional image plane and the three-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Zhenyu Li , Zehui Chen , Ang Li , Liangji Fang , Qinhong Jiang , Xianming Liu , Junjun Jiang , Bolei Zhou , Hang Zhao

Image to point cloud global localization is crucial for robot navigation in GNSS-denied environments and has become increasingly important for multi-robot map fusion and urban asset management. The modality gap between images and point…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuhao Li , Jianping Li , Zhen Dong , Yuan Wang , Bisheng Yang

Infrared and visible image fusion targets to provide an informative image by combining complementary information from different sensors. Existing learning-based fusion approaches attempt to construct various loss functions to preserve…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jinyuan Liu , Runjia Lin , Guanyao Wu , Risheng Liu , Zhongxuan Luo , Xin Fan

Cross-modality recognition has many important applications in science, law enforcement and entertainment. Popular methods to bridge the modality gap include reducing the distributional differences of representations of different modalities,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xin Niu , Enyi Li , Jinchao Liu , Yan Wang , Margarita Osadchy , Yongchun Fang

Cross-modality registration between 2D images from cameras and 3D point clouds from LiDARs is a crucial task in computer vision and robotic. Previous methods estimate 2D-3D correspondences by matching point and pixel patterns learned by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Junsheng Zhou , Baorui Ma , Wenyuan Zhang , Yi Fang , Yu-Shen Liu , Zhizhong Han

Image-point class incremental learning helps the 3D-points-vision robots continually learn category knowledge from 2D images, improving their perceptual capability in dynamic environments. However, some incremental learning methods address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chao Qi , Jianqin Yin , Ren Zhang

Self-supervised learning can extract representations of good quality from solely unlabeled data, which is appealing for point cloud videos due to their high labelling cost. In this paper, we propose a contrastive mask prediction (PointCMP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhiqiang Shen , Xiaoxiao Sheng , Longguang Wang , Yulan Guo , Qiong Liu , Xi Zhou

Learning and selecting important points on a point cloud is crucial for point cloud understanding in various applications. Most of early methods selected the important points on 3D shapes by analyzing the intrinsic geometric properties of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xinhai Liu , Zhizhong Han , Sanghuk Lee , Yan-Pei Cao , Yu-Shen Liu

Matching cross-modality features between images and point clouds is a fundamental problem for image-to-point cloud registration. However, due to the modality difference between images and points, it is difficult to learn robust and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haiping Wang , Yuan Liu , Bing Wang , Yujing Sun , Zhen Dong , Wenping Wang , Bisheng Yang

3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficient learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Fayao Liu , Guosheng Lin , Chuan-Sheng Foo , Chaitanya K. Joshi , Jie Lin

Some self-supervised cross-modal learning approaches have recently demonstrated the potential of image signals for enhancing point cloud representation. However, it remains a question on how to directly model cross-modal local and global…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Honggu Zhou , Xiaogang Peng , Jiawei Mao , Zizhao Wu , Ming Zeng

In this paper we explore the recent topic of point cloud completion, guided by an auxiliary image. We show how it is possible to effectively combine the information from the two modalities in a localized latent space, thus avoiding the need…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Emanuele Aiello , Diego Valsesia , Enrico Magli

Learning a powerful representation from point clouds is a fundamental and challenging problem in the field of computer vision. Different from images where RGB pixels are stored in the regular grid, for point clouds, the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-01-28 Feng Yang , Yichao Cao , Qifan Xue , Shuai Jin , Xuanpeng Li , Weigong Zhang

Geometrical structures and the internal local region relationship, such as symmetry, regular array, junction, etc., are essential for understanding a 3D shape. This paper proposes a point cloud feature extraction network named PointSCNet,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Xingye Chen , Yiqi Wu , Wenjie Xu , Jin Li , Huaiyi Dong , Yilin Chen

Multi-instance point cloud registration aims to estimate the pose of all instances of a model point cloud in the whole scene. Existing methods all adopt the strategy of first obtaining the global correspondence and then clustering to obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Liyuan Zhang , Le Hui , Qi Liu , Bo Li , Yuchao Dai

Robust and discriminative feature learning is critical for high-quality point cloud registration. However, existing deep learning-based methods typically rely on Euclidean neighborhood-based strategies for feature extraction, which struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shuyuan Lin , Wenwu Peng , Junjie Huang , Qiang Qi , Miaohui Wang , Jian Weng

Point cloud registration has seen significant advancements with the application of deep learning techniques. However, existing approaches often overlook the potential of integrating radiometric information from RGB images. This limitation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zhaoyi Wang , Shengyu Huang , Jemil Avers Butt , Yuanzhou Cai , Matej Varga , Andreas Wieser

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Bi'an Du , Xiang Gao , Wei Hu , Xin Li

Self-attention mechanism recently achieves impressive advancement in Natural Language Processing (NLP) and Image Processing domains. And its permutation invariance property makes it ideally suitable for point cloud processing. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xian-Feng Han , Zhang-Yue He , Jia Chen , Guo-Qiang Xiao