English
Related papers

Related papers: MM-Point: Multi-View Information-Enhanced Multi-Mo…

200 papers

Unsupervised representation learning techniques, such as learning word embeddings, have had a significant impact on the field of natural language processing. Similar representation learning techniques have not yet become commonplace in the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Joël Bachmann , Kenneth Blomqvist , Julian Förster , Roland Siegwart

Semantic segmentation of 3D point cloud data is essential for enhanced high-level perception in autonomous platforms. Furthermore, given the increasing deployment of LiDAR sensors onboard of cars and drones, a special emphasis is also…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Yara Ali Alnaggar , Mohamed Afifi , Karim Amer , Mohamed Elhelw

Self-supervised learning is attracting wide attention in point cloud processing. However, it is still not well-solved to gain discriminative and transferable features of point clouds for efficient training on downstream tasks, due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Xin Li , Mingqiang Wei , Songcan Chen

In this paper we address the task of finding representative subsets of points in a 3D point cloud by means of a point-wise ordering. Only a few works have tried to address this challenging vision problem, all with the help of hard to obtain…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Pengwan Yang , Cees G. M. Snoek , Yuki M. Asano

Point cloud processing and 3D shape understanding are very challenging tasks for which deep learning techniques have demonstrated great potentials. Still further progresses are essential to allow artificial intelligent agents to interact…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Antonio Alliegro , Davide Boscaini , Tatiana Tommasi

Remarkable performance from Transformer networks in Natural Language Processing promote the development of these models in dealing with computer vision tasks such as image recognition and segmentation. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Qi Zhong , Xian-Feng Han

3D object recognition has attracted wide research attention in the field of multimedia and computer vision. With the recent proliferation of deep learning, various deep models with different representations have achieved the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Haoxuan You , Yifan Feng , Rongrong Ji , Yue Gao

3D point clouds are rich in geometric structure information, while 2D images contain important and continuous texture information. Combining 2D information to achieve better 3D semantic segmentation has become mainstream in 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Chaolong Yang , Yuyao Yan , Weiguang Zhao , Jianan Ye , Xi Yang , Amir Hussain , Kaizhu Huang

Unsupervised point cloud segmentation is critical for embodied artificial intelligence and autonomous driving, as it mitigates the prohibitive cost of dense point-level annotations required by fully supervised methods. While integrating 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yixiao Song , Qingyong Li , Wen Wang , Zhicheng Yan

There is a trend to fuse multi-modal information for 3D object detection (3OD). However, the challenging problems of low lightweightness, poor flexibility of plug-and-play, and inaccurate alignment of features are still not well-solved,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Lipeng Gu , Xuefeng Yan , Peng Cui , Lina Gong , Haoran Xie , Fu Lee Wang , Jin Qin , Mingqiang Wei

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

The visual quality of point clouds has been greatly emphasized since the ever-increasing 3D vision applications are expected to provide cost-effective and high-quality experiences for users. Looking back on the development of point cloud…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Zicheng Zhang , Wei Sun , Xiongkuo Min , Quan Zhou , Jun He , Qiyuan Wang , Guangtao Zhai

This paper introduces a novel approach named CrossVideo, which aims to enhance self-supervised cross-modal contrastive learning in the field of point cloud video understanding. Traditional supervised learning methods encounter limitations…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yunze Liu , Changxi Chen , Zifan Wang , Li Yi

Object detection in 3D point clouds is a crucial task in a range of computer vision applications including robotics, autonomous cars, and augmented reality. This work addresses the object detection task in 3D point clouds using a highly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Sultan Abu Ghazal , Jean Lahoud , Rao Anwer

We introduce Point-Bind, a 3D multi-modality model aligning point clouds with 2D image, language, audio, and video. Guided by ImageBind, we construct a joint embedding space between 3D and multi-modalities, enabling many promising…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Yiwen Tang , Xianzheng Ma , Jiaming Han , Kexin Chen , Peng Gao , Xianzhi Li , Hongsheng Li , Pheng-Ann Heng

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i.e., images possess more semantic information while point clouds specialize in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ming Zhu , Chao Ma , Pan Ji , Xiaokang Yang

Mobile robots need to create high-definition 3D maps of the environment for applications such as remote surveillance and infrastructure mapping. Accurate semantic processing of the acquired 3D point cloud is critical for allowing the robot…

Robotics · Computer Science 2019-02-20 Jingdao Chen , Yong K. Cho , Zsolt Kira

With the development of 3D and 2D data acquisition techniques, it has become easy to obtain point clouds and images of scenes simultaneously, which further facilitates dual-modal semantic segmentation. Most existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Qiulei Dong , Jianan Li , Shuang Deng

We present 3D-MPA, a method for instance segmentation on 3D point clouds. Given an input point cloud, we propose an object-centric approach where each point votes for its object center. We sample object proposals from the predicted object…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Francis Engelmann , Martin Bokeloh , Alireza Fathi , Bastian Leibe , Matthias Nießner

Pre-training across 3D vision and language remains under development because of limited training data. Recent works attempt to transfer vision-language pre-training models to 3D vision. PointCLIP converts point cloud data to multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Tianyu Huang , Bowen Dong , Yunhan Yang , Xiaoshui Huang , Rynson W. H. Lau , Wanli Ouyang , Wangmeng Zuo