English
Related papers

Related papers: Point-MoE: Large-Scale Multi-Dataset Training with…

200 papers

In this work, we address the challenging task of few-shot and zero-shot 3D point cloud semantic segmentation. The success of few-shot semantic segmentation in 2D computer vision is mainly driven by the pre-training on large-scale datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shuting He , Xudong Jiang , Wei Jiang , Henghui Ding

Semantic understanding of 3D point cloud relies on learning models with massively annotated data, which, in many cases, are expensive or difficult to collect. This has led to an emerging research interest in semi-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xian Shi , Xun Xu , Wanyue Zhang , Xiatian Zhu , Chuan Sheng Foo , Kui Jia

Deep neural networks have achieved significant success in 3D point cloud classification while relying on large-scale, annotated point cloud datasets, which are labor-intensive to build. Compared to capturing data with LiDAR sensors and then…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Huantao Ren , Minmin Yang , Senem Velipasalar

Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzhi Li , Pheng-Ann Heng

We introduce Point-Bind, a 3D multi-modality model aligning point clouds with 2D image, language, audio, and video. Guided by ImageBind, we construct a joint embedding space between 3D and multi-modalities, enabling many promising…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Yiwen Tang , Xianzheng Ma , Jiaming Han , Kexin Chen , Peng Gao , Xianzhi Li , Hongsheng Li , Pheng-Ann Heng

In recent times, the scope of LIDAR (Light Detection and Ranging) sensor-based technology has spread across numerous fields. It is popularly used to map terrain and navigation information into reliable 3D point cloud data, potentially…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Aakash Kumar , Jyoti Kini , Mubarak Shah , Ajmal Mian

Many applications in robotics and human-computer interaction can benefit from understanding 3D motion of points in a dynamic environment, widely noted as scene flow. While most previous methods focus on stereo and RGB-D images as input, few…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xingyu Liu , Charles R. Qi , Leonidas J. Guibas

LiDAR point clouds contain measurements of complicated natural scenes and can be used to update digital elevation models, glacial monitoring, detecting faults and measuring uplift detecting, forest inventory, detect shoreline and beach…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 F. Patricia Medina , Randy Paffenroth

Unsupervised point cloud segmentation is critical for embodied artificial intelligence and autonomous driving, as it mitigates the prohibitive cost of dense point-level annotations required by fully supervised methods. While integrating 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yixiao Song , Qingyong Li , Wen Wang , Zhicheng Yan

As 3D point clouds become the representation of choice for multiple vision and graphics applications, the ability to synthesize or reconstruct high-resolution, high-fidelity point clouds becomes crucial. Despite the recent success of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Guandao Yang , Xun Huang , Zekun Hao , Ming-Yu Liu , Serge Belongie , Bharath Hariharan

3D semantic segmentation is a fundamental building block for several scene understanding applications such as autonomous driving, robotics and AR/VR. Several state-of-the-art semantic segmentation models suffer from the part…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Anirud Thyagharajan , Benjamin Ummenhofer , Prashant Laddha , Om J Omer , Sreenivas Subramoney

In this paper, we propose a novel joint instance and semantic segmentation approach, which is called JSNet, in order to address the instance and semantic segmentation of 3D point clouds simultaneously. Firstly, we build an effective…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Lin Zhao , Wenbing Tao

High quality upsampling of sparse 3D point clouds is critically useful for a wide range of geometric operations such as reconstruction, rendering, meshing, and analysis. In this paper, we propose a data-driven algorithm that enables an…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 Wentai Zhang , Haoliang Jiang , Zhangsihao Yang , Soji Yamakawa , Kenji Shimada , Levent Burak Kara

Mixture-of-Experts (MoE) decouples model capacity from per-token computation, yet their scalability remains limited by the physical dimensions of depth and width. To overcome this, we propose Mixture of Universal Experts (MOUE),a MoE…

Machine Learning · Computer Science 2026-03-06 Yilong Chen , Naibin Gu , Junyuan Shang , Zhenyu Zhang , Yuchen Feng , Jiawei Sheng , Tingwen Liu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Open-vocabulary semantic segmentation enables models to recognize and segment objects from arbitrary natural language descriptions, offering the flexibility to handle novel, fine-grained, or functionally defined categories beyond fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Chongyu Wang , Kunlei Jing , Jihua Zhu , Di Wang

Point clouds provide a flexible and natural representation usable in countless applications such as robotics or self-driving cars. Recently, deep neural networks operating on raw point cloud data have shown promising results on supervised…

Machine Learning · Computer Science 2019-06-04 Jonathan Sauder , Bjarne Sievers

As the development of 3D sensors, registration of 3D data (e.g. point cloud) coming from different kind of sensor is dispensable and shows great demanding. However, point cloud registration between different sensors is challenging because…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Xiaoshui Huang

Due to the few annotated labels of 3D point clouds, how to learn discriminative features of point clouds to segment object instances is a challenging problem. In this paper, we propose a simple yet effective 3D instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Linghua Tang , Le Hui , Jin Xie

The manual annotation for large-scale point clouds costs a lot of time and is usually unavailable in harsh real-world scenarios. Inspired by the great success of the pre-training and fine-tuning paradigm in both vision and language tasks,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Chao Sun , Zhedong Zheng , Xiaohan Wang , Mingliang Xu , Yi Yang

Semantic segmentation of 3D LiDAR point clouds, essential for autonomous driving and infrastructure management, is best achieved by supervised learning, which demands extensive annotated datasets and faces the problem of domain shifts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Andrew Caunes , Thierry Chateau , Vincent Frémont