English
Related papers

Related papers: PointMixer: MLP-Mixer for Point Cloud Understandin…

200 papers

In this work, we propose a novel method for generating 3D point clouds that leverage properties of hyper networks. Contrary to the existing methods that learn only the representation of a 3D object, our approach simultaneously finds a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Przemysław Spurek , Sebastian Winczowski , Jacek Tabor , Maciej Zamorski , Maciej Zięba , Tomasz Trzciński

Recent advances in deep learning for 3D point clouds have shown great promises in scene understanding tasks thanks to the introduction of convolution operators to consume 3D point clouds directly in a neural network. Point cloud data,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Zhiyuan Zhang , Binh-Son Hua , Wei Chen , Yibin Tian , Sai-Kit Yeung

Methods for processing point cloud information have seen a great success in collider physics applications. One recent breakthrough in machine learning is the usage of Transformer networks to learn semantic relationships between sequences in…

Data Analysis, Statistics and Probability · Physics 2021-07-19 Vinicius Mikuni , Florencia Canelli

Point clouds are a popular representation for 3D shapes. However, they encode a particular sampling without accounting for shape priors or non-local information. We advocate for the use of a hierarchical Gaussian mixture model (hGMM), which…

Machine Learning · Computer Science 2020-03-31 Amir Hertz , Rana Hanocka , Raja Giryes , Daniel Cohen-Or

As a popular representation of 3D data, point cloud may contain noise and need to be filtered before use. Existing point cloud filtering methods either cannot preserve sharp features or result in uneven point distribution in the filtered…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Shuaijun Chen , Jinxi Wang , Wei Pan , Shang Gao , Meili Wang , Xuequan Lu

Point cloud is an important type of 3D representation. However, directly applying convolutions on point clouds is challenging due to the sparse, irregular and unordered data structure. In this paper, we propose a novel Interpolated…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Jiageng Mao , Xiaogang Wang , Hongsheng Li

Deep learning is increasingly being used to perform machine vision tasks such as classification, object detection, and segmentation on 3D point cloud data. However, deep learning inference is computationally expensive. The limited…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Mateen Ulhaq , Ivan V. Bajić

3D shape recognition has attracted more and more attention as a task of 3D vision research. The proliferation of 3D data encourages various deep learning methods based on 3D data. Now there have been many deep learning models based on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Yaxin Zhao , Jichao Jiao , Tangkun Zhang

Learning for manipulation requires using policies that have access to rich sensory information such as point clouds or RGB images. Point clouds efficiently capture geometric structures, making them essential for manipulation tasks in…

Token-mixing multi-layer perceptron (MLP) models have shown competitive performance in computer vision tasks with a simple architecture and relatively small computational cost. Their success in maintaining computation efficiency is mainly…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

The unprecedented advancements in Large Language Models (LLMs) have shown a profound impact on natural language processing but are yet to fully embrace the realm of 3D understanding. This paper introduces PointLLM, a preliminary effort to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Runsen Xu , Xiaolong Wang , Tai Wang , Yilun Chen , Jiangmiao Pang , Dahua Lin

We propose Clustering Mask Transformer (CMT-DeepLab), a transformer-based framework for panoptic segmentation designed around clustering. It rethinks the existing transformer architectures used in segmentation and detection; CMT-DeepLab…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Qihang Yu , Huiyu Wang , Dahun Kim , Siyuan Qiao , Maxwell Collins , Yukun Zhu , Hartwig Adam , Alan Yuille , Liang-Chieh Chen

This paper presents Point Convolutional Neural Networks (PCNN): a novel framework for applying convolutional neural networks to point clouds. The framework consists of two operators: extension and restriction, mapping point cloud functions…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Matan Atzmon , Haggai Maron , Yaron Lipman

PointNet has recently emerged as a popular representation for unstructured point cloud data, allowing application of deep learning to tasks such as object detection, segmentation and shape completion. However, recent works in literature…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Vinit Sarode , Xueqian Li , Hunter Goforth , Yasuhiro Aoki , Animesh Dhagat , Rangaprasad Arun Srivatsan , Simon Lucey , Howie Choset

Deep learning techniques for point clouds have achieved strong performance on a range of 3D vision tasks. However, it is costly to annotate large-scale point sets, making it critical to learn generalizable representations that can transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Chao Huang , Zhangjie Cao , Yunbo Wang , Jianmin Wang , Mingsheng Long

Deep learning within the context of point clouds has gained much research interest in recent years mostly due to the promising results that have been achieved on a number of challenging benchmarks, such as 3D shape recognition and scene…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ye Zhu , Sven Ewan Shepstone , Pablo Martínez-Nuevo , Miklas Strøm Kristoffersen , Fabien Moutarde , Zhuang Fu

In this paper, we present a novel deep method to reconstruct a point cloud of an object from a single still image. Prior arts in the field struggle to reconstruct an accurate and scalable 3D model due to either the inefficient and expensive…

Computer Vision and Pattern Recognition · Computer Science 2019-11-18 Anh-Duc Nguyen , Seonghwa Choi , Woojae Kim , Sanghoon Lee

Among 2D convolutional networks on point clouds, point-based approaches consume point clouds of fixed size directly. By analysis of PointNet, a pioneer in introducing deep learning into point sets, we reveal that current point-based methods…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Zhenpeng Chen , Yuan li

Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yubo Cui , Zheng Fang , Jiayao Shan , Zuoxu Gu , Sifan Zhou