English
Related papers

Related papers: Self-Supervised Learning with Multi-View Rendering…

200 papers

This work considers a new task in geometric deep learning: generating a triangulation among a set of points in 3D space. We present PointTriNet, a differentiable and scalable approach enabling point set triangulation as a layer in 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Nicholas Sharp , Maks Ovsjanikov

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

Training deep neural networks to estimate the viewpoint of objects requires large labeled training datasets. However, manually labeling viewpoints is notoriously hard, error-prone, and time-consuming. On the other hand, it is relatively…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Siva Karthik Mustikovela , Varun Jampani , Shalini De Mello , Sifei Liu , Umar Iqbal , Carsten Rother , Jan Kautz

Deep neural network models have achieved remarkable progress in 3D scene understanding while trained in the closed-set setting and with full labels. However, the major bottleneck is that these models do not have the capacity to recognize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kangcheng Liu , Yong-Jin Liu , Baoquan Chen

Existing learning-based surface reconstruction methods from point clouds are still facing challenges in terms of scalability and preservation of details on large-scale point clouds. In this paper, we propose the SSRNet, a novel scalable…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Zhenxing Mi , Yiming Luo , Wenbing Tao

Most 3D neural networks are trained from scratch owing to the lack of large-scale labeled 3D datasets. In this paper, we present a novel 3D pretraining method by leveraging 2D networks learned from rich 2D datasets. We propose the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yueh-Cheng Liu , Yu-Kai Huang , Hung-Yueh Chiang , Hung-Ting Su , Zhe-Yu Liu , Chin-Tang Chen , Ching-Yu Tseng , Winston H. Hsu

Understanding dynamic 3D environment is crucial for robotic agents and many other applications. We propose a novel neural network architecture called $MeteorNet$ for learning representations for dynamic 3D point cloud sequences. Different…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Xingyu Liu , Mengyuan Yan , Jeannette Bohg

The core of self-supervised point cloud learning lies in setting up appropriate pretext tasks, to construct a pre-training framework that enables the encoder to perceive 3D objects effectively. In this paper, we integrate two prevalent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yun Liu , Peng Li , Xuefeng Yan , Liangliang Nan , Bing Wang , Honghua Chen , Lina Gong , Wei Zhao , Mingqiang Wei

3D point cloud understanding has made great progress in recent years. However, one major bottleneck is the scarcity of annotated real datasets, especially compared to 2D object detection tasks, since a large amount of labor is involved in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Yongming Rao , Benlin Liu , Yi Wei , Jiwen Lu , Cho-Jui Hsieh , Jie Zhou

Point cloud registration is the process of aligning a pair of point sets via searching for a geometric transformation. Recent works leverage the power of deep learning for registering a pair of point sets. However, unfortunately, deep…

Computational Geometry · Computer Science 2020-06-12 Lingjing Wang , Xiang Li , Yi Fang

3D reconstruction from single view images is an ill-posed problem. Inferring the hidden regions from self-occluded images is both challenging and ambiguous. We propose a two-pronged approach to address these issues. To better incorporate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Priyanka Mandikal , K L Navaneet , Mayank Agarwal , R. Venkatesh Babu

State-of-the-art 3D object detectors are often trained on massive labeled datasets. However, annotating 3D bounding boxes remains prohibitively expensive and time-consuming, particularly for LiDAR. Instead, recent works demonstrate that…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Mehar Khurana , Neehar Peri , James Hays , Deva Ramanan

In latest years, deep learning has gained a leading role in the pansharpening of multiresolution images. Given the lack of ground truth data, most deep learning-based methods carry out supervised training in a reduced-resolution domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Matteo Ciotola , Giovanni Poggi , Giuseppe Scarpa

In this work, we propose an end-to-end framework to learn local multi-view descriptors for 3D point clouds. To adopt a similar multi-view representation, existing studies use hand-crafted viewpoints for rendering in a preprocessing stage,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Lei Li , Siyu Zhu , Hongbo Fu , Ping Tan , Chiew-Lan Tai

With the development of 3D and 2D data acquisition techniques, it has become easy to obtain point clouds and images of scenes simultaneously, which further facilitates dual-modal semantic segmentation. Most existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Qiulei Dong , Jianan Li , Shuang Deng

Poles and building edges are frequently observable objects on urban roads, conveying reliable hints for various computer vision tasks. To repetitively extract them as features and perform association between discrete LiDAR frames for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Xiangrui Zhao , Sheng Yang , Tianxin Huang , Jun Chen , Teng Ma , Mingyang Li , Yong Liu

We propose and evaluate a neural point-based graphics method that can model semi-transparent scene parts. Similarly to its predecessor pipeline, ours uses point clouds to model proxy geometry, and augments each point with a neural…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Maria Kolos , Artem Sevastopolsky , Victor Lempitsky

Deep neural networks for aerial image segmentation require large amounts of labeled data, but high-quality aerial datasets with precise annotations are scarce and costly to produce. To address this limitation, we propose a self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Rupert Polley , Sai Vignesh Abishek Deenadayalan , J. Marius Zöllner

Real-world environment-derived point clouds invariably exhibit noise across varying modalities and intensities. Hence, point cloud denoising (PCD) is essential as a preprocessing step to improve downstream task performance. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Chengwei Zhang , Xueyi Zhang , Mingrui Lao , Tao Jiang , Xinhao Xu , Wenjie Li , Fubo Zhang , Longyong Chen

Though deep learning methods have shown great success in 3D point cloud part segmentation, they generally rely on a large volume of labeled training data, which makes the model suffer from unsatisfied generalization abilities to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Yu Hao , Yi Fang