English
Related papers

Related papers: KeyPointDiffuser: Unsupervised 3D Keypoint Learnin…

200 papers

Note: The final version of this article was published in Computers and Geosciences, Volume 206, January 2026, 106038. DOI: 10.1016/j.cageo.2025.106038. Readers should refer to the published version for the most up-to-date content.…

In this paper, we tackle the challenging problem of 3D keypoint estimation of general objects using a novel implicit representation. Previous works have demonstrated promising results for keypoint prediction through direct coordinate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Xiangyu Zhu , Dong Du , Haibin Huang , Chongyang Ma , Xiaoguang Han

We present a probabilistic model for point cloud generation, which is fundamental for various 3D vision tasks such as shape completion, upsampling, synthesis and data augmentation. Inspired by the diffusion process in non-equilibrium…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Shitong Luo , Wei Hu

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soumik Mukhopadhyay , Matthew Gwilliam , Yosuke Yamaguchi , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Tianyi Zhou , Jun Ohya , Abhinav Shrivastava

Deep learning techniques for point clouds have achieved strong performance on a range of 3D vision tasks. However, it is costly to annotate large-scale point sets, making it critical to learn generalizable representations that can transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Chao Huang , Zhangjie Cao , Yunbo Wang , Jianmin Wang , Mingsheng Long

Rich data and powerful machine learning models allow us to design drugs for a specific protein target \textit{in silico}. Recently, the inclusion of 3D structures during targeted drug design shows superior performance to other target-free…

Biomolecules · Quantitative Biology 2023-03-08 Jiaqi Guan , Wesley Wei Qian , Xingang Peng , Yufeng Su , Jian Peng , Jianzhu Ma

For non-rigid objects, predicting the 3D shape from 2D keypoint observations is ill-posed due to occlusions, and the need to disentangle changes in viewpoint and changes in shape. This challenge has often been addressed by embedding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Shalini Maiti , Lourdes Agapito , Benjamin Graham

Deep 3D point cloud models are sensitive to adversarial attacks, which poses threats to safety-critical applications such as autonomous driving. Robust training and defend-by-denoising are typical strategies for defending adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Kui Zhang , Hang Zhou , Jie Zhang , Qidong Huang , Weiming Zhang , Nenghai Yu

Knowledge of 3D properties of objects is a necessity in order to build effective computer vision systems. However, lack of large scale 3D datasets can be a major constraint for data-driven approaches in learning such properties. We consider…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Navaneet K L , Priyanka Mandikal , Mayank Agarwal , R. Venkatesh Babu

In perception, multiple sensory information is integrated to map visual information from 2D views onto 3D objects, which is beneficial for understanding in 3D environments. But in terms of a single 2D view rendered from different angles,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Hai-Tao Yu , Mofei Song

Self-supervised learning has emerged as a promising approach for acquiring transferable 3D representations from unlabeled 3D point clouds. Unlike 2D images, which are widely accessible, acquiring 3D assets requires specialized expertise or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xuweiyi Chen , Zezhou Cheng

As 3D point clouds become the representation of choice for multiple vision and graphics applications, the ability to synthesize or reconstruct high-resolution, high-fidelity point clouds becomes crucial. Despite the recent success of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Guandao Yang , Xun Huang , Zekun Hao , Ming-Yu Liu , Serge Belongie , Bharath Hariharan

Representing complex 3D objects as simple geometric primitives, known as shape abstraction, is important for geometric modeling, structural analysis, and shape synthesis. In this paper, we propose an unsupervised shape abstraction method to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaizhi Yang , Xuejin Chen

While diffusion models excel at generating high-quality samples, their latent variables typically lack semantic meaning and are not suitable for representation learning. Here, we propose InfoDiffusion, an algorithm that augments diffusion…

Machine Learning · Computer Science 2023-06-16 Yingheng Wang , Yair Schiff , Aaron Gokaslan , Weishen Pan , Fei Wang , Christopher De Sa , Volodymyr Kuleshov

A major challenge in reconstructing buildings from LiDAR point clouds lies in accurately capturing building surfaces under varying point densities and noise interference. To flexibly gather high-quality 3D profiles of the building in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jialu Sui , Rui Liu , Hongsheng Zhang

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

We learn a self-supervised, single-view 3D reconstruction model that predicts the 3D mesh shape, texture and camera pose of a target object with a collection of 2D images and silhouettes. The proposed method does not necessitate 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xueting Li , Sifei Liu , Kihwan Kim , Shalini De Mello , Varun Jampani , Ming-Hsuan Yang , Jan Kautz

An effective 3D descriptor should be invariant to different geometric transformations, such as scale and rotation, robust to occlusions and clutter, and capable of generalising to different application domains. We present a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Fabio Poiesi , Davide Boscaini

In this paper, we introduce a novel unsupervised domain adaptation technique for the task of 3D keypoint prediction from a single depth scan or image. Our key idea is to utilize the fact that predictions from different views of the same or…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Xingyi Zhou , Arjun Karpur , Chuang Gan , Linjie Luo , Qixing Huang

Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve…

Machine Learning · Computer Science 2020-07-21 Sameera Ramasinghe , Salman Khan , Nick Barnes , Stephen Gould