English
Related papers

Related papers: PointDico: Contrastive 3D Representation Learning …

200 papers

Arguably one of the top success stories of deep learning is transfer learning. The finding that pre-training a network on a rich source set (eg., ImageNet) can help boost performance once fine-tuned on a usually much smaller target set, has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Saining Xie , Jiatao Gu , Demi Guo , Charles R. Qi , Leonidas J. Guibas , Or Litany

As one of the most successful generative models, diffusion models have demonstrated remarkable efficacy in synthesizing high-quality images. These models learn the underlying high-dimensional data distribution in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Min Hou , Yueying Wu , Chang Xu , Yu-Hao Huang , Chenxi Bai , Le Wu , Jiang Bian

Prompt learning has garnered attention for its efficiency over traditional model training and fine-tuning. However, existing methods, constrained by inadequate theoretical foundations, encounter difficulties in achieving causally invariant…

Artificial Intelligence · Computer Science 2025-07-29 Xinshu Li , Ruoyu Wang , Erdun Gao , Mingming Gong , Lina Yao

A promising direction for pre-training 3D point clouds is to leverage the massive amount of data in 2D, whereas the domain gap between 2D and 3D creates a fundamental challenge. This paper proposes a novel approach to point-cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Siming Yan , Chen Song , Youkang Kong , Qixing Huang

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

Unsupervised representation learning techniques, such as learning word embeddings, have had a significant impact on the field of natural language processing. Similar representation learning techniques have not yet become commonplace in the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Joël Bachmann , Kenneth Blomqvist , Julian Förster , Roland Siegwart

Traditional 3D face models learn a latent representation of faces using linear subspaces from limited scans of a single database. The main roadblock of building a large-scale face model from diverse 3D databases lies in the lack of dense…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Feng Liu , Luan Tran , Xiaoming Liu

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Due to the high complexity and technical requirements of industrial production processes, surface defects will inevitably appear, which seriously affects the quality of products. Although existing lightweight detection networks are highly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xuyi Yu

Learning semantically meaningful representations from unstructured 3D point clouds remains a central challenge in computer vision, especially in the absence of large-scale labeled datasets. While masked point modeling (MPM) is widely used…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Remco F. Leijenaar , Hamidreza Kasaei

As the development of 3D sensors, registration of 3D data (e.g. point cloud) coming from different kind of sensor is dispensable and shows great demanding. However, point cloud registration between different sensors is challenging because…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Xiaoshui Huang

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Recent self-supervised contrastive methods have been able to produce impressive transferable visual representations by learning to be invariant to different data augmentations. However, these methods implicitly assume a particular set of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Tete Xiao , Xiaolong Wang , Alexei A. Efros , Trevor Darrell

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Animesh Karnewar , Andrea Vedaldi , David Novotny , Niloy Mitra

There has been a longstanding belief that generation can facilitate a true understanding of visual data. In line with this, we revisit generatively pre-training visual representations in light of recent interest in denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Chen Wei , Karttikeya Mangalam , Po-Yao Huang , Yanghao Li , Haoqi Fan , Hu Xu , Huiyu Wang , Cihang Xie , Alan Yuille , Christoph Feichtenhofer

Diffusion models have emerged as the dominant paradigm for style transfer, but their text-driven mechanism is hindered by a core limitation: it treats textual descriptions as uniform, monolithic guidance. This limitation overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yuanlin Yang , Quanjian Song , Zhexian Gao , Ge Wang , Shanshan Li , Xiaoyan Zhang

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

Diffusion probabilistic models are traditionally used to generate colors at fixed pixel positions in 2D images. Building on this, we extend diffusion models to point cloud semantic segmentation, where point positions also remain fixed, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yong He , Hongshan Yu , Mingtao Feng , Tongjia Chen , Zechuan Li , Anwaar Ulhaq , Saeed Anwar , Ajmal Saeed Mian

Creating 3D content from single-view images is a challenging problem that has attracted considerable attention in recent years. Current approaches typically utilize score distillation sampling (SDS) from pre-trained 2D diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junbang Liu , Enpei Huang , Dongxing Mao , Hui Zhang , Xinyuan Song , Yongxin Ni