English
Related papers

Related papers: Multi-scale Latent Point Consistency Models for 3D…

200 papers

Generative models have proven effective at modeling 3D shapes and their statistical variations. In this paper we investigate their application to point clouds, a 3D shape representation widely used in computer vision for which, however,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Roman Klokov , Edmond Boyer , Jakob Verbeek

Image diffusion distillation achieves high-fidelity generation with very few sampling steps. However, applying these techniques directly to video diffusion often results in unsatisfactory frame quality due to the limited visual quality in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yuanhao Zhai , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , David Doermann , Junsong Yuan , Lijuan Wang

Generating sewing patterns in garment design is receiving increasing attention due to its CG-friendly and flexible-editing nature. Previous sewing pattern generation methods have been able to produce exquisite clothing, but struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Shengqi Liu , Yuhao Cheng , Zhuo Chen , Xingyu Ren , Wenhan Zhu , Lincheng Li , Mengxiao Bi , Xiaokang Yang , Yichao Yan

Latent Consistency Models (LCMs) have achieved impressive performance in accelerating text-to-image generative tasks, producing high-quality images with minimal inference steps. LCMs are distilled from pre-trained latent diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simian Luo , Yiqin Tan , Suraj Patil , Daniel Gu , Patrick von Platen , Apolinário Passos , Longbo Huang , Jian Li , Hang Zhao

The ability to generate 3D multiphase microstructures on-demand with targeted attributes can greatly accelerate the design of advanced materials. Here, we present a conditional latent diffusion model (LDM) framework that rapidly synthesizes…

Remarkable performance from Transformer networks in Natural Language Processing promote the development of these models in dealing with computer vision tasks such as image recognition and segmentation. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Qi Zhong , Xian-Feng Han

Generative models, especially diffusion models (DMs), have achieved promising results for generating feature-rich geometries and advancing foundational science problems such as molecule design. Inspired by the recent huge success of Stable…

Machine Learning · Computer Science 2023-05-03 Minkai Xu , Alexander Powers , Ron Dror , Stefano Ermon , Jure Leskovec

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Although continuous-time consistency models (e.g., sCM, MeanFlow) are theoretically principled and empirically powerful for fast academic-scale diffusion, its applicability to large-scale text-to-image and video tasks remains unclear due to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Kaiwen Zheng , Yuji Wang , Qianli Ma , Huayu Chen , Jintao Zhang , Yogesh Balaji , Jianfei Chen , Ming-Yu Liu , Jun Zhu , Qinsheng Zhang

In recent years, point cloud generation has gained significant attention in 3D generative modeling. Among existing approaches, point-based methods directly generate point clouds without relying on other representations such as latent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Petr Molodyk , Jaemoo Choi , David W. Romero , Ming-Yu Liu , Yongxin Chen

We introduce a new generative model that combines latent diffusion with persistent homology to create 3D shapes with high diversity, with a special emphasis on their topological characteristics. Our method involves representing 3D shapes as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiangbei Hu , Ben Fei , Baixin Xu , Fei Hou , Weidong Yang , Shengfa Wang , Na Lei , Chen Qian , Ying He

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Consistency models are a new family of generative models capable of producing high-quality samples in either a single step or multiple steps. Recently, consistency models have demonstrated impressive performance, achieving results on par…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Quan Dao , Khanh Doan , Di Liu , Trung Le , Dimitris Metaxas

Recent advances in fast sampling methods for diffusion models have demonstrated significant potential to accelerate generation on image modalities. We apply these methods to 3-dimensional molecular conformations by building on the recently…

Quantitative Methods · Quantitative Biology 2024-04-23 Romain Lacombe , Neal Vaidya

Latent Consistency Model (LCM) extends the Consistency Model to the latent space and leverages the guided consistency distillation technique to achieve impressive performance in accelerating text-to-image synthesis. However, we observed…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jianbin Zheng , Minghui Hu , Zhongyi Fan , Chaoyue Wang , Changxing Ding , Dacheng Tao , Tat-Jen Cham

The recent success of pre-trained diffusion models unlocks the possibility of the automatic generation of textures for arbitrary 3D meshes in the wild. However, these models are trained in the screen space, while converting them to a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Hongkun Zhang , Zherong Pan , Congyi Zhang , Lifeng Zhu , Xifeng Gao

Automatically generating high-quality real world 3D scenes is of enormous interest for applications such as virtual reality and robotics simulation. Towards this goal, we introduce NeuralField-LDM, a generative model capable of synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Seung Wook Kim , Bradley Brown , Kangxue Yin , Karsten Kreis , Katja Schwarz , Daiqing Li , Robin Rombach , Antonio Torralba , Sanja Fidler

By embedding discrete representations into a continuous latent space, we can leverage continuous-space latent diffusion models to handle generative modeling of discrete data. However, despite their initial success, most latent diffusion…

Machine Learning · Computer Science 2025-04-02 Bac Nguyen , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Toshimitsu Uesaka , Stefano Ermon , Yuki Mitsufuji

Any-to-any singing voice conversion (SVC) aims to transfer a target singer's timbre to other songs using a short voice sample. However many diffusion model based any-to-any SVC methods, which have achieved impressive results, usually…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-23 Shihao Chen , Yu Gu , Jianwei Cui , Jie Zhang , Rilin Chen , Lirong Dai