中文
相关论文

相关论文: DreamPropeller: Supercharge Text-to-3D Generation …

200 篇论文

We introduce DD3G, a formulation that Distills a multi-view Diffusion model (MV-DM) into a 3D Generator using gaussian splatting. DD3G compresses and integrates extensive visual and spatial geometric knowledge from the MV-DM by simulating…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Hao Qin , Luyuan Chen , Ming Kong , Mengxu Lu , Qiang Zhu

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Chuhan Wang , Hao Chen

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face image quality degradation…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Beier Zhu , Ruoyu Wang , Tong Zhao , Hanwang Zhang , Chi Zhang

Recent advancements in text-to-3D generation have significantly contributed to the automation and democratization of 3D content creation. Building upon these developments, we aim to address the limitations of current methods in blending…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Yeongtak Oh , Jooyoung Choi , Yongsung Kim , Minjun Park , Chaehun Shin , Sungroh Yoon

Autoregressive (AR) models with diffusion heads have recently achieved strong text-to-audio performance, yet their iterative decoding and multi-step sampling process introduce high-latency issues. To address this bottleneck, we propose a…

Text-to-3D content creation is a rapidly evolving research area. Given the scarcity of 3D data, current approaches often adapt pre-trained 2D diffusion models for 3D synthesis. Among these approaches, Score Distillation Sampling (SDS) has…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Yumin Zhang , Xingyu Miao , Haoran Duan , Bo Wei , Tejal Shah , Yang Long , Rajiv Ranjan

We tackle the problem of text-driven 3D generation from a geometry alignment perspective. Given a set of text prompts, we aim to generate a collection of objects with semantically corresponding parts aligned across them. Recent methods…

Text-to-3D generation has shown promising results, yet common challenges such as the Multi-face Janus problem and extended generation time for high-quality assets. In this paper, we address these issues by introducing a novel three-stage…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Trapoom Ukarapol , Kevin Pruvost

Recently, the text-to-3D task has developed rapidly due to the appearance of the SDS method. However, the SDS method always generates 3D objects with poor quality due to the over-smooth issue. This issue is attributed to two factors: 1) the…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Yiming Zhong , Xiaolin Zhang , Yao Zhao , Yunchao Wei

We present DreamPolisher, a novel Gaussian Splatting based method with geometric guidance, tailored to learn cross-view consistency and intricate detail from textual descriptions. While recent progress on text-to-3D generation methods have…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Yuanze Lin , Ronald Clark , Philip Torr

In recent years, advancements in generative models have significantly expanded the capabilities of text-to-3D generation. Many approaches rely on Score Distillation Sampling (SDS) technology. However, SDS struggles to accommodate…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jiahui Yang , Donglin Di , Baorui Ma , Xun Yang , Yongjia Ma , Wenzhang Sun , Wei Chen , Jianxun Cui , Zhou Xue , Meng Wang , Yebin Liu

We introduce Audio-SDS, a generalization of Score Distillation Sampling (SDS) to text-conditioned audio diffusion models. While SDS was initially designed for text-to-3D generation using image diffusion, its core idea of distilling a…

声音 · 计算机科学 2025-05-08 Jessie Richter-Powell , Antonio Torralba , Jonathan Lorraine

Diffusion-based generative models have become dominant generators of high-fidelity images and videos but remain limited by their computationally expensive inference procedures. Existing acceleration techniques either require extensive model…

机器学习 · 计算机科学 2025-07-22 Jiaqi Han , Haotian Ye , Puheng Li , Minkai Xu , James Zou , Stefano Ermon

Score Distillation Sampling (SDS) has achieved remarkable success in text-to-3D content generation. However, SDS-based methods struggle to maintain semantic fidelity for user prompts, particularly when involving multiple objects with…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Chenhan Jiang , Yihan Zeng , Dit-Yan Yeung

Recent one image to 3D generation methods commonly adopt Score Distillation Sampling (SDS). Despite the impressive results, there are multiple deficiencies including multi-view inconsistency, over-saturated and over-smoothed textures, as…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Junwu Zhang , Zhenyu Tang , Yatian Pang , Xinhua Cheng , Peng Jin , Yida Wei , Munan Ning , Li Yuan

We present SD3.5-Flash, an efficient few-step distillation framework that brings high-quality image generation to accessible consumer devices. Our approach distills computationally prohibitive rectified flow models through a reformulated…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Hmrishav Bandyopadhyay , Rahim Entezari , Jim Scott , Reshinth Adithyan , Yi-Zhe Song , Varun Jampani

Despite their ability to generate high-resolution and diverse images from text prompts, text-to-image diffusion models often suffer from slow iterative sampling processes. Model distillation is one of the most effective directions to…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Thuan Hoang Nguyen , Anh Tran

Diffusion distillation methods aim to compress the diffusion models into efficient one-step generators while trying to preserve quality. Among them, Distribution Matching Distillation (DMD) offers a suitable framework for training…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Denis Rakitin , Ivan Shchekotov , Dmitry Vetrov

Diffusion models have become a leading method for generative modeling of both image and scientific data. As these models are costly to train and \emph{evaluate}, reducing the inference cost for diffusion models remains a major goal.…

机器学习 · 计算机科学 2025-12-01 Haoxuan Chen , Yinuo Ren , Lexing Ying , Grant M. Rotskoff

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li