中文
相关论文

相关论文: Diffusion-SDF: Text-to-Shape via Voxelized Diffusi…

200 篇论文

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

In this paper, we propose an effective two-stage approach named Grounded-Dreamer to generate 3D assets that can accurately follow complex, compositional text prompts while achieving high fidelity by using a pre-trained multi-view diffusion…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Xiaolong Li , Jiawei Mo , Ying Wang , Chethan Parameshwara , Xiaohan Fei , Ashwin Swaminathan , CJ Taylor , Zhuowen Tu , Paolo Favaro , Stefano Soatto

We present Diff3F as a simple, robust, and class-agnostic feature descriptor that can be computed for untextured input shapes (meshes or point clouds). Our method distills diffusion features from image foundational models onto input shapes.…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Niladri Shekhar Dutt , Sanjeev Muralikrishnan , Niloy J. Mitra

Score distillation sampling (SDS) has shown great promise in text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models, but suffers from over-saturation, over-smoothing, and low-diversity problems. In this…

机器学习 · 计算机科学 2023-11-23 Zhengyi Wang , Cheng Lu , Yikai Wang , Fan Bao , Chongxuan Li , Hang Su , Jun Zhu

We present Frankenstein, a diffusion-based framework that can generate semantic-compositional 3D scenes in a single pass. Unlike existing methods that output a single, unified 3D shape, Frankenstein simultaneously generates multiple…

计算机视觉与模式识别 · 计算机科学 2024-09-02 Han Yan , Yang Li , Zhennan Wu , Shenzhou Chen , Weixuan Sun , Taizhang Shang , Weizhe Liu , Tian Chen , Xiaqiang Dai , Chao Ma , Hongdong Li , Pan Ji

Text-guided scalable vector graphics (SVG) synthesis has broad applications in icon and sketch generation. However, existing text-to-SVG methods often suffer from limited editability, suboptimal visual quality, and low sample diversity. To…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Ximing Xing , Haitao Zhou , Chuang Wang , Jing Zhang , Dong Xu , Qian Yu

In recent times, the generation of 3D assets from text prompts has shown impressive results. Both 2D and 3D diffusion models can help generate decent 3D objects based on prompts. 3D diffusion models have good 3D consistency, but their…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Taoran Yi , Jiemin Fang , Junjie Wang , Guanjun Wu , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Qi Tian , Xinggang Wang

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field.…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Lutao Jiang , Ruyi Ji , Libo Zhang

The generation of 3D clothed humans has attracted increasing attention in recent years. However, existing work cannot generate layered high-quality 3D humans with consistent body structures. As a result, these methods are unable to…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yi Wang , Jian Ma , Ruizhi Shao , Qiao Feng , Yu-Kun Lai , Yebin Liu , Kun Li

The diffusion model has been proven a powerful generative model in recent years, yet remains a challenge in generating visual text. Several methods alleviated this issue by incorporating explicit text position and content as guidance on…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

Recent advances in diffusion models have greatly improved image generation and editing, yet generating or reconstructing layered PSD files with transparent alpha channels remains highly challenging. We propose OmniPSD, a unified diffusion…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Cheng Liu , Yiren Song , Haofan Wang , Mike Zheng Shou

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

Diffusion models (DMs) have become the new trend of generative models and have demonstrated a powerful ability of conditional synthesis. Among those, text-to-image diffusion models pre-trained on large-scale image-text pairs are highly…

计算机视觉与模式识别 · 计算机科学 2023-03-06 Wenliang Zhao , Yongming Rao , Zuyan Liu , Benlin Liu , Jie Zhou , Jiwen Lu

In medical imaging, the diffusion models have shown great potential for synthetic image generation tasks. However, these approaches often lack the interpretable connections between the generated and real images and can create anatomically…

图像与视频处理 · 电气工程与系统科学 2026-02-12 Jian-Qing Zheng , Yuanhan Mo , Yang Sun , Jiahua Li , Fuping Wu , Ziyang Wang , Tonia Vincent , Bartłomiej W. Papież

Diffusion models have emerged as a powerful generative method, capable of producing stunning photo-realistic images from natural language descriptions. However, these models lack explicit control over the 3D structure in the generated…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Wufei Ma , Qihao Liu , Jiahao Wang , Angtian Wang , Xiaoding Yuan , Yi Zhang , Zihao Xiao , Guofeng Zhang , Beijia Lu , Ruxiao Duan , Yongrui Qi , Adam Kortylewski , Yaoyao Liu , Alan Yuille

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Zongye Zhang , Bohan Kong , Qingjie Liu , Yunhong Wang

Generating 3D CT volumes from descriptive free-text inputs presents a transformative opportunity in diagnostics and research. In this paper, we introduce Text2CT, a novel approach for synthesizing 3D CT volumes from textual descriptions…

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li

In recent years, 3D Gaussian splatting has emerged as a powerful technique for 3D reconstruction and generation, known for its fast and high-quality rendering capabilities. To address these shortcomings, this paper introduces a novel…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Xianglong He , Junyi Chen , Sida Peng , Di Huang , Yangguang Li , Xiaoshui Huang , Chun Yuan , Wanli Ouyang , Tong He

Text-guided 3D face synthesis has achieved remarkable results by leveraging text-to-image (T2I) diffusion models. However, most existing works focus solely on the direct generation, ignoring the editing, restricting them from synthesizing…

计算机视觉与模式识别 · 计算机科学 2023-12-04 Yunjie Wu , Yapeng Meng , Zhipeng Hu , Lincheng Li , Haoqian Wu , Kun Zhou , Weiwei Xu , Xin Yu