English
Related papers

Related papers: DreamBeast: Distilling 3D Fantastical Animals with…

200 papers

The increased demand for 3D data in AR/VR, robotics and gaming applications, gave rise to powerful generative pipelines capable of synthesizing high-quality 3D objects. Most of these models rely on the Score Distillation Sampling (SDS)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Ziyu Wan , Despoina Paschalidou , Ian Huang , Hongyu Liu , Bokui Shen , Xiaoyu Xiang , Jing Liao , Leonidas Guibas

In this work, we introduce \textbf{Wonder3D++}, a novel method for efficiently generating high-fidelity textured meshes from single-view images. Recent methods based on Score Distillation Sampling (SDS) have shown the potential to recover…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yuxiao Yang , Xiao-Xiao Long , Zhiyang Dou , Cheng Lin , Yuan Liu , Qingsong Yan , Yuexin Ma , Haoqian Wang , Zhiqiang Wu , Wei Yin

In this paper, we propose an effective two-stage approach named Grounded-Dreamer to generate 3D assets that can accurately follow complex, compositional text prompts while achieving high fidelity by using a pre-trained multi-view diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Xiaolong Li , Jiawei Mo , Ying Wang , Chethan Parameshwara , Xiaohan Fei , Ashwin Swaminathan , CJ Taylor , Zhuowen Tu , Paolo Favaro , Stefano Soatto

The ability to generate virtual environments is crucial for applications ranging from gaming to physical AI domains such as robotics, autonomous driving, and industrial AI. Current learning-based 3D reconstruction methods rely on the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Sherwin Bahmani , Tianchang Shen , Jiawei Ren , Jiahui Huang , Yifeng Jiang , Haithem Turki , Andrea Tagliasacchi , David B. Lindell , Zan Gojcic , Sanja Fidler , Huan Ling , Jun Gao , Xuanchi Ren

Recent advancements in optimization-based text-to-3D generation heavily rely on distilling knowledge from pre-trained text-to-image diffusion models using techniques like Score Distillation Sampling (SDS), which often introduce artifacts…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ziying Li , Xuequan Lu , Xinkui Zhao , Guanjie Cheng , Shuiguang Deng , Jianwei Yin

Recently, the emergence of diffusion models has opened up new opportunities for single-view reconstruction. However, all the existing methods represent the target object as a closed mesh devoid of any structural information, thus neglecting…

Graphics · Computer Science 2024-05-28 Anran Liu , Cheng Lin , Yuan Liu , Xiaoxiao Long , Zhiyang Dou , Hao-Xiang Guo , Ping Luo , Wenping Wang

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic sets while preserving training efficacy. However, existing studies mainly focus on image classification, leaving dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wenjie Zheng , Haoji Hu , Jiali Lu , Xingze Zou , Jing Wang

The success of 3DGS in generative and editing applications has sparked growing interest in 3DGS-based style transfer. However, current methods still face two major challenges: (1) multi-view inconsistency often leads to style conflicts,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yitong Yang , Yinglin Wang , Changshuo Wang , Huajie Wang , Shuting He

Driven by powerful image diffusion models, recent research has achieved the automatic creation of 3D objects from textual or visual guidance. By performing score distillation sampling (SDS) iteratively across different views, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zeyu Li , Ruitong Gan , Chuanchen Luo , Yuxi Wang , Jiaheng Liu , Ziwei Zhu Man Zhang , Qing Li , Xucheng Yin , Zhaoxiang Zhang , Junran Peng

Recently, text-guided 3D generative methods have made remarkable advancements in producing high-quality textures and geometry, capitalizing on the proliferation of large vision-language and image diffusion models. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Xiao Han , Yukang Cao , Kai Han , Xiatian Zhu , Jiankang Deng , Yi-Zhe Song , Tao Xiang , Kwan-Yee K. Wong

Score distillation sampling (SDS) and its variants have greatly boosted the development of text-to-3D generation, but are vulnerable to geometry collapse and poor textures yet. To solve this issue, we first deeply analyze the SDS and find…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Zike Wu , Pan Zhou , Xuanyu Yi , Xiaoding Yuan , Hanwang Zhang

Novel view synthesis has observed tremendous developments since the arrival of NeRFs. However, Nerf models overfit on a single scene, lacking generalization to out of distribution objects. Recently, diffusion models have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Rukhshanda Hussain , Hui Xian Grace Lim , Borchun Chen , Mubarak Shah , Ser Nam Lim

Diffusion models have demonstrated excellent performance for real-world image super-resolution (Real-ISR), albeit at high computational costs. Most existing methods are trying to derive one-step diffusion models from multi-step counterparts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jianze Li , Jiezhang Cao , Zichen Zou , Xiongfei Su , Xin Yuan , Yulun Zhang , Yong Guo , Xiaokang Yang

Generating diverse and high-quality 3D assets automatically poses a fundamental yet challenging task in 3D computer vision. Despite extensive efforts in 3D generation, existing optimization-based approaches struggle to produce large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Ziang Cao , Fangzhou Hong , Tong Wu , Liang Pan , Ziwei Liu

We introduce Posterior Distillation Sampling (PDS), a novel optimization method for parametric image editing based on diffusion models. Existing optimization-based methods, which leverage the powerful 2D prior of diffusion models to handle…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juil Koo , Chanho Park , Minhyuk Sung

Diffusion models like Stable Diffusion (SD) drive a vibrant open-source ecosystem including fully fine-tuned checkpoints and parameter-efficient adapters such as LoRA, LyCORIS, and ControlNet. However, these adaptation components are…

Machine Learning · Computer Science 2025-12-04 Zhidong Gao , Zimeng Pan , Yuhang Yao , Chenyue Xie , Wei Wei

This paper presents a novel method to generate textures for 3D models given text prompts and 3D meshes. Additional depth information is taken into account to perform the Score Distillation Sampling (SDS) process with depth conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cindy Le , Congrui Hetang , Chendi Lin , Ang Cao , Yihui He

It is highly desirable to obtain a model that can generate high-quality 3D meshes from text prompts in just seconds. While recent attempts have adapted pre-trained text-to-image diffusion models, such as Stable Diffusion (SD), into…

Graphics · Computer Science 2025-03-28 Zhiyuan Ma , Xinyue Liang , Rongyuan Wu , Xiangyu Zhu , Zhen Lei , Lei Zhang

Existing Score Distillation Sampling (SDS)-based methods have driven significant progress in text-to-3D generation. However, 3D models produced by SDS-based methods tend to exhibit over-smoothing and low-quality outputs. These issues arise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

Although Score Distillation Sampling (SDS) has exhibited remarkable performance in conditional 3D content generation, a comprehensive understanding of its formulation is still lacking, hindering the development of 3D generation. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Boshi Tang , Jianan Wang , Zhiyong Wu , Lei Zhang