English
Related papers

Related papers: MicroDreamer: Efficient 3D Generation in $\sim$20 …

200 papers

Generative models for 3D object synthesis have seen significant advancements with the incorporation of prior knowledge distilled from 2D diffusion models. Nevertheless, challenges persist in the form of multi-view geometric inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Lincong Feng , Muyu Wang , Maoyu Wang , Kuo Xu , Xiaoli Liu

Most text-to-3D generators build upon off-the-shelf text-to-image models trained on billions of images. They use variants of Score Distillation Sampling (SDS), which is slow, somewhat unstable, and prone to artifacts. A mitigation is to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Luke Melas-Kyriazi , Iro Laina , Christian Rupprecht , Natalia Neverova , Andrea Vedaldi , Oran Gafni , Filippos Kokkinos

The recent advancements in text-to-3D generation mark a significant milestone in generative models, unlocking new possibilities for creating imaginative 3D assets across various real-world scenarios. While recent advancements in text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yixun Liang , Xin Yang , Jiantao Lin , Haodong Li , Xiaogang Xu , Yingcong Chen

3D content generation has wide applications in various fields. One of its dominant paradigms is by sparse-view reconstruction using multi-view images generated by diffusion models. However, since directly reconstructing triangle meshes from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Ruowen Zhao , Zhengyi Wang , Yikai Wang , Zihan Zhou , Jun Zhu

Score distillation sampling (SDS) has emerged as an effective framework in text-driven 3D editing tasks, leveraging diffusion models for 3D-consistent editing. However, existing SDS-based 3D editing methods suffer from long training times…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jiwook Kim , Seonho Lee , Jaeyo Shin , Jiho Choi , Hyunjung Shim

This paper presents Invariant Score Distillation (ISD), a novel method for high-fidelity text-to-3D generation. ISD aims to tackle the over-saturation and over-smoothing problems in Score Distillation Sampling (SDS). In this paper, SDS is…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Wenjie Zhuo , Fan Ma , Hehe Fan , Yi Yang

3D reconstruction of high-resolution target remains a challenge task due to the large memory required from the large input image size. Recently developed learning based algorithms provide promising reconstruction performance than…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yanwei Wang

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiaxiang Tang , Jiawei Ren , Hang Zhou , Ziwei Liu , Gang Zeng

Score-based generative models (SGMs) have gained prominence in sparse-view CT reconstruction for their precise sampling of complex distributions. In SGM-based reconstruction, data consistency in the score-based diffusion model ensures close…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Weiwen Wu , Yanyang Wang

While 2D diffusion models generate realistic, high-detail images, 3D shape generation methods like Score Distillation Sampling (SDS) built on these 2D diffusion models produce cartoon-like, over-smoothed shapes. To help explain this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Artem Lukoianov , Haitz Sáez de Ocáriz Borde , Kristjan Greenewald , Vitor Campagnolo Guizilini , Timur Bagautdinov , Vincent Sitzmann , Justin Solomon

While super-resolution (SR) methods based on diffusion models exhibit promising results, their practical application is hindered by the substantial number of required inference steps. Recent methods utilize degraded images in the initial…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yufei Wang , Wenhan Yang , Xinyuan Chen , Yaohui Wang , Lanqing Guo , Lap-Pui Chau , Ziwei Liu , Yu Qiao , Alex C. Kot , Bihan Wen

Text-to-3D generation aims to create 3D assets from text-to-image diffusion models. However, existing methods face an inherent bottleneck in generation quality because the widely-used objectives such as Score Distillation Sampling (SDS)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Zixuan Chen , Ruijie Su , Jiahao Zhu , Lingxiao Yang , Jian-Huang Lai , Xiaohua Xie

In the realm of text-to-3D generation, utilizing 2D diffusion models through score distillation sampling (SDS) frequently leads to issues such as blurred appearances and multi-faced geometry, primarily due to the intrinsically noisy nature…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Pengsheng Guo , Hans Hao , Adam Caccavale , Zhongzheng Ren , Edward Zhang , Qi Shan , Aditya Sankar , Alexander G. Schwing , Alex Colburn , Fangchang Ma

Existing Score Distillation Sampling (SDS)-based methods have driven significant progress in text-to-3D generation. However, 3D models produced by SDS-based methods tend to exhibit over-smoothing and low-quality outputs. These issues arise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

This technical report introduces TripoSR, a 3D reconstruction model leveraging transformer architecture for fast feed-forward 3D generation, producing 3D mesh from a single image in under 0.5 seconds. Building upon the LRM network…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Dmitry Tochilkin , David Pankratz , Zexiang Liu , Zixuan Huang , Adam Letts , Yangguang Li , Ding Liang , Christian Laforte , Varun Jampani , Yan-Pei Cao

We present a novel approach for recovering 3D shape and view dependent appearance from a few colored images, enabling efficient 3D reconstruction and novel view synthesis. Our method learns an implicit neural representation in the form of a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Mae Younes , Amine Ouasfi , Adnane Boukhayma

Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks…

Image and Video Processing · Electrical Eng. & Systems 2023-06-22 Mingjie Pan , Yulu Gan , Fangxu Zhou , Jiaming Liu , Aimin Wang , Shanghang Zhang , Dawei Li

Volumetric optical microscopy using non-diffracting beams enables rapid imaging of 3D volumes by projecting them axially to 2D images but lacks crucial depth information. Addressing this, we introduce MicroDiffusion, a pioneering tool…

Image and Video Processing · Electrical Eng. & Systems 2024-03-19 Mude Hui , Zihao Wei , Hongru Zhu , Fei Xia , Yuyin Zhou

Recent one image to 3D generation methods commonly adopt Score Distillation Sampling (SDS). Despite the impressive results, there are multiple deficiencies including multi-view inconsistency, over-saturated and over-smoothed textures, as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Junwu Zhang , Zhenyu Tang , Yatian Pang , Xinhua Cheng , Peng Jin , Yida Wei , Munan Ning , Li Yuan

Recent advances in diffusion models have significantly improved 3D generation, enabling the use of assets generated from an image for embodied AI simulations. However, the one-to-many nature of the image-to-3D problem limits their use due…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Onat Şahin , Mohammad Altillawi , George Eskandar , Carlos Carbone , Ziyuan Liu
‹ Prev 1 2 3 10 Next ›