English
Related papers

Related papers: Isotropic3D: Image-to-3D Generation Based on a Sin…

200 papers

The limited availability of 3D medical image datasets, due to privacy concerns and high collection or annotation costs, poses significant challenges in the field of medical imaging. While a promising alternative is the use of synthesized…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Lingting Zhu , Noel Codella , Dongdong Chen , Zhenchao Jin , Lu Yuan , Lequan Yu

Recent advancements in open-world 3D object generation have been remarkable, with image-to-3D methods offering superior fine-grained control over their text-to-3D counterparts. However, most existing models fall short in simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Minghua Liu , Ruoxi Shi , Linghao Chen , Zhuoyang Zhang , Chao Xu , Xinyue Wei , Hansheng Chen , Chong Zeng , Jiayuan Gu , Hao Su

Diffusion models have recently emerged as a powerful technique in image generation, especially for image super-resolution tasks. While 2D diffusion models significantly enhance the resolution of individual images, existing diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Bohao Chen , Yanchao Zhang , Yanan Lv , Hua Han , Xi Chen

Score Distillation Sampling (SDS) has made significant strides in distilling image-generative models for 3D generation. However, its maximum-likelihood-seeking behavior often leads to degraded visual quality and diversity, limiting its…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Runjie Yan , Yinbo Chen , Xiaolong Wang

Current image-to-3D approaches suffer from high computational costs and lack scalability for high-resolution outputs. In contrast, we introduce a novel framework to directly generate explicit surface geometry and texture using multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Haoyu Wu , Meher Gitika Karumuri , Chuhang Zou , Seungbae Bang , Yuelong Li , Dimitris Samaras , Sunil Hadap

Exploiting 3D Gaussian Splatting (3DGS) with Contrastive Language-Image Pre-Training (CLIP) models for open-vocabulary 3D semantic understanding of indoor scenes has emerged as an attractive research focus. Existing methods typically attach…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Guibiao Liao , Jiankun Li , Zhenyu Bao , Xiaoqing Ye , Qing Li , Kanglin Liu

3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images…

Graphics · Computer Science 2025-03-04 Changlin Song , Jiaqi Wang , Liyun Zhu , He Weng

Text-to-image diffusion-based generative models have the stunning ability to generate photo-realistic images and achieve state-of-the-art low FID scores on challenging image generation benchmarks. However, one of the primary failure modes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Arman Zarei , Keivan Rezaei , Samyadeep Basu , Mehrdad Saberi , Mazda Moayeri , Priyatham Kattakinda , Soheil Feizi

Solving medical imaging data scarcity through semantic image generation has attracted growing attention in recent years. However, existing generative models mainly focus on synthesizing whole-organ or large-tissue structures, showing…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Jiahao Xia , Yutao Hu , Yaolei Qi , Zhenliang Li , Wenqi Shao , Junjun He , Ying Fu , Longjiang Zhang , Guanyu Yang

Score distillation sampling (SDS) has shown great promise in text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models, but suffers from over-saturation, over-smoothing, and low-diversity problems. In this…

Machine Learning · Computer Science 2023-11-23 Zhengyi Wang , Cheng Lu , Yikai Wang , Fan Bao , Chongxuan Li , Hang Su , Jun Zhu

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

3D medical imaging is in high demand and essential for clinical diagnosis and scientific research. Currently, diffusion models (DMs) have become an effective tool for medical imaging reconstruction thanks to their ability to learn rich,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Chenhe Du , Qing Wu , Xuanyu Tian , Jingyi Yu , Hongjiang Wei , Yuyao Zhang

Synthesizing multi-view 3D from one single image is a significant but challenging task. Zero-1-to-3 methods have achieved great success by lifting a 2D latent diffusion model to the 3D scope. The target view image is generated with a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Yabo Chen , Jiemin Fang , Yuyang Huang , Taoran Yi , Xiaopeng Zhang , Lingxi Xie , Xinggang Wang , Wenrui Dai , Hongkai Xiong , Qi Tian

Creative image generation has emerged as a compelling area of research, driven by the need to produce novel and high-quality images that expand the boundaries of imagination. In this work, we propose a novel framework for creative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Kunpeng Song , Ahmed Elgammal

We present DiSR-NeRF, a diffusion-guided framework for view-consistent super-resolution (SR) NeRF. Unlike prior works, we circumvent the requirement for high-resolution (HR) reference images by leveraging existing powerful 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jie Long Lee , Chen Li , Gim Hee Lee

Stereo video generation has been gaining increasing attention with recent advancements in video diffusion models. However, most existing methods focus on generating 3D stereoscopic videos from monocular 2D videos. These approaches typically…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Xingchang Huang , Ashish Kumar Singh , Florian Dubost , Cristina Nader Vasconcelos , Sakar Khattar , Liang Shi , Christian Theobalt , Cengiz Oztireli , Gurprit Singh

Text-to-3D generation from a single-view image is a popular but challenging task in 3D vision. Although numerous methods have been proposed, existing works still suffer from the inconsistency issues, including 1) semantic inconsistency, 2)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yichen Ouyang , Wenhao Chai , Jiayi Ye , Dapeng Tao , Yibing Zhan , Gaoang Wang

Due to their text-to-image synthesis feature, diffusion models have recently seen a rise in visual perception tasks, such as depth estimation. The lack of good-quality datasets makes the extraction of a fine-grain semantic context…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Nischal Khanal , Shivanand Venkanna Sheshappanavar

Images produced by diffusion models are increasingly popular in digital artwork and visual marketing. However, such generated images might replicate content from existing ones and pose the challenge of content originality. Existing Image…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Wenhao Wang , Yifan Sun , Zhentao Tan , Yi Yang