English
Related papers

Related papers: Portrait3D: Text-Guided High-Quality 3D Portrait G…

200 papers

We present AvatarPopUp, a method for fast, high quality 3D human avatar generation from different input modalities, such as images and text prompts and with control over the generated pose and shape. The common theme is the use of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Nikos Kolotouros , Thiemo Alldieck , Enric Corona , Eduard Gabriel Bazavan , Cristian Sminchisescu

We study the problem of generating point clouds of 3D objects. Instead of discretizing the object into 3D voxels with huge computational cost and resolution limitations, we propose a novel geometry image based generator (GIG) to convert the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Lei Wang , Yuchun Huang , Pengjie Tao , Yaolin Hou , Yuxuan Liu

In this work, we introduce Prometheus, a 3D-aware latent diffusion model for text-to-3D generation at both object and scene levels in seconds. We formulate 3D scene generation as multi-view, feed-forward, pixel-aligned 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yuanbo Yang , Jiahao Shao , Xinyang Li , Yujun Shen , Andreas Geiger , Yiyi Liao

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Using the latent diffusion model has proven effective in developing novel 3D generation techniques. To harness the latent diffusion model, a key challenge is designing a high-fidelity and efficient representation that links the latent space…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Haitao Yang , Yuan Dong , Hanwen Jiang , Dejia Xu , Georgios Pavlakos , Qixing Huang

In the field of computer vision, unsupervised learning for 2D object generation has advanced rapidly in the past few years. However, 3D object generation has not garnered the same attention or success as its predecessor. To facilitate novel…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Devendra K. Jangid , Neal R. Brodnik , Amil Khan , McLean P. Echlin , Tresa M. Pollock , Sam Daly , B. S. Manjunath

In this paper, we develop a new method, termed SDF-3DGAN, for 3D object generation and 3D-Aware image synthesis tasks, which introduce implicit Signed Distance Function (SDF) as the 3D object representation method in the generative field.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Lutao Jiang , Ruyi Ji , Libo Zhang

We present a high-fidelity 3D generative adversarial network (GAN) inversion framework that can synthesize photo-realistic novel views while preserving specific details of the input image. High-fidelity 3D GAN inversion is inherently…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Jiaxin Xie , Hao Ouyang , Jingtan Piao , Chenyang Lei , Qifeng Chen

Text-to-3D generation has attracted much attention from the computer vision community. Existing methods mainly optimize a neural field from scratch for each text prompt, relying on heavy and repetitive training cost which impedes their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Ming Li , Pan Zhou , Jia-Wei Liu , Jussi Keppo , Min Lin , Shuicheng Yan , Xiangyu Xu

3D-aware Generative Adversarial Networks (GANs) have shown remarkable progress in learning to generate multi-view-consistent images and 3D geometries of scenes from collections of 2D images via neural volume rendering. Yet, the significant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Alex Trevithick , Matthew Chan , Towaki Takikawa , Umar Iqbal , Shalini De Mello , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zhenwei Wang , Tengfei Wang , Zexin He , Gerhard Hancke , Ziwei Liu , Rynson W. H. Lau

Diffusion models have emerged as a powerful generative method, capable of producing stunning photo-realistic images from natural language descriptions. However, these models lack explicit control over the 3D structure in the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Wufei Ma , Qihao Liu , Jiahao Wang , Angtian Wang , Xiaoding Yuan , Yi Zhang , Zihao Xiao , Guofeng Zhang , Beijia Lu , Ruxiao Duan , Yongrui Qi , Adam Kortylewski , Yaoyao Liu , Alan Yuille

Generating accurate 3D models is a challenging problem that traditionally requires explicit learning from 3D datasets using supervised learning. Although recent advances have shown promise in learning 3D models from 2D images, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Qijia Shen , Guangrun Wang

Due to the fascinating generative performance of text-to-image diffusion models, growing text-to-3D generation works explore distilling the 2D generative priors into 3D, using the score distillation sampling (SDS) loss, to bypass the data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yu-Jie Yuan , Leif Kobbelt , Jiwen Liu , Yuan Zhang , Pengfei Wan , Yu-Kun Lai , Lin Gao

Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations…

This paper presents a method to reconstruct high-quality textured 3D models from single images. Current methods rely on datasets with expensive annotations; multi-view images and their camera parameters. Our method relies on GAN generated…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xinyang Li , Zhangyu Lai , Linning Xu , Yansong Qu , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Generative Adversarial Networks (GANs) have gained significant attention in several computer vision tasks for generating high-quality synthetic data. Various medical applications including diagnostic imaging and radiation therapy can…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

Face portrait line drawing is a unique style of art which is highly abstract and expressive. However, due to its high semantic constraints, many existing methods learn to generate portrait drawings using paired training data, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Ran Yi , Yong-Jin Liu , Yu-Kun Lai , Paul L. Rosin

While generative artificial intelligence has advanced significantly across text, image, audio, and video domains, 3D generation remains comparatively underdeveloped due to fundamental challenges such as data scarcity, algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Weiyu Li , Xuanyang Zhang , Zheng Sun , Di Qi , Hao Li , Wei Cheng , Weiwei Cai , Shihao Wu , Jiarui Liu , Zihao Wang , Xiao Chen , Feipeng Tian , Jianxiong Pan , Zeming Li , Gang Yu , Xiangyu Zhang , Daxin Jiang , Ping Tan