English
Related papers

Related papers: IPDreamer: Appearance-Controllable 3D Object Gener…

200 papers

While recent works have achieved great success on image-to-3D object generation, high quality and fidelity 3D head generation from a single image remains a great challenge. Previous text-based methods for generating 3D heads were limited by…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jinkun Hao , Junshu Tang , Jiangning Zhang , Ran Yi , Yijia Hong , Moran Li , Weijian Cao , Yating Wang , Chengjie Wang , Lizhuang Ma

Existing multi-view 3D object reconstruction methods heavily rely on sufficient overlap between input views, where occlusions and sparse coverage in practice frequently yield severe reconstruction incompleteness. Recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiahao Chang , Chongjie Ye , Yushuang Wu , Yuantao Chen , Yidan Zhang , Zhongjin Luo , Chenghong Li , Yihao Zhi , Xiaoguang Han

3D object generation has undergone significant advancements, yielding high-quality results. However, fall short of achieving precise user control, often yielding results that do not align with user expectations, thus limiting their…

Graphics · Computer Science 2024-04-26 Shaocong Dong , Lihe Ding , Zhanpeng Huang , Zibin Wang , Tianfan Xue , Dan Xu

Compositing an object into an image involves multiple non-trivial sub-tasks such as object placement and scaling, color/lighting harmonization, viewpoint/geometry adjustment, and shadow/reflection generation. Recent generative image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Gemma Canet Tarrés , Zhe Lin , Zhifei Zhang , Jianming Zhang , Yizhi Song , Dan Ruta , Andrew Gilbert , John Collomosse , Soo Ye Kim

Recent advancements in text-to-3D generation technology have significantly advanced the conversion of textual descriptions into imaginative well-geometrical and finely textured 3D objects. Despite these developments, a prevalent limitation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zexiang Liu , Yangguang Li , Youtian Lin , Xin Yu , Sida Peng , Yan-Pei Cao , Xiaojuan Qi , Xiaoshui Huang , Ding Liang , Wanli Ouyang

While generative artificial intelligence has advanced significantly across text, image, audio, and video domains, 3D generation remains comparatively underdeveloped due to fundamental challenges such as data scarcity, algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Weiyu Li , Xuanyang Zhang , Zheng Sun , Di Qi , Hao Li , Wei Cheng , Weiwei Cai , Shihao Wu , Jiarui Liu , Zihao Wang , Xiao Chen , Feipeng Tian , Jianxiong Pan , Zeming Li , Gang Yu , Xiangyu Zhang , Daxin Jiang , Ping Tan

We introduce InseRF, a novel method for generative object insertion in the NeRF reconstructions of 3D scenes. Based on a user-provided textual description and a 2D bounding box in a reference viewpoint, InseRF generates new objects in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Mohamad Shahbazi , Liesbeth Claessens , Michael Niemeyer , Edo Collins , Alessio Tonioni , Luc Van Gool , Federico Tombari

In the burgeoning field of AI-driven image generation, the quest for precision and relevance in response to textual prompts remains paramount. This paper introduces GPTDrawer, an innovative pipeline that leverages the generative prowess of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Kun Li , Xinwei Chen , Tianyou Song , Hansong Zhang , Wenzhe Zhang , Qing Shan

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Textured 3D morphing seeks to generate smooth and plausible transitions between two 3D assets, preserving both structural coherence and fine-grained appearance. This ability is crucial not only for advancing 3D generation research but also…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xiaolu Liu , Yicong Li , Qiyuan He , Jiayin Zhu , Wei Ji , Angela Yao , Jianke Zhu

Recent advances in text-to-image generation with diffusion models present transformative capabilities in image quality. However, user controllability of the generated image, and fast adaptation to new tasks still remains an open challenge,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Omer Bar-Tal , Lior Yariv , Yaron Lipman , Tali Dekel

We propose a novel approach to synthesizing images that are effective for training object detectors. Starting from a small set of real images, our algorithm estimates the rendering parameters required to synthesize similar images given a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-30 Artem Rozantsev , Vincent Lepetit , Pascal Fua

Generating high-quality 3D content from text, single images, or sparse view images remains a challenging task with broad applications. Existing methods typically employ multi-view diffusion models to synthesize multi-view images, followed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junlin Han , Jianyuan Wang , Andrea Vedaldi , Philip Torr , Filippos Kokkinos

Texture map production is an important part of 3D modeling and determines the rendering quality. Recently, diffusion-based methods have opened a new way for texture generation. However, restricted control flexibility and limited prompt…

Graphics · Computer Science 2025-06-04 Dongyu Yan , Leyi Wu , Jiantao Lin , Luozhou Wang , Tianshuo Xu , Zhifei Chen , Zhen Yang , Lie Xu , Shunsi Zhang , Yingcong Chen

We introduce ShapeWords, an approach for synthesizing images based on 3D shape guidance and text prompts. ShapeWords incorporates target 3D shape information within specialized tokens embedded together with the input text, effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Dmitry Petrov , Pradyumn Goyal , Divyansh Shivashok , Yuanming Tao , Melinos Averkiou , Evangelos Kalogerakis

DreamFusion established a new paradigm for unsupervised 3D reconstruction from virtual views by combining advances in generative models and differentiable rendering. However, the underlying multi-view rendering, along with supervision from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ananta R. Bhattarai , Xingzhe He , Alla Sheffer , Helge Rhodin

As humans, we aspire to create media content that is both freely willed and readily controlled. Thanks to the prominent development of generative techniques, we now can easily utilize 2D diffusion methods to synthesize images controlled by…

Graphics · Computer Science 2024-05-15 Wenqi Dong , Bangbang Yang , Lin Ma , Xiao Liu , Liyuan Cui , Hujun Bao , Yuewen Ma , Zhaopeng Cui

Automatic 3D content creation has gained increasing attention recently, due to its potential in various applications such as video games, film industry, and AR/VR. Recent advancements in diffusion models and multimodal models have notably…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yitong Wang , Xudong Xu , Li Ma , Haoran Wang , Bo Dai

3D content generation has wide applications in various fields. One of its dominant paradigms is by sparse-view reconstruction using multi-view images generated by diffusion models. However, since directly reconstructing triangle meshes from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Ruowen Zhao , Zhengyi Wang , Yikai Wang , Zihan Zhou , Jun Zhu