English
Related papers

Related papers: 3D-Adapter: Geometry-Consistent Multi-View Diffusi…

200 papers

Recently, 3D generative domain adaptation has emerged to adapt the pre-trained generator to other domains without collecting massive datasets and camera pose distributions. Typically, they leverage large-scale pre-trained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hengjia Li , Yang Liu , Yibo Zhao , Haoran Cheng , Yang Yang , Linxuan Xia , Zekai Luo , Qibo Qiu , Boxi Wu , Tu Zheng , Zheng Yang , Deng Cai

3D scene reconstruction is fundamental for spatial intelligence applications such as AR, robotics, and digital twins. Traditional multi-view stereo struggles with sparse viewpoints or low-texture regions, while neural rendering approaches,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jiaqi Yao , Zhongmiao Yan , Jingyi Xu , Songpengcheng Xia , Yan Xiang , Ling Pei

Diffusion models have become a popular approach for image generation and reconstruction due to their numerous advantages. However, most diffusion-based inverse problem-solving methods only deal with 2D images, and even recently published 3D…

Image and Video Processing · Electrical Eng. & Systems 2023-09-04 Suhyeon Lee , Hyungjin Chung , Minyoung Park , Jonghyuk Park , Wi-Sun Ryu , Jong Chul Ye

We present a novel video generation framework that integrates 3-dimensional geometry and dynamic awareness. To achieve this, we augment 2D videos with 3D point trajectories and align them in pixel space. The resulting 3D-aware video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yunuo Chen , Junli Cao , Vidit Goel , Sergei Korolev , Chenfanfu Jiang , Jian Ren , Sergey Tulyakov , Anil Kag

Recent advancements in diffusion and flow models have greatly improved text-based image editing, yet methods that edit images independently often produce geometrically and photometrically inconsistent results across different views of the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Josef Bengtson , David Nilsson , Dong In Lee , Yaroslava Lochman , Fredrik Kahl

Developing a unified pipeline that enables users to remove, re-texture, or replace objects in a versatile manner is crucial for text-guided 3D inpainting. However, there are still challenges in performing multiple 3D inpainting tasks within…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jingyi Pan , Dan Xu , Qiong Luo

In this paper, we focus on 3D scene inpainting, where parts of an input image set, captured from different viewpoints, are masked out. The main challenge lies in generating plausible image completions that are geometrically consistent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Ahmad Salimi , Tristan Aumentado-Armstrong , Marcus A. Brubaker , Konstantinos G. Derpanis

We present a novel method for 3D scene editing using diffusion models, designed to ensure view consistency and realism across perspectives. Our approach leverages attention features extracted from a single reference image to define the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Eyal Gomel , Lior Wolf

Recently, a surge of high-quality 3D-aware GANs have been proposed, which leverage the generative power of neural rendering. It is natural to associate 3D GANs with GAN inversion methods to project a real image into the generator's latent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Fei Yin , Yong Zhang , Xuan Wang , Tengfei Wang , Xiaoyu Li , Yuan Gong , Yanbo Fan , Xiaodong Cun , Ying Shan , Cengiz Oztireli , Yujiu Yang

Open-world 3D reconstruction models have recently garnered significant attention. However, without sufficient 3D inductive bias, existing methods typically entail expensive training costs and struggle to extract high-quality 3D meshes. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Minghua Liu , Chong Zeng , Xinyue Wei , Ruoxi Shi , Linghao Chen , Chao Xu , Mengqi Zhang , Zhaoning Wang , Xiaoshuai Zhang , Isabella Liu , Hongzhi Wu , Hao Su

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury

While 3D GANs have recently demonstrated the high-quality synthesis of multi-view consistent images and 3D shapes, they are mainly restricted to photo-realistic human portraits. This paper aims to extend 3D GANs to a different, but…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Wonjoon Jin , Nuri Ryu , Geonung Kim , Seung-Hwan Baek , Sunghyun Cho

We introduce TurboPortrait3D: a method for low-latency novel-view synthesis of human portraits. Our approach builds on the observation that existing image-to-3D models for portrait generation, while capable of producing renderable 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Emily Kim , Julieta Martinez , Timur Bagautdinov , Jessica Hodgins

Recently, significant advances have been made in 3D object generation. Building upon the generated geometry, current pipelines typically employ image diffusion models to generate multi-view RGB images, followed by UV texture reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Mingqi Shao , Feng Xiong , Zhaoxu Sun , Mu Xu

During the last years, many advances have been made in tasks like3D model retrieval, 3D model classification, and 3D model segmentation.The typical 3D representations such as point clouds, voxels, and poly-gon meshes are mostly suitable for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Arniel Labrada , Benjamin Bustos , Ivan Sipiran

Estimating 3D geometry from monocular colonoscopy images is challenging due to non-Lambertian surfaces, moving light sources, and large textureless regions. While recent 3D geometric foundation models eliminate the need for multi-stage…

Image and Video Processing · Electrical Eng. & Systems 2025-12-01 Zhiyi Jiang , Yifu Wang , Xuelian Cheng , Zongyuan Ge

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common object generation,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Single-image-to-3D generative models can now produce high-quality geometry, yet conditioning on a single view inevitably introduces ambiguity about unseen regions. Multi-view conditioning can reduce this ambiguity, but existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanxiao Sun , Mingxin Yang , Shuhui Yang , Zebin He , Xintong Han , Hongbo Fu , Chunchao Guo , Wenhan Luo

The generation of high-quality, animatable 3D head avatars from text has enormous potential in content creation applications such as games, movies, and embodied virtual assistants. Current text-to-3D generation methods typically combine…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yiqian Wu , Malte Prinzler , Xiaogang Jin , Siyu Tang

Recent advances in diffusion models have significantly improved image generation and editing, but extending these capabilities to 3D assets remains challenging, especially for fine-grained edits that require multi-view consistency. Existing…

Graphics · Computer Science 2025-07-01 Junchao Huang , Xinting Hu , Shaoshuai Shi , Zhuotao Tian , Li Jiang