English
Related papers

Related papers: An Optimization Framework to Enforce Multi-View Co…

200 papers

2D-to-3D reconstruction is an ill-posed problem, yet humans are good at solving this problem due to their prior knowledge of the 3D world developed over years. Driven by this observation, we propose NeRDi, a single-view NeRF synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Congyue Deng , Chiyu "Max'' Jiang , Charles R. Qi , Xinchen Yan , Yin Zhou , Leonidas Guibas , Dragomir Anguelov

3D content creation via text-driven stylization has played a fundamental challenge to multimedia and graphics community. Recent advances of cross-modal foundation models (e.g., CLIP) have made this problem feasible. Those approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Haibo Yang , Yang Chen , Yingwei Pan , Ting Yao , Zhineng Chen , Tao Mei

Current 4D generation methods have achieved noteworthy efficacy with the aid of advanced diffusion generative models. However, these methods lack multi-view spatial-temporal modeling and encounter challenges in integrating diverse prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Haiyu Zhang , Xinyuan Chen , Yaohui Wang , Xihui Liu , Yunhong Wang , Yu Qiao

We present a novel framework for mesh reconstruction from unstructured point clouds by taking advantage of the learned visibility of the 3D points in the virtual views and traditional graph-cut based mesh generation. Specifically, we first…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Shuang Song , Zhaopeng Cui , Rongjun Qin

Reconstructing 3D objects from extremely sparse views is a long-standing and challenging problem. While recent techniques employ image diffusion models for generating plausible images at novel viewpoints or for distilling pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Zi-Xin Zou , Weihao Cheng , Yan-Pei Cao , Shi-Sheng Huang , Ying Shan , Song-Hai Zhang

We propose MVGBench, a comprehensive benchmark for multi-view image generation models (MVGs) that evaluates 3D consistency in geometry and texture, image quality, and semantics (using vision language models). Recently, MVGs have been the…

Graphics · Computer Science 2025-07-02 Xianghui Xie , Chuhang Zou , Meher Gitika Karumuri , Jan Eric Lenssen , Gerard Pons-Moll

We introduce MEt3R, a metric for multi-view consistency in generated images. Large-scale generative models for multi-view image generation are rapidly advancing the field of 3D inference from sparse observations. However, due to the nature…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Mohammad Asim , Christopher Wewer , Thomas Wimmer , Bernt Schiele , Jan Eric Lenssen

Multi-view consistency remains a challenge for image diffusion models. Even within the Text-to-Texture problem, where perfect geometric correspondences are known a priori, many methods fail to yield aligned predictions across views,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shimon Vainer , Konstantin Kutsy , Dante De Nigris , Ciara Rowles , Slava Elizarov , Simon Donné

We present Make-A-Texture, a new framework that efficiently synthesizes high-resolution texture maps from textual prompts for given 3D geometries. Our approach progressively generates textures that are consistent across multiple viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Xiaoyu Xiang , Liat Sless Gorelik , Yuchen Fan , Omri Armstrong , Forrest Iandola , Yilei Li , Ita Lifshitz , Rakesh Ranjan

We present a volume rendering-based neural surface reconstruction method that takes as few as three disparate RGB images as input. Our key idea is to regularize the reconstruction, which is severely ill-posed and leaving significant gaps…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Aditya Vora , Akshay Gadi Patil , Hao Zhang

Current methods for 3D scene reconstruction from sparse posed images employ intermediate 3D representations such as neural fields, voxel grids, or 3D Gaussians, to achieve multi-view consistent scene appearance and geometry. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Vitor Guizilini , Muhammad Zubair Irshad , Dian Chen , Greg Shakhnarovich , Rares Ambrus

We present a new effective way for performance capture of deforming meshes with fine-scale time-varying surface detail from multi-view video. Our method builds up on coarse 4D surface reconstructions, as obtained with commonly used…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Nadia Robertini , Edilson De Aguiar , Thomas Helten , Christian Theobalt

Multiview clustering (MVC) segregates data samples into meaningful clusters by synthesizing information across multiple views. Moreover, deep learning-based methods have demonstrated their strong feature learning capabilities in MVC…

Machine Learning · Computer Science 2024-03-22 Hao Yang , Hua Mao , Wai Lok Woo , Jie Chen , Xi Peng

Many real-world applications, such as interactive photo retouching, artistic content creation, and product design, require flexible and iterative image editing. However, existing image editing methods primarily focus on achieving the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Zijun Zhou , Yingying Deng , Xiangyu He , Weiming Dong , Fan Tang

3D Gaussian Splatting (3DGS) has gained significant attention for its high-quality rendering capabilities, ultra-fast training, and inference speeds. However, when we apply 3DGS to surface reconstruction tasks, especially in environments…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Chenfeng Hou , Qi Xun Yeo , Mengqi Guo , Yongxin Su , Yanyan Li , Gim Hee Lee

Reconstructing 3D objects from a single image is an intriguing but challenging problem. One promising solution is to utilize multi-view (MV) 3D reconstruction to fuse generated MV images into consistent 3D objects. However, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yizheng Chen , Rengan Xie , Qi Ye , Sen Yang , Zixuan Xie , Tianxiao Chen , Rong Li , Yuchi Huo

This paper presents a multi stage 3D shape reconstruction system of multiple object scenes by considering the silhouette inconsistencies in shape-from silhouette SFS method. These inconsistencies are common in multiple view images due to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Waqqas-ur-Rehman Butt , Martin Servin

The stylization of 3D scenes is an increasingly attractive topic in 3D vision. Although image style transfer has been extensively researched with promising results, directly applying 2D style transfer methods to 3D scenes often fails to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yushen Zuo , Jun Xiao , Kin-Chung Chan , Rongkang Dong , Cuixin Yang , Zongqi He , Hao Xie , Kin-Man Lam

We present a novel method for 3D surface reconstruction from multiple images where only a part of the object of interest is captured. Our approach builds on two recent developments: surface reconstruction using neural radiance fields for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Savva Ignatyev , Daniil Selikhanovych , Oleg Voynov , Yiqun Wang , Peter Wonka , Stamatios Lefkimmiatis , Evgeny Burnaev

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury