English
Related papers

Related papers: A Generative Approach to High Fidelity 3D Reconstr…

200 papers

Recent 3D large reconstruction models typically employ a two-stage process, including first generate multi-view images by a multi-view diffusion model, and then utilize a feed-forward model to reconstruct images to 3D content.However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhenyu Tang , Junwu Zhang , Xinhua Cheng , Wangbo Yu , Chaoran Feng , Yatian Pang , Bin Lin , Li Yuan

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

We present a method of generating high resolution 3D shapes from natural language descriptions. To achieve this goal, we propose two steps that generating low resolution shapes which roughly reflect texts and generating high resolution…

Graphics · Computer Science 2019-01-23 Kentaro Fukamizu , Masaaki Kondo , Ryuichi Sakamoto

Generative Networks have proved to be extremely effective in image restoration and reconstruction in the past few years. Generating faces from textual descriptions is one such application where the power of generative algorithms can be…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Sandeep Shinde , Tejas Pradhan , Aniket Ghorpade , Mihir Tale

Per-scene optimization methods such as 3D Gaussian Splatting provide state-of-the-art novel view synthesis quality but extrapolate poorly to under-observed areas. Methods that leverage generative priors to correct artifacts in these areas…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Riccardo de Lutio , Tobias Fischer , Yen-Yu Chang , Yuxuan Zhang , Jay Zhangjie Wu , Xuanchi Ren , Tianchang Shen , Katarina Tothova , Zan Gojcic , Haithem Turki

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Recovering the shape and appearance of real-world objects from natural 2D images is a long-standing and challenging inverse rendering problem. In this paper, we introduce a novel hybrid differentiable rendering method to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiangyang Zhu , Yiling Pan , Bailin Deng , Bin Wang

Representation (feature) space is an environment where data points are vectorized, distances are computed, patterns are characterized, and geometric structures are embedded. Extracting a good representation space is critical to address the…

Machine Learning · Computer Science 2022-05-31 Dongjie Wang , Yanjie Fu , Kunpeng Liu , Xiaolin Li , Yan Solihin

Large-scale scene data is essential for training and testing in robot learning. Neural reconstruction methods have promised the capability of reconstructing large physically-grounded outdoor scenes from captured sensor data. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Julian Ost , Andrea Ramazzina , Amogh Joshi , Maximilian Bömer , Mario Bijelic , Felix Heide

In this paper, a deep learning-based model for 3D human motion generation from the text is proposed via gesture action classification and an autoregressive model. The model focuses on generating special gestures that express human thinking,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Gwantae Kim , Youngsuk Ryu , Junyeop Lee , David K. Han , Jeongmin Bae , Hanseok Ko

Large scale 3D scene reconstruction is important for applications such as virtual reality and simulation. Existing neural rendering approaches (e.g., NeRF, 3DGS) have achieved realistic reconstructions on large scenes, but optimize per…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yun Chen , Jingkang Wang , Ze Yang , Sivabalan Manivasagam , Raquel Urtasun

Reconstructing a 3D object from a 2D image is a well-researched vision problem, with many kinds of deep learning techniques having been tried. Most commonly, 3D convolutional approaches are used, though previous work has shown…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Rohan Agarwal , Wei Zhou , Xiaofeng Wu , Yuhan Li

We introduce ProcGen3D, a new approach for 3D content creation by generating procedural graph abstractions of 3D objects, which can then be decoded into rich, complex 3D assets. Inspired by the prevalent use of procedural generators in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xinyi Zhang , Daoyi Gao , Naiqi Li , Angela Dai

Numerous techniques have been proposed for reconstructing 3D models for opaque objects in past decades. However, none of them can be directly applied to transparent objects. This paper presents a fully automatic approach for reconstructing…

Graphics · Computer Science 2018-05-15 Bojian Wu , Yang Zhou , Yiming Qian , Minglun Gong , Hui Huang

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu

Generative AI, specifically text-to-image models, have revolutionized interior architectural design by enabling the rapid translation of conceptual ideas into visual representations from simple text prompts. While generative AI can produce…

Human-Computer Interaction · Computer Science 2025-06-19 Richa Gupta , Alexander Htet Kyaw

Most deep learning approaches to comprehensive semantic modeling of 3D indoor spaces require costly dense annotations in the 3D domain. In this work, we explore a central 3D scene modeling task, namely, semantic scene reconstruction without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Junwen Huang , Alexey Artemov , Yujin Chen , Shuaifeng Zhi , Kai Xu , Matthias Nießner

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Danilo Jimenez Rezende , S. M. Ali Eslami , Shakir Mohamed , Peter Battaglia , Max Jaderberg , Nicolas Heess

Two fundamental challenges face generative models in engineering applications: the acquisition of high-performing, diverse datasets, and the adherence to precise constraints in generated designs. We propose a novel approach combining…

Neural and Evolutionary Computing · Computer Science 2024-05-17 Adam Gaier , James Stoddart , Lorenzo Villaggi , Shyam Sudhakaran

The reconstruction of unsteady flow fields from limited measurements is a challenging and crucial task for many engineering applications. Machine learning models are gaining popularity for solving this problem due to their ability to learn…

Fluid Dynamics · Physics 2026-01-09 Marc Amorós-Trepat , Luis Medrano-Navarro , Qiang Liu , Luca Guastoni , Nils Thuerey