English
Related papers

Related papers: Flex3D: Feed-Forward 3D Generation with Flexible R…

200 papers

We introduce ShowRoom3D, a three-stage approach for generating high-quality 3D room-scale scenes from texts. Previous methods using 2D diffusion priors to optimize neural radiance fields for generating room-scale scenes have shown…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Weijia Mao , Yan-Pei Cao , Jia-Wei Liu , Zhongcong Xu , Mike Zheng Shou

The default strategy for training single-view Large Reconstruction Models (LRMs) follows the fully supervised route using large-scale datasets of synthetic 3D assets or multi-view captures. Although these resources simplify the training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Hanwen Jiang , Qixing Huang , Georgios Pavlakos

With the increasing popularity of autonomous driving based on the powerful and unified bird's-eye-view (BEV) representation, a demand for high-quality and large-scale multi-view video data with accurate annotation is urgently required.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Xiaofan Li , Yifu Zhang , Xiaoqing Ye

Video generation models have made significant progress in generating realistic content, enabling applications in simulation, gaming, and film making. However, current generated videos still contain visual artifacts arising from 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Duolikun Danier , Ge Gao , Steven McDonagh , Changjian Li , Hakan Bilen , Oisin Mac Aodha

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

This paper tackles the problem of generalizable 3D-aware generation from monocular datasets, e.g., ImageNet. The key challenge of this task is learning a robust 3D-aware representation without multi-view or dynamic data, while ensuring…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yuxin Wang , Qianyi Wu , Dan Xu

We introduce GRM, a large-scale reconstructor capable of recovering a 3D asset from sparse-view images in around 0.1s. GRM is a feed-forward transformer-based model that efficiently incorporates multi-view information to translate the input…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yinghao Xu , Zifan Shi , Wang Yifan , Hansheng Chen , Ceyuan Yang , Sida Peng , Yujun Shen , Gordon Wetzstein

3D vector graphics play a crucial role in various applications including 3D shape retrieval, conceptual design, and virtual reality interactions due to their ability to capture essential structural information with minimal representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chuang Wang , Haitao Zhou , Ling Luo , Qian Yu

The remarkable achievements of both generative models of 2D images and neural field representations for 3D scenes present a compelling opportunity to integrate the strengths of both approaches. In this work, we propose a methodology that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Azmi Haider , Dan Rosenbaum

Recent advances in 4D generation mainly focus on generating 4D content by distilling pre-trained text or single-view image-conditioned models. It is inconvenient for them to take advantage of various off-the-shelf 3D assets with multi-view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yanqin Jiang , Chaohui Yu , Chenjie Cao , Fan Wang , Weiming Hu , Jin Gao

2D-to-3D reconstruction is an ill-posed problem, yet humans are good at solving this problem due to their prior knowledge of the 3D world developed over years. Driven by this observation, we propose NeRDi, a single-view NeRF synthesis…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Congyue Deng , Chiyu "Max'' Jiang , Charles R. Qi , Xinchen Yan , Yin Zhou , Leonidas Guibas , Dragomir Anguelov

The synthesis of spatiotemporally coherent 4D content presents fundamental challenges in computer vision, requiring simultaneous modeling of high-fidelity spatial representations and physically plausible temporal dynamics. Current…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyan Liu , Kangrui Li , Yuehao Song , Jiaxin Liu

Recent progress in 3D object generation has been fueled by the strong priors offered by diffusion models. However, existing models are tailored to specific tasks, accommodating only one modality at a time and necessitating retraining to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yijun Fan , Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Traditional 3D content creation tools empower users to bring their imagination to life by giving them direct control over a scene's geometry, appearance, motion, and camera path. Creating computer-generated videos, however, is a tedious…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Shengqu Cai , Duygu Ceylan , Matheus Gadelha , Chun-Hao Paul Huang , Tuanfeng Yang Wang , Gordon Wetzstein

We present GSD, a diffusion model approach based on Gaussian Splatting (GS) representation for 3D object reconstruction from a single view. Prior works suffer from inconsistent 3D geometry or mediocre rendering quality due to improper…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuxuan Mu , Xinxin Zuo , Chuan Guo , Yilin Wang , Juwei Lu , Xiaofeng Wu , Songcen Xu , Peng Dai , Youliang Yan , Li Cheng

3D editing is a fundamental capability for scalable 3D content creation. While image editing has rapidly evolved toward large-scale feedforward generative paradigms, 3D AI generation remains dominated by training-free editing pipelines. A…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiawei Weng , Saining Zhang , Zhenxin Diao , Peishuo Li , Henghaofan Zhang , Junhao Chen , Hao Zhao

Open-world 3D reconstruction models have recently garnered significant attention. However, without sufficient 3D inductive bias, existing methods typically entail expensive training costs and struggle to extract high-quality 3D meshes. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Minghua Liu , Chong Zeng , Xinyue Wei , Ruoxi Shi , Linghao Chen , Chao Xu , Mengqi Zhang , Zhaoning Wang , Xiaoshuai Zhang , Isabella Liu , Hongzhi Wu , Hao Su

We present LT3SD, a novel latent diffusion model for large-scale 3D scene generation. Recent advances in diffusion models have shown impressive results in 3D object generation, but are limited in spatial extent and quality when extended to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Quan Meng , Lei Li , Matthias Nießner , Angela Dai

Recovering 3D scenes from sparse views is a challenging task due to its inherent ill-posed problem. Conventional methods have developed specialized solutions (e.g., geometry regularization or feed-forward deterministic model) to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hanyang Wang , Fangfu Liu , Jiawei Chi , Yueqi Duan

The limited availability of 3D medical image datasets, due to privacy concerns and high collection or annotation costs, poses significant challenges in the field of medical imaging. While a promising alternative is the use of synthesized…

Image and Video Processing · Electrical Eng. & Systems 2024-05-27 Lingting Zhu , Noel Codella , Dongdong Chen , Zhenchao Jin , Lu Yuan , Lequan Yu