English
Related papers

Related papers: Efficient4D: Fast Dynamic 3D Object Generation fro…

200 papers

Reconstructing dynamic 3D scenes from sparse multi-view videos is highly ill-posed, often leading to geometric collapse, trajectory drift, and floating artifacts. Recent attempts introduce generative priors to hallucinate missing content,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Zhenlong Wu , Zihan Zheng , Xuanxuan Wang , Qianhe Wang , Hua Yang , Xiaoyun Zhang , Qiang Hu , Wenjun Zhang

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

Generating dynamic 4D objects from sparse inputs is difficult because it demands joint preservation of appearance and motion coherence across views and time while suppressing artifacts and temporal drift. We hypothesize that the view…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Su Sun , Cheng Zhao , Himangi Mittal , Gaurav Mittal , Rohith Kukkala , Yingjie Victor Chen , Mei Chen

We introduce Edify 3D, an advanced solution designed for high-quality 3D asset generation. Our method first synthesizes RGB and surface normal images of the described object at multiple viewpoints using a diffusion model. The multi-view…

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Recent breakthroughs in text-to-4D generation rely on pre-trained text-to-image and text-to-video models to generate dynamic 3D scenes. However, current text-to-4D methods face a three-way tradeoff between the quality of scene appearance,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sherwin Bahmani , Ivan Skorokhodov , Victor Rong , Gordon Wetzstein , Leonidas Guibas , Peter Wonka , Sergey Tulyakov , Jeong Joon Park , Andrea Tagliasacchi , David B. Lindell

In the domain of 3D scene representation, 3D Gaussian Splatting (3DGS) has emerged as a pivotal technology. However, its application to large-scale, high-resolution scenes (exceeding 4k$\times$4k pixels) is hindered by the excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Wenkai Liu , Tao Guan , Bin Zhu , Lili Ju , Zikai Song , Dan Li , Yuesong Wang , Wei Yang

Existing feedforward image-to-3D methods mainly rely on 2D multi-view diffusion models that cannot guarantee 3D consistency. These methods easily collapse when changing the prompt view direction and mainly handle object-centric cases. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuanhao Cai , He Zhang , Kai Zhang , Yixun Liang , Mengwei Ren , Fujun Luan , Qing Liu , Soo Ye Kim , Jianming Zhang , Zhifei Zhang , Yuqian Zhou , Yulun Zhang , Xiaokang Yang , Zhe Lin , Alan Yuille

4D generation, or dynamic 3D content generation, integrates spatial, temporal, and view dimensions to model realistic dynamic scenes, playing a foundational role in advancing world models and physical AI. However, maintaining long-chain…

Graphics · Computer Science 2026-04-01 Yuanbin Man , Ying Huang , Zhile Ren , Miao Yin

We propose 4DGT, a 4D Gaussian-based Transformer model for dynamic scene reconstruction, trained entirely on real-world monocular posed videos. Using 4D Gaussian as an inductive bias, 4DGT unifies static and dynamic components, enabling the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhen Xu , Zhengqin Li , Zhao Dong , Xiaowei Zhou , Richard Newcombe , Zhaoyang Lv

4D mesh generation has recently emerged as a powerful paradigm for recovering dynamic 3D structure from videos, but existing methods remain slow, computationally expensive, and difficult to scale to longer sequences. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Dvir Samuel , Yuval Atzmon , Gal Chechik , Yoni Kasten

One image to editable dynamic 3D model and video generation is novel direction and change in the research area of single image to 3D representation or 3D reconstruction of image. Gaussian Splatting has demonstrated its advantages in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jinwei Lin

This paper targets high-fidelity and real-time view synthesis of dynamic 3D scenes at 4K resolution. Recently, some methods on dynamic view synthesis have shown impressive rendering quality. However, their speed is still limited when…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhen Xu , Sida Peng , Haotong Lin , Guangzhao He , Jiaming Sun , Yujun Shen , Hujun Bao , Xiaowei Zhou

Recent years have seen significant advancements in 3D generation. While methods like score distillation achieve impressive results, they often require extensive per-scene optimization, which limits their time efficiency. On the other hand,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Chen Wang , Jiatao Gu , Xiaoxiao Long , Yuan Liu , Lingjie Liu

Generating multi-view images based on text or single-image prompts is a critical capability for the creation of 3D content. Two fundamental questions on this topic are what data we use for training and how to ensure multi-view consistency.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Qi Zuo , Xiaodong Gu , Lingteng Qiu , Yuan Dong , Zhengyi Zhao , Weihao Yuan , Rui Peng , Siyu Zhu , Zilong Dong , Liefeng Bo , Qixing Huang

Recent advances in diffusion-based generative models have established a new paradigm for image and video relighting. However, extending these capabilities to 4D relighting remains challenging, due primarily to the scarcity of paired 4D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Zhenghuang Wu , Kang Chen , Zeyu Zhang , Hao Tang

How can one efficiently generate high-quality, wide-scope 3D scenes from arbitrary single images? Existing methods suffer several drawbacks, such as requiring multi-view data, time-consuming per-scene optimization, distorted geometry in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hanwen Liang , Junli Cao , Vidit Goel , Guocheng Qian , Sergei Korolev , Demetri Terzopoulos , Konstantinos N. Plataniotis , Sergey Tulyakov , Jian Ren

Recent advancements in diffusion models for 2D and 3D content creation have sparked a surge of interest in generating 4D content. However, the scarcity of 3D scene datasets constrains current methodologies to primarily object-centric…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Dejia Xu , Hanwen Liang , Neel P. Bhatt , Hezhen Hu , Hanxue Liang , Konstantinos N. Plataniotis , Zhangyang Wang

Reliable 4D object detection, which refers to 3D object detection in streaming video, is crucial for perceiving and understanding the real world. Existing open-set 4D object detection methods typically make predictions on a frame-by-frame…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jiawei Hou , Shenghao Zhang , Can Wang , Zheng Gu , Yonggen Ling , Taiping Zeng , Xiangyang Xue , Jingbo Zhang

We present Dual3D, a novel text-to-3D generation framework that generates high-quality 3D assets from texts in only $1$ minute.The key component is a dual-mode multi-view latent diffusion model. Given the noisy multi-view latents, the 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyang Li , Zhangyu Lai , Linning Xu , Jianfei Guo , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji