English
Related papers

Related papers: Gen3R: 3D Scene Generation Meets Feed-Forward Reco…

200 papers

Large-scale video diffusion models achieve impressive visual quality, yet often fail to preserve geometric consistency. Prior approaches improve consistency either by augmenting the generator with additional modules or applying…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zhaochong An , Orest Kupyn , Théo Uscidda , Andrea Colaco , Karan Ahuja , Serge Belongie , Mar Gonzalez-Franco , Marta Tintore Gazulla

We introduce ProcGen3D, a new approach for 3D content creation by generating procedural graph abstractions of 3D objects, which can then be decoded into rich, complex 3D assets. Inspired by the prevalent use of procedural generators in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xinyi Zhang , Daoyi Gao , Naiqi Li , Angela Dai

Recent advances in diffusion-based generation techniques enable AI models to produce highly realistic videos, heightening the need for reliable detection mechanisms. However, existing detection methods provide only limited exploration of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Wenhan Chen , Sezer Karaoglu , Theo Gevers

This report presents a comprehensive framework for generating high-quality 3D shapes and textures from diverse input prompts, including single images, multi-view images, and text descriptions. The framework consists of 3D shape generation…

We present Genesis, a unified framework for joint generation of multi-view driving videos and LiDAR sequences with spatio-temporal and cross-modal consistency. Genesis employs a two-stage architecture that integrates a DiT-based video…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Xiangyu Guo , Zhanqian Wu , Kaixin Xiong , Ziyang Xu , Lijun Zhou , Gangwei Xu , Shaoqing Xu , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

We propose VideoRFSplat, a direct text-to-3D model leveraging a video generation model to generate realistic 3D Gaussian Splatting (3DGS) for unbounded real-world scenes. To generate diverse camera poses and unbounded spatial extent of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Hyojun Go , Byeongjun Park , Hyelin Nam , Byung-Hoon Kim , Hyungjin Chung , Changick Kim

A single-pass driving clip frequently results in incomplete scanning of the road structure, making reconstructed scene expanding a critical requirement for sensor simulators to effectively regress driving actions. Although contemporary 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Sicong Du , Jiarun Liu , Qifeng Chen , Hao-Xiang Chen , Tai-Jiang Mu , Sheng Yang

This paper proposes a novel model for video generation and especially makes the attempt to deal with the problem of video generation from text descriptions, i.e., synthesizing realistic videos conditioned on given texts. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hongyuan Yu , Yan Huang , Lihong Pi , Liang Wang

High-resolution imagery is essential for accurate 3D reconstruction, as many geometric details only emerge at fine spatial scales. Recent feed-forward approaches, such as the Visual Geometry Grounded Transformer (VGGT), have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Tianrun Chen , Yuanqi Hu , Yidong Han , Hanjie Xu , Deyi Ji , Qi Zhu , Chunan Yu , Xin Zhang , Cheng Chen , Chaotao Ding , Ying Zang , Xuanfu Li , Jin Ma , Lanyun Zhu

Generative models, especially diffusion models (DMs), have achieved promising results for generating feature-rich geometries and advancing foundational science problems such as molecule design. Inspired by the recent huge success of Stable…

Machine Learning · Computer Science 2023-05-03 Minkai Xu , Alexander Powers , Ron Dror , Stefano Ermon , Jure Leskovec

Recent advances in video generation enable a new paradigm for 3D scene creation: generating camera-controlled videos that simulate scene walkthroughs, then lifting them to 3D via feed-forward reconstruction techniques. This generative…

We present WinT3R, a feed-forward reconstruction model capable of online prediction of precise camera poses and high-quality point maps. Previous methods suffer from a trade-off between reconstruction quality and real-time performance. To…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Zizun Li , Jianjun Zhou , Yifan Wang , Haoyu Guo , Wenzheng Chang , Yang Zhou , Haoyi Zhu , Junyi Chen , Chunhua Shen , Tong He

Diffusion models have emerged as the new state-of-the-art generative model with high quality samples, with intriguing properties such as mode coverage and high flexibility. They have also been shown to be effective inverse problem solvers,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Hyungjin Chung , Dohoon Ryu , Michael T. McCann , Marc L. Klasky , Jong Chul Ye

Accurately reconstructing complex full multi-object scenes from sparse observations remains a core challenge in computer vision and a key step toward scalable and reliable simulation for robotics. In this work, we introduce RecGen, a…

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

We present a latent diffusion model over 3D scenes, that can be trained using only 2D image data. To achieve this, we first design an autoencoder that maps multi-view images to 3D Gaussian splats, and simultaneously builds a compressed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Paul Henderson , Melonie de Almeida , Daniela Ivanova , Titas Anciukevičius

High-resolution 3D object generation remains a challenging task primarily due to the limited availability of comprehensive annotated training data. Recent advancements have aimed to overcome this constraint by harnessing image generative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Zijie Pan , Jiachen Lu , Xiatian Zhu , Li Zhang

A recent frontier in computer vision has been the task of 3D video generation, which consists of generating a time-varying 3D representation of a scene. To generate dynamic 3D scenes, current methods explicitly model 3D temporal dynamics by…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Rishab Parthasarathy , Zachary Ankner , Aaron Gokaslan

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

Recent advances in 3D Gaussian Splatting (3DGS) present two main directions: feed-forward models offer fast inference in sparse-view settings, while per-scene optimization yields high-quality renderings but is computationally expensive. To…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yueh-Cheng Liu , Jozef Hladký , Matthias Nießner , Angela Dai