English
Related papers

Related papers: Gen3R: 3D Scene Generation Meets Feed-Forward Reco…

200 papers

Recently single-view 3D generation via Gaussian splatting has emerged and developed quickly. They learn 3D Gaussians from 2D RGB images generated from pre-trained multi-view diffusion (MVD) models, and have shown a promising avenue for 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yiyang Shen , Kun Zhou , He Wang , Yin Yang , Tianjia Shao

We present Pow3r, a novel large 3D vision regression model that is highly versatile in the input modalities it accepts. Unlike previous feed-forward models that lack any mechanism to exploit known camera or scene priors at test time, Pow3r…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Wonbong Jang , Philippe Weinzaepfel , Vincent Leroy , Lourdes Agapito , Jerome Revaud

Gen-Swarms is an innovative method that leverages and combines the capabilities of deep generative models with reactive navigation algorithms to automate the creation of drone shows. Advancements in deep generative models, particularly…

While recent advances in generative latent spaces have driven substantial progress in single-image generation, the optimal latent space for novel view synthesis (NVS) remains largely unexplored. In particular, NVS requires geometrically…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wooseok Jang , Seonghu Jeon , Jisang Han , Jinhyeok Choi , Minkyung Kwon , Seungryong Kim , Saining Xie , Sainan Liu

The reconstruction of 3D microstructures from 2D slices is considered to hold significant value in predicting the spatial structure and physical properties of materials.The dimensional extension from 2D to 3D is viewed as a highly…

Machine Learning · Computer Science 2024-02-27 Yilin Zheng , Zhigong Song

Streaming 3D perception is well suited to robotics and augmented reality, where long visual streams must be processed efficiently and consistently. Recent recurrent models offer a promising solution by maintaining fixed-size states and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Changkun Liu , Jiezhi Yang , Zeman Li , Yuan Deng , Jiancong Guo , Luca Ballan

Diffusion models have achieved great success in generating 2D images. However, the quality and generalizability of 3D content generation remain limited. State-of-the-art methods often require large-scale 3D assets for training, which are…

Graphics · Computer Science 2025-03-24 Jiantao Lin , Xin Yang , Meixi Chen , Yingjie Xu , Dongyu Yan , Leyi Wu , Xinli Xu , Lie XU , Shunsi Zhang , Ying-Cong Chen

High-resolution video generation has emerged as a crucial task in computer vision, with wide-ranging applications in entertainment, simulation, and data augmentation. However, generating temporally coherent and visually realistic videos…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Abhinav Sagar

Object-centric scene understanding is a fundamental challenge in computer vision. Existing approaches often rely on multi-stage pipelines that first apply pre-trained segmentors to extract individual objects, followed by per-object 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yi Du , Yang You , Xiang Wan , Leonidas Guibas

This paper addresses the task of large-scale 3D scene reconstruction from long video sequences. Recent feed-forward reconstruction models have shown promising results by directly regressing 3D geometry from RGB images without explicit 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Tao Xie , Peishan Yang , Yudong Jin , Yingfeng Cai , Wei Yin , Weiqiang Ren , Qian Zhang , Wei Hua , Sida Peng , Xiaoyang Guo , Xiaowei Zhou

Recent text-to-scene generation approaches largely reduced the manual efforts required to create 3D scenes. However, their focus is either to generate a scene layout or to generate objects, and few generate both. The generated scene layout…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zhenggang Tang , Yuehao Wang , Yuchen Fan , Jun-Kun Chen , Yu-Ying Yeh , Kihyuk Sohn , Zhangyang Wang , Qixing Huang , Alexander Schwing , Rakesh Ranjan , Dilin Wang , Zhicheng Yan

Recent advances in dense 3D reconstruction have led to significant progress, yet achieving accurate unified geometric prediction remains a major challenge. Most existing methods are limited to predicting a single geometry quantity from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xianze Fang , Jingnan Gao , Zhe Wang , Zhuo Chen , Xingyu Ren , Jiangjing Lyu , Qiaomu Ren , Zhonglei Yang , Xiaokang Yang , Yichao Yan , Chengfei Lyu

We train a feed-forward text-to-3D diffusion generator for human characters using only single-view 2D data for supervision. Existing 3D generative models cannot yet match the fidelity of image or video generative models. State-of-the-art 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Souhaib Attaiki , Paul Guerrero , Duygu Ceylan , Niloy J. Mitra , Maks Ovsjanikov

3D terrain models are essential in fields such as video game development and film production. Since surface color often correlates with terrain geometry, capturing this relationship is crucial to achieving realism. However, most existing…

Graphics · Computer Science 2025-12-18 Kazuki Higo , Toshiki Kanai , Yuki Endo , Yoshihiro Kanamori

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

We introduce Diff4Splat, a feed-forward method that synthesizes controllable and explicit 4D scenes from a single image. Our approach unifies the generative priors of video diffusion models with geometry and motion constraints learned from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Panwang Pan , Chenguo Lin , Jingjing Zhao , Chenxin Li , Yuchen Lin , Haopeng Li , Honglei Yan , Kairun Wen , Yunlong Lin , Yixuan Yuan , Yadong Mu

We present a novel method for generating geometrically realistic and consistent orbital videos from a single image of an object. Existing video generation works mostly rely on pixel-wise attention to enforce view consistency across frames.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Rong Wang , Ruyi Zha , Ziang Cheng , Jiayu Yang , Pulak Purkait , Hongdong Li

With the growing demand for high-fidelity 3D models from 2D images, existing methods still face significant challenges in accurately reproducing fine-grained geometric details due to limitations in domain gaps and inherent ambiguities in…

Graphics · Computer Science 2025-04-01 Chongjie Ye , Yushuang Wu , Ziteng Lu , Jiahao Chang , Xiaoyang Guo , Jiaqing Zhou , Hao Zhao , Xiaoguang Han

Despite the success of Generative Adversarial Networks (GANs) in image synthesis, applying trained GAN models to real image processing remains challenging. Previous methods typically invert a target image back to the latent space either by…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jinjin Gu , Yujun Shen , Bolei Zhou

While recent feed-forward 3D reconstruction models accelerate 3D reconstruction by jointly inferring dense geometry and camera poses in a single pass, their reliance on dense attention imposes a quadratic complexity, creating a prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Weining Ren , Xiao Tan , Kai Han