English
Related papers

Related papers: 4D-LRM: Large Space-Time Reconstruction Model From…

200 papers

We propose the first Large Reconstruction Model (LRM) that predicts the 3D model of an object from a single input image within just 5 seconds. In contrast to many previous methods that are trained on small-scale datasets such as ShapeNet in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yicong Hong , Kai Zhang , Jiuxiang Gu , Sai Bi , Yang Zhou , Difan Liu , Feng Liu , Kalyan Sunkavalli , Trung Bui , Hao Tan

We present L4GM, the first 4D Large Reconstruction Model that produces animated objects from a single-view video input -- in a single feed-forward pass that takes only a second. Key to our success is a novel dataset of multiview videos…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jiawei Ren , Kevin Xie , Ashkan Mirzaei , Hanxue Liang , Xiaohui Zeng , Karsten Kreis , Ziwei Liu , Antonio Torralba , Sanja Fidler , Seung Wook Kim , Huan Ling

We propose GS-LRM, a scalable large reconstruction model that can predict high-quality 3D Gaussian primitives from 2-4 posed sparse images in 0.23 seconds on single A100 GPU. Our model features a very simple transformer-based architecture;…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Kai Zhang , Sai Bi , Hao Tan , Yuanbo Xiangli , Nanxuan Zhao , Kalyan Sunkavalli , Zexiang Xu

We present Large Inverse Rendering Model (LIRM), a transformer architecture that jointly reconstructs high-quality shape, materials, and radiance fields with view-dependent effects in less than a second. Our model builds upon the recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zhengqin Li , Dilin Wang , Ka Chen , Zhaoyang Lv , Thu Nguyen-Phuoc , Milim Lee , Jia-Bin Huang , Lei Xiao , Cheng Zhang , Yufeng Zhu , Carl S. Marshall , Yufeng Ren , Richard Newcombe , Zhao Dong

We propose MeshLRM, a novel LRM-based approach that can reconstruct a high-quality mesh from merely four input images in less than one second. Different from previous large reconstruction models (LRMs) that focus on NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Xinyue Wei , Kai Zhang , Sai Bi , Hao Tan , Fujun Luan , Valentin Deschaintre , Kalyan Sunkavalli , Hao Su , Zexiang Xu

We propose Long-LRM, a feed-forward 3D Gaussian reconstruction model for instant, high-resolution, 360{\deg} wide-coverage, scene-level reconstruction. Specifically, it takes in 32 input images at a resolution of 960x540 and produces the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Chen Ziwen , Hao Tan , Kai Zhang , Sai Bi , Fujun Luan , Yicong Hong , Li Fuxin , Zexiang Xu

The default strategy for training single-view Large Reconstruction Models (LRMs) follows the fully supervised route using large-scale datasets of synthetic 3D assets or multi-view captures. Although these resources simplify the training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Hanwen Jiang , Qixing Huang , Georgios Pavlakos

As interest grows in world models that predict future states from current observations and actions, accurately modeling part-level dynamics has become increasingly relevant for various applications. Existing approaches, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Mingju Gao , Yike Pan , Huan-ang Gao , Zongzheng Zhang , Wenyi Li , Hao Dong , Hao Tang , Li Yi , Hao Zhao

We introduce GRM, a large-scale reconstructor capable of recovering a 3D asset from sparse-view images in around 0.1s. GRM is a feed-forward transformer-based model that efficiently incorporates multi-view information to translate the input…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yinghao Xu , Zifan Shi , Wang Yifan , Hansheng Chen , Ceyuan Yang , Sida Peng , Yujun Shen , Gordon Wetzstein

In this work, we introduce the Geometry-Aware Large Reconstruction Model (GeoLRM), an approach which can predict high-quality assets with 512k Gaussians and 21 input images in only 11 GB GPU memory. Previous works neglect the inherent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Chubin Zhang , Hongliang Song , Yi Wei , Yu Chen , Jiwen Lu , Yansong Tang

We propose a Pose-Free Large Reconstruction Model (PF-LRM) for reconstructing a 3D object from a few unposed images even with little visual overlap, while simultaneously estimating the relative camera poses in ~1.3 seconds on a single A100…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Peng Wang , Hao Tan , Sai Bi , Yinghao Xu , Fujun Luan , Kalyan Sunkavalli , Wenping Wang , Zexiang Xu , Kai Zhang

Despite recent advancements in the Large Reconstruction Model (LRM) demonstrating impressive results, when extending its input from single image to multiple images, it exhibits inefficiencies, subpar geometric and texture quality, as well…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Mengfei Li , Xiaoxiao Long , Yixun Liang , Weiyu Li , Yuan Liu , Peng Li , Wenhan Luo , Wenping Wang , Yike Guo

We propose tttLRM, a novel large 3D reconstruction model that leverages a Test-Time Training (TTT) layer to enable long-context, autoregressive 3D reconstruction with linear computational complexity, further scaling the model's capability.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Chen Wang , Hao Tan , Wang Yifan , Zhiqin Chen , Yuheng Liu , Kalyan Sunkavalli , Sai Bi , Lingjie Liu , Yiwei Hu

We present Any4D, a scalable multi-view transformer for metric-scale, dense feed-forward 4D reconstruction. Any4D directly generates per-pixel motion and geometry predictions for N frames, in contrast to prior work that typically focuses on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jay Karhade , Nikhil Keetha , Yuchen Zhang , Tanisha Gupta , Akash Sharma , Sebastian Scherer , Deva Ramanan

Modeling 3D articulated objects with realistic geometry, textures, and kinematics is essential for a wide range of applications. However, existing optimization-based reconstruction methods often require dense multi-view inputs and expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Sylvia Yuan , Ruoxi Shi , Xinyue Wei , Xiaoshuai Zhang , Hao Su , Minghua Liu

We present 4RC, a unified feed-forward framework for 4D reconstruction from monocular videos. Unlike existing approaches that typically decouple motion from geometry or produce limited 4D attributes such as sparse trajectories or two-view…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yihang Luo , Shangchen Zhou , Yushi Lan , Xingang Pan , Chen Change Loy

Sparse-view 3D CT reconstruction aims to recover volumetric structures from a limited number of 2D X-ray projections. Existing feedforward methods are constrained by the scarcity of large-scale training datasets and the absence of direct…

Image and Video Processing · Electrical Eng. & Systems 2026-01-29 Guofeng Zhang , Ruyi Zha , Hao He , Yixun Liang , Alan Yuille , Hongdong Li , Yuanhao Cai

We introduce the Deformable Gaussian Splats Large Reconstruction Model (DGS-LRM), the first feed-forward method predicting deformable 3D Gaussian splats from a monocular posed video of any dynamic scene. Feed-forward scene reconstruction…

Feed-forward 3D modeling has emerged as a promising approach for rapid and high-quality 3D reconstruction. In particular, directly generating explicit 3D representations, such as 3D Gaussian splatting, has attracted significant attention…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Gyeongjin Kang , Seungtae Nam , Seungkwon Yang , Xiangyu Sun , Sameh Khamis , Abdelrahman Mohamed , Eunbyung Park

Vision-language models (VLMs) have demonstrated strong performance in 2D scene understanding and generation, but extending this unification to the physical world remains an open challenge. Existing 3D and 4D approaches typically embed scene…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Hanyu Zhou , Gim Hee Lee
‹ Prev 1 2 3 10 Next ›