English
Related papers

Related papers: Genie Sim PanoRecon: Fast Immersive Scene Generati…

200 papers

Photorealistic 3D scene generation is challenging due to the scarcity of large-scale, high-quality real-world 3D datasets and complex workflows requiring specialized expertise for manual modeling. These constraints often result in slow…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Clément Jambon , Changwoon Choi , Dongsu Zhang , Olga Sorkine-Hornung , Young Min Kim

We introduce GE-Sim 2.0 (Genie Envisioner World Simulator 2.0), a closed-loop video world simulator for robotic manipulation. Building on the action-conditioned video generation framework of Genie Envisioner, GE-Sim 2.0 is re-trained on…

We present a feed-forward framework for Gaussian full-head synthesis from a single unposed image. Unlike previous work that relies on time-consuming GAN inversion and test-time optimization, our framework can reconstruct the Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Peng Li , Yisheng He , Yingdong Hu , Yuan Dong , Weihao Yuan , Yuan Liu , Siyu Zhu , Gang Cheng , Zilong Dong , Yike Guo

Surgical simulation is essential for medical training, enabling practitioners to develop crucial skills in a risk-free environment while improving patient safety and surgical outcomes. However, conventional methods for building simulation…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhenya Yang

Synthesizing consistent and photorealistic 3D scenes is an open problem in computer vision. Video diffusion models generate impressive videos but cannot directly synthesize 3D representations, i.e., lack 3D consistency in the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Katja Schwarz , Norman Mueller , Peter Kontschieder

Immersive scene generation, notably panorama creation, benefits significantly from the adaptation of large pre-trained text-to-image (T2I) models for multi-view image generation. Due to the high cost of acquiring multi-view images,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Aoming Liu , Zhong Li , Zhang Chen , Nannan Li , Yi Xu , Bryan A. Plummer

We introduce Genie Envisioner (GE), a unified world foundation platform for robotic manipulation that integrates policy learning, evaluation, and simulation within a single video-generative framework. At its core, GE-Base is a large-scale,…

Real-time, high-fidelity reconstruction of dynamic driving scenes is challenged by complex dynamics and sparse views, with prior methods struggling to balance quality and efficiency. We propose DrivingScene, an online, feed-forward…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Qirui Hou , Wenzhang Sun , Chang Zeng , Chunfeng Wang , Hao Li , Jianxun Cui

We introduce OmniRe, a comprehensive system for efficiently creating high-fidelity digital twins of dynamic real-world scenes from on-device logs. Recent methods using neural fields or Gaussian Splatting primarily focus on vehicles,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ziyu Chen , Jiawei Yang , Jiahui Huang , Riccardo de Lutio , Janick Martinez Esturo , Boris Ivanovic , Or Litany , Zan Gojcic , Sanja Fidler , Marco Pavone , Li Song , Yue Wang

In this work, we introduce a generative approach for pose-free (without camera parameters) reconstruction of 360 scenes from a sparse set of 2D images. Pose-free scene reconstruction from incomplete, pose-free observations is usually…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Soumava Paul , Prakhar Kaushik , Alan Yuille

Novel view synthesis (NVS) of static and dynamic urban scenes is essential for autonomous driving simulation, yet existing methods often struggle to balance reconstruction time with quality. While state-of-the-art neural radiance fields and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Sheng Miao , Sijin Li , Pan Wang , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

Current compositional image-to-3D scene generation approaches construct 3D scenes by time-consuming iterative layout optimization or inflexible joint object-layout generation. Moreover, most methods rely on limited field-of-view perspective…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Zidian Qiu , Ancong Wu

Single-view indoor scene generation plays a crucial role in a range of real-world applications. However, generating a complete 360{\deg} scene from a single image remains a highly ill-posed and challenging problem. Recent approaches have…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Runmao Yao , Junsheng Zhou , Zhen Dong , Yu-Shen Liu

The growing demand for Embodied AI and VR applications has highlighted the need for synthesizing high-quality 3D indoor scenes from sparse inputs. However, existing approaches struggle to infer massive amounts of missing geometry in large…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Dehui Wang , Congsheng Xu , Rong Wei , Yue Shi , Shoufa Chen , Dingxiang Luo , Tianshuo Yang , Xiaokang Yang , Wei Sui , Yusen Qin , Rui Tang , Yao Mu

3D scene reconstruction and novel-view synthesis are fundamental for VR, robotics, and content creation. However, most NeRF and 3D Gaussian Splatting pipelines assume clean inputs and degrade under real noise and artifacts. We therefore…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Fuzhen Jiang , Zhuoran Li , Yinlin Zhang

We introduce AnySplat, a feed forward network for novel view synthesis from uncalibrated image collections. In contrast to traditional neural rendering pipelines that demand known camera poses and per scene optimization, or recent feed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Lihan Jiang , Yucheng Mao , Linning Xu , Tao Lu , Kerui Ren , Yichen Jin , Xudong Xu , Mulin Yu , Jiangmiao Pang , Feng Zhao , Dahua Lin , Bo Dai

Rendering novel view images in dynamic scenes is a crucial yet challenging task. Current methods mainly utilize NeRF-based methods to represent the static scene and an additional time-variant MLP to model scene deformations, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Diwen Wan , Ruijie Lu , Gang Zeng

We present a latent diffusion model over 3D scenes, that can be trained using only 2D image data. To achieve this, we first design an autoencoder that maps multi-view images to 3D Gaussian splats, and simultaneously builds a compressed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Paul Henderson , Melonie de Almeida , Daniela Ivanova , Titas Anciukevičius

360-degree visual content is widely shared on platforms such as YouTube and plays a central role in virtual reality, robotics, and autonomous navigation. However, consumer-grade dual-fisheye systems consistently yield imperfect panoramas…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Changha Shin , Woong Oh Cho , Seon Joo Kim

In this paper, we tackle the problem of synthesizing a ground-view panorama image conditioned on a top-view aerial image, which is a challenging problem due to the large gap between the two image domains with different view-points. Instead…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Songsong Wu , Hao Tang , Xiao-Yuan Jing , Haifeng Zhao , Jianjun Qian , Nicu Sebe , Yan Yan