中文
相关论文

相关论文: Prometheus: 3D-Aware Latent Diffusion Models for F…

200 篇论文

Feed-forward 3D reconstruction offers substantial runtime advantages over per-scene optimization, which remains slow at inference and often fragile under sparse views. However, existing feed-forward methods still have potential for further…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Tianyu Chen , Wei Xiang , Kang Han , Yu Lu , Di Wu , Gaowen Liu , Ramana Rao Kompella

In this paper, we propose Extend3D, a training-free pipeline for 3D scene generation from a single image, built upon an object-centric 3D generative model. To overcome the limitations of fixed-size latent spaces in object-centric models for…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Seungwoo Yoon , Jinmo Kim , Jaesik Park

Generative latent-variable models are emerging as promising tools in robotics and reinforcement learning. Yet, even though tasks in these domains typically involve distinct objects, most state-of-the-art generative models do not explicitly…

机器学习 · 计算机科学 2020-11-24 Martin Engelcke , Adam R. Kosiorek , Oiwi Parker Jones , Ingmar Posner

We propose VideoRFSplat, a direct text-to-3D model leveraging a video generation model to generate realistic 3D Gaussian Splatting (3DGS) for unbounded real-world scenes. To generate diverse camera poses and unbounded spatial extent of…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Hyojun Go , Byeongjun Park , Hyelin Nam , Byung-Hoon Kim , Hyungjin Chung , Changick Kim

We present LangFlash, a feed-forward framework for 3D Language Gaussian Splatting that reconstructs 3D scenes parameterized by Gaussian primitives enriched with language-aligned semantic features from sparse unposed multi-view images.…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Yilong Liu , Wanhua Li , Chen Zhu-Tian , Hanspeter Pfister

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging. Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Yingqing He , Tianyu Yang , Yong Zhang , Ying Shan , Qifeng Chen

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu

Recent advances in driving-scene generation and reconstruction have demonstrated significant potential for enhancing autonomous driving systems by producing scalable and controllable training data. Existing generation methods primarily…

计算机视觉与模式识别 · 计算机科学 2025-10-17 Ziyue Zhu , Zhanqian Wu , Zhenxin Zhu , Lijun Zhou , Haiyang Sun , Bing Wan , Kun Ma , Guang Chen , Hangjun Ye , Jin Xie , jian Yang

Text-driven image generation using diffusion models has recently gained significant attention. To enable more flexible image manipulation and editing, recent research has expanded from single image generation to transparent layer generation…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Junjia Huang , Pengxiang Yan , Jinhang Cai , Jiyang Liu , Zhao Wang , Yitong Wang , Xinglong Wu , Guanbin Li

Most text-to-3D generators build upon off-the-shelf text-to-image models trained on billions of images. They use variants of Score Distillation Sampling (SDS), which is slow, somewhat unstable, and prone to artifacts. A mitigation is to…

计算机视觉与模式识别 · 计算机科学 2024-02-14 Luke Melas-Kyriazi , Iro Laina , Christian Rupprecht , Natalia Neverova , Andrea Vedaldi , Oran Gafni , Filippos Kokkinos

Existing dynamic scene generation methods mostly rely on distilling knowledge from pre-trained 3D generative models, which are typically fine-tuned on synthetic object datasets. As a result, the generated scenes are often object-centric and…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Heng Yu , Chaoyang Wang , Peiye Zhuang , Willi Menapace , Aliaksandr Siarohin , Junli Cao , Laszlo A Jeni , Sergey Tulyakov , Hsin-Ying Lee

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

In recent years, 3D Gaussian splatting has emerged as a powerful technique for 3D reconstruction and generation, known for its fast and high-quality rendering capabilities. To address these shortcomings, this paper introduces a novel…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Xianglong He , Junyi Chen , Sida Peng , Di Huang , Yangguang Li , Xiaoshui Huang , Chun Yuan , Wanli Ouyang , Tong He

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

We present SceneFactor, a diffusion-based approach for large-scale 3D scene generation that enables controllable generation and effortless editing. SceneFactor enables text-guided 3D scene synthesis through our factored diffusion…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Alexey Bokhovkin , Quan Meng , Shubham Tulsiani , Angela Dai

While generative models have seen significant adoption across a wide range of data modalities, including 3D data, a consensus on which model is best suited for which task has yet to be reached. Further, conditional information such as text…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Matthias Humt , Ulrich Hillenbrand , Rudolph Triebel

Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these, there are diffusion-based models that have demonstrated…

We aim to address sparse-view reconstruction of a 3D scene by leveraging priors from large-scale vision models. While recent advancements such as 3D Gaussian Splatting (3DGS) have demonstrated remarkable successes in 3D reconstruction,…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Hanyang Yu , Xiaoxiao Long , Ping Tan

While text-to-3D and image-to-3D generation tasks have received considerable attention, one important but under-explored field between them is controllable text-to-3D generation, which we mainly focus on in this work. To address this task,…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Zhiqi Li , Yiming Chen , Lingzhe Zhao , Peidong Liu

With the widespread usage of VR devices and contents, demands for 3D scene generation techniques become more popular. Existing 3D scene generation models, however, limit the target scene to specific domain, primarily due to their training…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Jaeyoung Chung , Suyoung Lee , Hyeongjin Nam , Jaerin Lee , Kyoung Mu Lee