English
Related papers

Related papers: Text-to-3D Gaussian Splatting with Physics-Grounde…

200 papers

The advent of 3D Gaussian Splatting (3DGS) has recently brought about a revolution in the field of neural rendering, facilitating high-quality renderings at real-time speed. However, 3DGS heavily depends on the initialized point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Kai Cheng , Xiaoxiao Long , Kaizhi Yang , Yao Yao , Wei Yin , Yuexin Ma , Wenping Wang , Xuejin Chen

In this work, we introduce Prometheus, a 3D-aware latent diffusion model for text-to-3D generation at both object and scene levels in seconds. We formulate 3D scene generation as multi-view, feed-forward, pixel-aligned 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yuanbo Yang , Jiahao Shao , Xinyang Li , Yujun Shen , Andreas Geiger , Yiyi Liao

3D Gaussian Splatting has demonstrated superior performance in rendering efficiency and quality, yet the generation of 3D Gaussians still remains a challenge without proper geometric priors. Existing methods have explored predicting point…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Weiqi Zhang , Junsheng Zhou , Haotian Geng , Kanle Shi , Shenkun Xu , Yi Fang , Yu-Shen Liu

We introduce RealmDreamer, a technique for generating forward-facing 3D scenes from text descriptions. Our method optimizes a 3D Gaussian Splatting representation to match complex text prompts using pretrained diffusion models. Our key…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jaidev Shriram , Alex Trevithick , Lingjie Liu , Ravi Ramamoorthi

Modern Gaussian Splatting methods have proven highly effective for real-time photorealistic rendering of 3D scenes. However, integrating semantic information into this representation remains a significant challenge, especially in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Roman Titkov , Egor Zubkov , Dmitry Yudin , Jaafar Mahmoud , Malik Mohrat , Gennady Sidorov

Large-scale 3D reconstruction is critical in the field of robotics, and the potential of 3D Gaussian Splatting (3DGS) for achieving accurate object-level reconstruction has been demonstrated. However, ensuring geometric accuracy in outdoor…

Robotics · Computer Science 2024-09-20 Changjian Jiang , Ruilan Gao , Kele Shao , Yue Wang , Rong Xiong , Yu Zhang

Rapid advancements in text-to-3D generation require robust and scalable evaluation metrics that align closely with human judgment, a need unmet by current metrics such as PSNR and CLIP, which require ground-truth data or focus only on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Shalini Maiti , Lourdes Agapito , Filippos Kokkinos

Despite advances in physics-based 3D motion synthesis, current methods face key limitations: reliance on pre-reconstructed 3D Gaussian Splatting (3DGS) built from dense multi-view images with time-consuming per-scene optimization; physics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Chunji Lv , Zequn Chen , Donglin Di , Weinan Zhang , Hao Li , Wei Chen , Yinjie Lei , Changsheng Li

Text-driven 3D indoor scene generation holds broad applications, ranging from gaming and smart homes to AR/VR applications. Fast and high-fidelity scene generation is paramount for ensuring user-friendly experiences. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yikun Ma , Dandan Zhan , Zhi Jin

While 3D Gaussian Splatting (3DGS) enables real-time rendering, its training demands workstation-level compute and memory, making mobile deployment impractical under minute-scale time budgets and limited peak memory. We present PocketGS, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Wenzhi Guo , Guangchi Fang , Shu Yang , Bing Wang

3D stylization is central to game development, virtual reality, and digital arts, where the demand for diverse assets calls for scalable methods that support fast, high-fidelity manipulation. Existing text-to-3D stylization methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Melis Ocal , Xiaoyan Xing , Yue Li , Ngo Anh Vien , Sezer Karaoglu , Theo Gevers

High-fidelity 3D garment synthesis from text is desirable yet challenging for digital avatar creation. Recent diffusion-based approaches via Score Distillation Sampling (SDS) have enabled new possibilities but either intricately couple with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yufei Liu , Junshu Tang , Chu Zheng , Shijie Zhang , Jinkun Hao , Junwei Zhu , Dongjin Huang

Open-vocabulary 3D scene understanding presents a significant challenge in computer vision, with wide-ranging applications in embodied agents and augmented reality systems. Existing methods adopt neurel rendering methods as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jun Guo , Xiaojian Ma , Yue Fan , Huaping Liu , Qing Li

We propose a method to fuse frozen text-only large language models (LLMs) with pre-trained image encoder and decoder models, by mapping between their embedding spaces. Our model demonstrates a wide suite of multimodal capabilities: image…

Computation and Language · Computer Science 2023-10-16 Jing Yu Koh , Daniel Fried , Ruslan Salakhutdinov

Generating synthetic images is a useful method for cheaply obtaining labeled data for training computer vision models. However, obtaining accurate 3D models of relevant objects is necessary, and the resulting images often have a gap in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Bram Vanherle , Brent Zoomers , Jeroen Put , Frank Van Reeth , Nick Michiels

4D generation has made remarkable progress in synthesizing dynamic 3D objects from input text, images, or videos. However, existing methods often represent motion as an implicit deformation field, which limits direct control and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Lifan Wu , Ruijie Zhu , Yubo Ai , Tianzhu Zhang

The modeling and manipulation of 3D scenes captured from the real world are pivotal in various applications, attracting growing research interest. While previous works on editing have achieved interesting results through manipulating 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Guan Luo , Tian-Xing Xu , Ying-Tian Liu , Xiao-Xiong Fan , Fang-Lue Zhang , Song-Hai Zhang

Scene understanding based on 3D Gaussian Splatting (3DGS) has recently achieved notable advances. Although 3DGS related methods have efficient rendering capabilities, they fail to address the inherent contradiction between the anisotropic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Q. G. Duan , Benyun Zhao , Mingqiao Han Yijun Huang , Ben M. Chen

Due to the fascinating generative performance of text-to-image diffusion models, growing text-to-3D generation works explore distilling the 2D generative priors into 3D, using the score distillation sampling (SDS) loss, to bypass the data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yu-Jie Yuan , Leif Kobbelt , Jiwen Liu , Yuan Zhang , Pengfei Wan , Yu-Kun Lai , Lin Gao

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy