English
Related papers

Related papers: DreamLifting: A Plug-in Module Lifting MV Diffusio…

200 papers

We introduce DD3G, a formulation that Distills a multi-view Diffusion model (MV-DM) into a 3D Generator using gaussian splatting. DD3G compresses and integrates extensive visual and spatial geometric knowledge from the MV-DM by simulating…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hao Qin , Luyuan Chen , Ming Kong , Mengxu Lu , Qiang Zhu

Generating high-quality 3D assets from a given image is highly desirable in various applications such as AR/VR. Recent advances in single-image 3D generation explore feed-forward models that learn to infer the 3D model of an object without…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yongwei Chen , Tengfei Wang , Tong Wu , Xingang Pan , Kui Jia , Ziwei Liu

Generating high-quality Scalable Vector Graphics (SVGs) from text remains a significant challenge. Existing LLM-based models that generate SVG code as a flat token sequence struggle with poor structural understanding and error accumulation,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Ximing Xing , Juncheng Hu , Ziteng Xue , Jing Zhang , Buyu Li , Sheng Wang , Dong Xu , Qian Yu

We present Drivable 3D Gaussian Avatars (D3GA), a multi-layered 3D controllable model for human bodies that utilizes 3D Gaussian primitives embedded into tetrahedral cages. The advantage of using cages compared to commonly employed linear…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Wojciech Zielonka , Timur Bagautdinov , Shunsuke Saito , Michael Zollhöfer , Justus Thies , Javier Romero

Driven by powerful image diffusion models, recent research has achieved the automatic creation of 3D objects from textual or visual guidance. By performing score distillation sampling (SDS) iteratively across different views, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zeyu Li , Ruitong Gan , Chuanchen Luo , Yuxi Wang , Jiaheng Liu , Ziwei Zhu Man Zhang , Qing Li , Xucheng Yin , Zhaoxiang Zhang , Junran Peng

Manual modeling of material parameters and 3D geometry is a time consuming yet essential task in the gaming and film industries. While recent advances in 3D reconstruction have enabled accurate approximations of scene geometry and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Philipp Langsteiner , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

Single-image 3D reconstruction remains a fundamental challenge in computer vision due to inherent geometric ambiguities and limited viewpoint information. Recent advances in Latent Video Diffusion Models (LVDMs) offer promising 3D priors…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yabo Chen , Chen Yang , Jiemin Fang , Xiaopeng Zhang , Lingxi Xie , Wei Shen , Wenrui Dai , Hongkai Xiong , Qi Tian

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

Compression techniques for 3D Gaussian Splatting (3DGS) have recently achieved considerable success in minimizing storage overhead for 3D Gaussians while preserving high rendering quality. Despite the impressive storage reduction, the lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Seungjoo Shin , Jaesik Park , Sunghyun Cho

The enormous parameter scale of large language models (LLMs) has made model compression a research hotspot, which aims to alleviate computational resource demands during deployment and inference. As a promising direction, low-rank…

Machine Learning · Computer Science 2025-07-08 Guangyan Li , Yongqiang Tang , Wensheng Zhang

We introduce Dream, Lift, Animate (DLA), a novel framework that reconstructs animatable 3D human avatars from a single image. This is achieved by leveraging multi-view generation, 3D Gaussian lifting, and pose-aware UV-space mapping of 3D…

Graphics · Computer Science 2025-11-18 Marcel C. Bühler , Ye Yuan , Xueting Li , Yangyi Huang , Koki Nagano , Umar Iqbal

Validating autonomous driving (AD) systems requires diverse and safety-critical testing, making photorealistic virtual environments essential. Traditional simulation platforms, while controllable, are resource-intensive to scale and often…

Diffusion models (DMs) have recently achieved impressive photorealism in image and video generation. However, their application to image animation remains limited, even when trained on large-scale datasets. Two primary challenges contribute…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Zhenhao Li , Shaohan Yi , Zheng Liu , Leonartinus Gao , Minh Ngoc Le , Ambrose Ling , Zhuoran Wang , Md Amirul Islam , Zhixiang Chi , Yuanhao Yu

Generating diverse and high-quality 3D assets automatically poses a fundamental yet challenging task in 3D computer vision. Despite extensive efforts in 3D generation, existing optimization-based approaches struggle to produce large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Ziang Cao , Fangzhou Hong , Tong Wu , Liang Pan , Ziwei Liu

Existing multi-view image generation methods often make invasive modifications to pre-trained text-to-image (T2I) models and require full fine-tuning, leading to (1) high computational costs, especially with large base models and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Zehuan Huang , Yuan-Chen Guo , Haoran Wang , Ran Yi , Lizhuang Ma , Yan-Pei Cao , Lu Sheng

Radiance field representations have recently been explored in the latent space of VAEs that are commonly used by diffusion models. This direction offers efficient rendering and seamless integration with diffusion-based pipelines. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Or Hirschorn , Omer Sela , Inbar Huberman-Spiegelglas , Netalee Efrat , Eli Alshan , Ianir Ideses , Frederic Devernay , Yochai Zvik , Lior Fritz

Multiview diffusion models have rapidly emerged as a powerful tool for content creation with spatial consistency across viewpoints, offering rich visual realism without requiring explicit geometry and appearance representation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Hubert Kompanowski , Varun Jampani , Aaryaman Vasishta , Binh-Son Hua

We present LTM3D, a Latent Token space Modeling framework for conditional 3D shape generation that integrates the strengths of diffusion and auto-regressive (AR) models. While diffusion-based methods effectively model continuous latent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Xin Kang , Zihan Zheng , Lei Chu , Yue Gao , Jiahao Li , Hao Pan , Xuejin Chen , Yan Lu

Video Diffusion Models (VDMs) have emerged as powerful generative tools, capable of synthesizing high-quality spatiotemporal content. Yet, their potential goes far beyond mere video generation. We argue that the training dynamics of VDMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Low-rank Adaptation (LoRA) models have revolutionized the personalization of pre-trained diffusion models by enabling fine-tuning through low-rank, factorized weight matrices specifically optimized for attention layers. These models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Mert Sonmezer , Matthew Zheng , Pinar Yanardag