English
Related papers

Related papers: FB-4D: Spatial-Temporal Coherent Dynamic 3D Conten…

200 papers

We present Stable Video 4D 2.0 (SV4D 2.0), a multi-view video diffusion model for dynamic 3D asset generation. Compared to its predecessor SV4D, SV4D 2.0 is more robust to occlusions and large motion, generalizes better to real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chun-Han Yao , Yiming Xie , Vikram Voleti , Huaizu Jiang , Varun Jampani

While recent foundational video generators produce visually rich output, they still struggle with appearance drift, where objects gradually degrade or change inconsistently across frames, breaking visual coherence. We hypothesize that this…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hyeonho Jeong , Chun-Hao Paul Huang , Jong Chul Ye , Niloy Mitra , Duygu Ceylan

The advancement of 4D (i.e., sequential 3D) generation opens up new possibilities for lifelike experiences in various applications, where users can explore dynamic objects or characters from any viewpoint. Meanwhile, video generative models…

Graphics · Computer Science 2025-04-08 Yikai Wang , Guangce Liu , Xinzhou Wang , Zilong Chen , Jiafang Li , Xin Liang , Fuchun Sun , Jun Zhu

Recent advances in diffusion models have revolutionized 2D and 3D content creation, yet generating photorealistic dynamic 4D scenes remains a significant challenge. Existing dynamic 4D generation methods typically rely on distilling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Vinayak Gupta , Yunze Man , Yu-Xiong Wang

In recent years, the increasing demand for dynamic 3D assets in design and gaming applications has given rise to powerful generative pipelines capable of synthesizing high-quality 4D objects. Previous methods generally rely on score…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qi Sun , Zhiyang Guo , Ziyu Wan , Jing Nathan Yan , Shengming Yin , Wengang Zhou , Jing Liao , Houqiang Li

Temporal volume images with 3D+t (4D) information are often used in medical imaging to statistically analyze temporal dynamics or capture disease progression. Although deep-learning-based generative models for natural images have been…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Boah Kim , Jong Chul Ye

Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications…

Machine Learning · Computer Science 2025-11-26 Sifan Wang , Zehao Dou , Siming Shan , Tong-Rui Liu , Lu Lu

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Current generative models struggle to synthesize dynamic 4D driving scenes that simultaneously support temporal extrapolation and spatial novel view synthesis (NVS) without per-scene optimization. Bridging generation and novel view…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Hao Lu , Zhuang Ma , Guangfeng Jiang , Wenhang Ge , Bohan Li , Yuzhan Cai , Wenzhao Zheng , Yunpeng Zhang , Yingcong Chen

Generating high-quality 3D content from text, single images, or sparse view images remains a challenging task with broad applications. Existing methods typically employ multi-view diffusion models to synthesize multi-view images, followed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Junlin Han , Jianyuan Wang , Andrea Vedaldi , Philip Torr , Filippos Kokkinos

Current generative models struggle to synthesize dynamic 4D driving scenes that simultaneously support temporal extrapolation and spatial novel view synthesis (NVS) without per-scene optimization. A key challenge lies in finding an…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhe Guo , Yikang Ding , Xiwu Chen , Shuo Chen , Bohan Li , Yingshuang Zou , Xiaoyang Lyu , Feiyang Tan , Xiaojuan Qi , Zhiheng Li , Hao Zhao

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu

Diffusion and flow matching models have unlocked unprecedented capabilities for creative content creation, such as interactive image and streaming video generation. The growing demand for higher resolutions, frame rates, and context…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Brian Chao , Lior Yariv , Howard Xiao , Gordon Wetzstein

Recent advances in generative modeling with diffusion processes (DPs) enabled breakthroughs in image synthesis. Despite impressive image quality, these models have various prompt compliance problems, including low recall in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Deepak Sridhar , Abhishek Peri , Rohith Rachala , Nuno Vasconcelos

In this paper, we present Diffusion-4K, a novel framework for direct ultra-high-resolution image synthesis using text-to-image diffusion models. The core advancements include: (1) Aesthetic-4K Benchmark: addressing the absence of a publicly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Jinjin Zhang , Qiuyu Huang , Junjie Liu , Xiefan Guo , Di Huang

We propose 4Real-Video, a novel framework for generating 4D videos, organized as a grid of video frames with both time and viewpoint axes. In this grid, each row contains frames sharing the same timestep, while each column contains frames…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Chaoyang Wang , Peiye Zhuang , Tuan Duc Ngo , Willi Menapace , Aliaksandr Siarohin , Michael Vasilkovsky , Ivan Skorokhodov , Sergey Tulyakov , Peter Wonka , Hsin-Ying Lee

With the rapid advancement of diffusion-based generative models, Stable Diffusion (SD) has emerged as a state-of-the-art framework for high-fidelity im-age synthesis. However, existing SD models suffer from suboptimal feature aggregation,…

Graphics · Computer Science 2025-07-21 Zhen-Qi Chen , Yuan-Fu Yang

The field of generative models has recently witnessed significant progress, with diffusion models showing remarkable performance in image generation. In light of this success, there is a growing interest in exploring the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ariel Lapid , Idan Achituve , Lior Bracha , Ethan Fetaya

Recent video diffusion models have achieved impressive capabilities as large-scale generative world models. However, these models often struggle with fine-grained physical consistency, exhibiting physically implausible dynamics over time.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haoran Lu , Shang Wu , Jianshu Zhang , Maojiang Su , Guo Ye , Chenwei Xu , Lie Lu , Pranav Maneriker , Fan Du , Manling Li , Zhaoran Wang , Han Liu