中文
相关论文

相关论文: A Survey: Spatiotemporal Consistency in Video Gene…

200 篇论文

Video generation has witnessed great success recently, but their application in generating long videos still remains challenging due to the difficulty in maintaining the temporal consistency of generated videos and the high memory cost…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Wei Feng , Xin Wang , Hong Chen , Zeyang Zhang , Wenwu Zhu

In recent years there have been remarkable breakthroughs in image-to-video generation. However, the 3D consistency and camera controllability of generated frames have remained unsolved. Recent studies have attempted to incorporate camera…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Dejia Xu , Yifan Jiang , Chen Huang , Liangchen Song , Thorsten Gernoth , Liangliang Cao , Zhangyang Wang , Hao Tang

State-of-the-art video generative models typically learn the distribution of video latents in the VAE space and map them to pixels using a VAE decoder. While this approach can generate high-quality videos, it suffers from slow convergence…

计算机视觉与模式识别 · 计算机科学 2025-12-29 Jianhong Bai , Xiaoshi Wu , Xintao Wang , Xiao Fu , Yuanxing Zhang , Qinghe Wang , Xiaoyu Shi , Menghan Xia , Zuozhu Liu , Haoji Hu , Pengfei Wan , Kun Gai

The synthesis of spatiotemporally coherent 4D content presents fundamental challenges in computer vision, requiring simultaneous modeling of high-fidelity spatial representations and physically plausible temporal dynamics. Current…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Xiaoyan Liu , Kangrui Li , Yuehao Song , Jiaxin Liu

With the rapid development of AI-generated content (AIGC), the creation of high-quality AI-generated videos has become faster and easier, resulting in the Internet being flooded with all kinds of video content. However, the impact of these…

信息检索 · 计算机科学 2025-07-30 Haowen Gao , Liang Pang , Shicheng Xu , Leigang Qu , Tat-Seng Chua , Huawei Shen , Xueqi Cheng

With the explosive popularity of AI-generated content (AIGC), video generation has recently received a lot of attention. Generating videos guided by text instructions poses significant challenges, such as modeling the complex relationship…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Wenjing Wang , Huan Yang , Zixi Tuo , Huiguo He , Junchen Zhu , Jianlong Fu , Jiaying Liu

Stochastic video prediction models take in a sequence of image frames, and generate a sequence of consecutive future image frames. These models typically generate future frames in an autoregressive fashion, which is slow and requires the…

计算机视觉与模式识别 · 计算机科学 2019-04-23 Ananya Kumar , S. M. Ali Eslami , Danilo J. Rezende , Marta Garnelo , Fabio Viola , Edward Lockhart , Murray Shanahan

As a prominent subfield of Artificial Intelligence Generated Content (AIGC), video generation has achieved notable advancements in recent years. The introduction of Sora-alike models represents a pivotal breakthrough in video generation…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Linyuan Li , Jianing Qiu , Anujit Saha , Lin Li , Poyuan Li , Mengxian He , Ziyu Guo , Wu Yuan

The generative model has made significant advancements in the creation of realistic videos, which causes security issues. However, this emerging risk has not been adequately addressed due to the absence of a benchmark dataset for…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Peisong He , Leyao Zhu , Jiaxing Li , Shiqi Wang , Haoliang Li

Videos express highly structured spatio-temporal patterns of visual data. A video can be thought of as being governed by two factors: (i) temporally invariant (e.g., person identity), or slowly varying (e.g., activity), attribute-induced…

计算机视觉与模式识别 · 计算机科学 2018-03-26 Jiawei He , Andreas Lehrmann , Joseph Marino , Greg Mori , Leonid Sigal

The escalating quality of video generated by advanced video generation methods results in new security challenges, while there have been few relevant research efforts: 1) There is no open-source dataset for generated video detection, 2) No…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Long Ma , Zhiyuan Yan , Qinglang Guo , Yong Liao , Haiyang Yu , Pengyuan Zhou

Scene-consistent video generation aims to create videos that explore 3D scenes based on a camera trajectory. Previous methods rely on video generation models with external memory for consistency, or iterative 3D reconstruction and…

计算机视觉与模式识别 · 计算机科学 2026-02-26 JiaKui Hu , Jialun Liu , Liying Yang , Xinliang Zhang , Kaiwen Li , Shuang Zeng , Yuanwei Li , Haibin Huang , Chi Zhang , Yanye Lu

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systematic review of…

图形学 · 计算机科学 2025-06-09 Miguel Silva , Alexandre Valle de Carvalho

Artificial intelligence generated content (AIGC), a rapidly advancing technology, is transforming content creation across domains, such as text, images, audio, and video. Its growing potential has attracted more and more researchers and…

人工智能 · 计算机科学 2026-03-03 Chengzhang Zhu , Luobin Cui , Ying Tang , Jiacun Wang

Video generation remains a challenging task due to spatiotemporal complexity and the requirement of synthesizing diverse motions with temporal consistency. Previous works attempt to generate videos in arbitrary lengths either in an…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Xiaoqian Shen , Xiang Li , Mohamed Elhoseiny

An image may convey a thousand words, but a video composed of hundreds or thousands of image frames tells a more intricate story. Despite significant progress in multimodal large language models (MLLMs), generating extended videos remains a…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Faraz Waseem , Muhammad Shahzad

Generating long, cohesive video stories with consistent characters is a significant challenge for current text-to-video AI. We introduce a method that approaches video generation in a filmmaker-like manner. Instead of creating a video in…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Chayan Jain , Rishant Sharma , Archit Garg , Ishan Bhanuka , Pratik Narang , Dhruv Kumar

Applying image processing algorithms independently to each frame of a video often leads to undesired inconsistent results over time. Developing temporally consistent video-based extensions, however, requires domain knowledge for individual…

计算机视觉与模式识别 · 计算机科学 2018-08-02 Wei-Sheng Lai , Jia-Bin Huang , Oliver Wang , Eli Shechtman , Ersin Yumer , Ming-Hsuan Yang

It's no secret that video has become the primary way we share information online. That's why there's been a surge in demand for algorithms that can analyze and understand video content. It's a trend going to continue as video continues to…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Amir Hosein Fadaei , Mohammad-Reza A. Dehaqani

Image-to-Video generation (I2V) animates a static image into a temporally coherent video sequence following textual instructions, yet preserving fine-grained object identity under changing viewpoints remains a persistent challenge. Unlike…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Mingyang Wu , Ashirbad Mishra , Soumik Dey , Shuo Xing , Naveen Ravipati , Hansi Wu , Binbin Li , Zhengzhong Tu