English
Related papers

Related papers: Screen, Cache, and Match: A Training-Free Causalit…

200 papers

Long-form video generation presents a dual challenge: models must capture long-range dependencies while preventing the error accumulation inherent in autoregressive decoding. To address these challenges, we make two contributions. First,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Xiaofei Wu , Guozhen Zhang , Zhiyong Xu , Yuan Zhou , Qinglin Lu , Xuming He

We present Captain Cinema, a generation framework for short movie generation. Given a detailed textual description of a movie storyline, our approach firstly generates a sequence of keyframes that outline the entire narrative, which ensures…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Junfei Xiao , Ceyuan Yang , Lvmin Zhang , Shengqu Cai , Yang Zhao , Yuwei Guo , Gordon Wetzstein , Maneesh Agrawala , Alan Yuille , Lu Jiang

Video colorization task has recently attracted wide attention. Recent methods mainly work on the temporal consistency in adjacent frames or frames with small interval. However, it still faces severe challenge of the inconsistency between…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Yu Zhang , Siqi Chen , Mingdao Wang , Xianlin Zhang , Chuang Zhu , Yue Zhang , Xueming Li

Learning long-horizon embodied behaviors from synthetic data remains challenging because generated scenes are often physically implausible, language-driven programs frequently "succeed" without satisfying task semantics, and high-level…

Robotics · Computer Science 2026-01-22 Yaru Liu , Ao-bo Wang , Nanyang Ye

Diffusion and rectified flow (RF) models generate high-fidelity images and videos, but their iterative velocity-field evaluations are computationally expensive. Existing caching methods accelerate sampling by skipping timesteps, yet their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiao Liu , Kai Liu , Naiyang Guan , Hongliang Lu , Zhixin Wang , Zhikai Chen , Renjing Pei , Yulun Zhang

Existing cache-based acceleration methods for video diffusion models primarily skip early or mid denoising steps, which often leads to structural discrepancies relative to full-timestep generation and can hinder instruction following and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Zhentao Fan , Zongzuo Wang , Weiwei Zhang

Vision-Language Models have excelled at textual reasoning, but they often struggle with fine-grained spatial understanding and continuous action planning, failing to simulate the dynamics required for complex visual reasoning. In this work,…

Emerging world models autoregressively generate video frames in response to actions, such as camera movements and text prompts, among other control signals. Due to limited temporal context window sizes, these models often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Tong Wu , Shuai Yang , Ryan Po , Yinghao Xu , Ziwei Liu , Dahua Lin , Gordon Wetzstein

Maintaining consistent characters, props, and environments across multiple shots is a central challenge in narrative video generation. Existing models can produce high-quality short clips but often fail to preserve entity identity and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jinsong Zhou , Yihua Du , Xinli Xu , Luozhou Wang , Zijie Zhuang , Yehang Zhang , Shuaibo Li , Xiaojun Hu , Bolan Su , Ying-cong Chen

Real robots are expected to repeat the same behavior in new environments with very little new data, yet modern controllers either incur heavy per-step inference or require deployment-time fine-tuning. We propose RT-Cache, a training-free…

Robotics · Computer Science 2025-08-26 Owen Kwon , Abraham George , Alison Bartsch , Amir Barati Farimani

Autoregressive diffusion enables real-time frame streaming, yet existing sliding-window caches discard past context, causing fidelity degradation, identity drift, and motion stagnation over long horizons. Current approaches preserve a fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Youngrae Kim , Qixin Hu , C. -C. Jay Kuo , Peter A. Beerel

The core challenge for streaming video generation is maintaining the content consistency in long context, which poses high requirement for the memory design. Most existing solutions maintain the memory by compressing historical frames with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Sihui Ji , Xi Chen , Shuai Yang , Xin Tao , Pengfei Wan , Hengshuang Zhao

Data replay is a successful incremental learning technique for images. It prevents catastrophic forgetting by keeping a reservoir of previous data, original or synthesized, to ensure the model retains past knowledge while adapting to novel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Guodong Ding , Hans Golong , Angela Yao

In this paper, we address the challenge of generating temporally consistent videos with motion guidance. While many existing methods depend on additional control modules or inference-time fine-tuning, recent studies suggest that effective…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Xinyu Zhang , Zicheng Duan , Dong Gong , Lingqiao Liu

We present Match-and-Fuse - a zero-shot, training-free method for consistent controlled generation of unstructured image sets - collections that share a common visual element, yet differ in viewpoint, time of capture, and surrounding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Kate Feingold , Omri Kaduri , Tali Dekel

Spatially consistent long-horizon video generation aims to maintain temporal and spatial consistency along predefined camera trajectories. Existing methods mostly entangle memory modeling with video generation, leading to inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yanjun Guo , Zhengqiang Zhang , Pengfei Wang , Xinyue Liang , Zhiyuan Ma , Lei Zhang

Understanding video content is pivotal for advancing real-world applications like activity recognition, autonomous systems, and human-computer interaction. While scene graphs are adept at capturing spatial relationships between objects in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Raphael Ruschel , Md Awsafur Rahman , Hardik Prajapati , Suya You , B. S. Manjuanth

Stochastic video prediction models take in a sequence of image frames, and generate a sequence of consecutive future image frames. These models typically generate future frames in an autoregressive fashion, which is slow and requires the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Ananya Kumar , S. M. Ali Eslami , Danilo J. Rezende , Marta Garnelo , Fabio Viola , Edward Lockhart , Murray Shanahan

Vision-Language-Action (VLA) models enable generalist robotic manipulation but suffer from high inference latency. This bottleneck stems from the massive number of visual tokens processed by large language backbones. Existing methods either…

Robotics · Computer Science 2026-03-12 Yuquan Li , Lianjie Ma , Han Ding , Lijun Zhu

Most existing real-time deep models trained with each frame independently may produce inconsistent results across the temporal axis when tested on a video sequence. A few methods take the correlations in the video sequence into…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Yifan Liu , Chunhua Shen , Changqian Yu , Jingdong Wang