English
Related papers

Related papers: Long-Context Autoregressive Video Modeling with Ne…

200 papers

Learning to predict the long-term future of video frames is notoriously challenging due to inherent ambiguities in the distant future and dramatic amplifications of prediction error through time. Despite the recent advances in the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Wonkwang Lee , Whie Jung , Han Zhang , Ting Chen , Jing Yu Koh , Thomas Huang , Hyungsuk Yoon , Honglak Lee , Seunghoon Hong

Interactive real-time autoregressive video generation is essential for applications such as content creation and world modeling, where visual content must adapt to dynamically evolving event conditions. A fundamental challenge lies in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yuheng Wu , Xiangbo Gao , Tianhao Chen , Xinghao Chen , Qing Yin , Zhengzhong Tu , Dongman Lee

Long-context video modeling is critical for multimodal large language models (MLLMs), enabling them to process movies, online video streams, and so on. Despite its advances, handling long videos remains challenging due to the difficulty in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xinhao Li , Yi Wang , Jiashuo Yu , Xiangyu Zeng , Yuhan Zhu , Haian Huang , Jianfei Gao , Kunchang Li , Yinan He , Chenting Wang , Yu Qiao , Yali Wang , Limin Wang

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

Autoregressive transformers have shown remarkable success in video generation. However, the transformers are prohibited from directly learning the long-term dependency in videos due to the quadratic complexity of self-attention, and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Jaehoon Yoo , Semin Kim , Doyup Lee , Chiheon Kim , Seunghoon Hong

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik

We introduce Sparse Forcing, a training-and-inference paradigm for autoregressive video diffusion models that improves long-horizon generation quality while reducing decoding latency. Sparse Forcing is motivated by an empirical observation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Boxun Xu , Yuming Du , Zichang Liu , Siyu Yang , Ziyang Jiang , Siqi Yan , Rajasi Saha , Albert Pumarola , Wenchen Wang , Peng Li

Recent advancements in auto-regressive large language models (LLMs) have led to their application in video generation. This paper explores the use of Large Vision Models (LVMs) for video continuation, a task essential for building world…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Ruibo Ming , Jingwei Wu , Zhewei Huang , Zhuoxuan Ju , Jianming HU , Lihui Peng , Shuchang Zhou

Scene parsing is a technique that consist on giving a label to all pixels in an image according to the class they belong to. To ensure a good visual coherence and a high class accuracy, it is essential for a scene parser to capture image…

Computer Vision and Pattern Recognition · Computer Science 2013-06-13 Pedro H. O. Pinheiro , Ronan Collobert

This paper proposes a method for performing continual learning of predictive models that facilitate the inference of future frames in video sequences. For a first given experience, an initial Variational Autoencoder, together with a set of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Damian Campo , Giulia Slavic , Mohamad Baydoun , Lucio Marcenaro , Carlo Regazzoni

Video generation has witnessed great success recently, but their application in generating long videos still remains challenging due to the difficulty in maintaining the temporal consistency of generated videos and the high memory cost…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Wei Feng , Xin Wang , Hong Chen , Zeyang Zhang , Wenwu Zhu

Visual autoregressive models typically adhere to a raster-order ``next-token prediction" paradigm, which overlooks the spatial and temporal locality inherent in visual content. Specifically, visual tokens exhibit significantly stronger…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yefei He , Yuanyu He , Shaoxuan He , Feng Chen , Hong Zhou , Kaipeng Zhang , Bohan Zhuang

Temporal prediction is inherently uncertain, but representing the ambiguity in natural image sequences is a challenging high-dimensional probabilistic inference problem. For natural scenes, the curse of dimensionality renders explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Pierre-Étienne H. Fiquet , Eero P. Simoncelli

Video generation is a critical pathway toward world models, with efficient long video inference as a key capability. Toward this end, we introduce LongCat-Video, a foundational video generation model with 13.6B parameters, delivering strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Meituan LongCat Team , Xunliang Cai , Qilong Huang , Zhuoliang Kang , Hongyu Li , Shijun Liang , Liya Ma , Siyu Ren , Xiaoming Wei , Rixu Xie , Tong Zhang

Video diffusion models perform well in short-video synthesis, but their training-free extension to long videos often suffers from content drift, temporal inconsistency, and over-smoothed dynamics. Existing methods improve temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Fangda Chen , Shanshan Zhao , Longrong Yang , Chuanfu Xu , Zhigang Luo , Long Lan

The existing state-of-the-art method for audio-visual conditioned video prediction uses the latent codes of the audio-visual frames from a multimodal stochastic network and a frame encoder to predict the next visual frame. However, a direct…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Yating Xu , Conghui Hu , Gim Hee Lee

World foundation models aim to simulate the evolution of the real world with physically plausible behavior. Unlike prior methods that handle spatial and temporal correlations separately, we propose RAYNOVA, a geometry-agonistic multiview…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yichen Xie , Chensheng Peng , Mazen Abdelfattah , Yihan Hu , Jiezhi Yang , Eric Higgins , Ryan Brigden , Masayoshi Tomizuka , Wei Zhan

For semantic segmentation, most existing real-time deep models trained with each frame independently may produce inconsistent results for a video sequence. Advanced methods take into considerations the correlations in the video sequence,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Yifan Liu , Chunhua Shen , Changqian Yu , Jingdong Wang

Extending the generation horizon of video diffusion models to long sequences remains a long-standing and important challenge. Existing training-free approaches fall into two categories: extensions of bidirectional models, which are tightly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jangho Park , Geon Yeong Park , Gihyun Kwon , Jong Chul Ye

Using generative models to synthesize new data has become a de-facto standard in autonomous driving to address the data scarcity issue. Though existing approaches are able to boost perception models, we discover that these approaches fail…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Enhui Ma , Lijun Zhou , Tao Tang , Zhan Zhang , Dong Han , Junpeng Jiang , Kun Zhan , Peng Jia , Xianpeng Lang , Haiyang Sun , Di Lin , Kaicheng Yu