English
Related papers

Related papers: Accelerating Training of Autoregressive Video Gene…

200 papers

Autoregressive diffusion enables real-time frame streaming, yet existing sliding-window caches discard past context, causing fidelity degradation, identity drift, and motion stagnation over long horizons. Current approaches preserve a fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Youngrae Kim , Qixin Hu , C. -C. Jay Kuo , Peter A. Beerel

Current auto-regressive models can generate high-quality, topologically precise meshes; however, they necessitate thousands-or even tens of thousands-of next-token predictions during inference, resulting in substantial latency. We introduce…

Graphics · Computer Science 2025-08-07 Dian Chen , Yansong Qu , Xinyang Li , Ming Li , Shengchuan Zhang

Autoregressive (AR) models for image generation typically adopt a two-stage paradigm of vector quantization and raster-scan ``next-token prediction", inspired by its great success in language modeling. However, due to the huge modality gap,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Hu Yu , Hao Luo , Hangjie Yuan , Yu Rong , Jie Huang , Feng Zhao

Self-supervised feature learning enables perception systems to benefit from the vast raw data recorded by vehicle fleets worldwide. While video-level self-supervised learning approaches have shown strong generalizability on classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Christopher Lang , Alexander Braun , Lars Schillingmann , Karsten Haug , Abhinav Valada

This paper presents Randomized AutoRegressive modeling (RAR) for visual generation, which sets a new state-of-the-art performance on the image generation task while maintaining full compatibility with language modeling frameworks. The…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Qihang Yu , Ju He , Xueqing Deng , Xiaohui Shen , Liang-Chieh Chen

Video world models should maintain evolving states when evidence is unobserved, yet current generators often freeze hidden states upon interruption. This is not simply a capacity problem: pretrained video diffusion transformers already…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Tianshuo Xu , Yichen Xie , Depu Meng , Chensheng Peng , Quentin Herau , Bo Jiang , Yihan Hu , Wei Zhan

Personalized image synthesis has emerged as a pivotal application in text-to-image generation, enabling the creation of images featuring specific subjects in diverse contexts. While diffusion models have dominated this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Kaiyue Sun , Xian Liu , Yao Teng , Xihui Liu

Recent advances in video super-resolution have shown that convolutional neural networks combined with motion compensation are able to merge information from multiple low-resolution (LR) frames to generate high-quality images. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mehdi S. M. Sajjadi , Raviteja Vemulapalli , Matthew Brown

Video generation models often operate under the assumption of fixed frame rates, which leads to suboptimal performance when it comes to handling flexible frame rates (e.g., increasing the frame rate of the more dynamic portion of the video…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Sunghyun Park , Kangyeol Kim , Junsoo Lee , Jaegul Choo , Joonseok Lee , Sookyung Kim , Edward Choi

Current state-of-the-art approaches for image captioning typically adopt an autoregressive manner, i.e., generating descriptions word by word, which suffers from slow decoding issue and becomes a bottleneck in real-time applications.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Xu Yan , Zhengcong Fei , Zekang Li , Shuhui Wang , Qingming Huang , Qi Tian

In autoregressive (AR) image generation, visual tokenizers compress images into compact discrete latent tokens, enabling efficient training of downstream autoregressive models for visual generation via next-token prediction. While scaling…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Tianwei Xiong , Jun Hao Liew , Zilong Huang , Jiashi Feng , Xihui Liu

Video generation techniques have achieved remarkable advancements in visual quality, yet faithfully reproducing real-world physics remains elusive. Preference-based model post-training may improve physical consistency, but requires costly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenxu Qian , Chaoyue Wang , Hou Peng , Zhiyu Tan , Hao Li , Anxiang Zeng

This paper focuses on self-supervised video representation learning. Most existing approaches follow the contrastive learning pipeline to construct positive and negative pairs by sampling different clips. However, this formulation tends to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Rui Qian , Weiyao Lin , John See , Dian Li

We present Flowception, a novel non-autoregressive and variable-length video generation framework. Flowception learns a probability path that interleaves discrete frame insertions with continuous frame denoising. Compared to autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Tariq Berrada Ifriqi , John Nguyen , Karteek Alahari , Jakob Verbeek , Ricky T. Q. Chen

This paper presents a novel approach for unsupervised video summarization using reinforcement learning (RL), addressing limitations like unstable adversarial training and reliance on heuristic-based reward functions. The method operates on…

Multimedia · Computer Science 2025-12-24 Mehryar Abbasi , Hadi Hadizadeh , Parvaneh Saeedi

Large-scale autoregressive models pretrained on next-token prediction and finetuned with reinforcement learning (RL) have achieved unprecedented success on many problem domains. During RL, these models explore by generating new outputs, one…

Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ruihan Yang , Prakhar Srivastava , Stephan Mandt

Visual content generation has advanced from single-image to multi-image workflows, yet existing agents remain largely plan-driven and lack systematic reflection mechanisms to correct mid-trajectory visual errors. To address this limitation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Jinxiang Lai , Wenzhe Zhao , Zexin Lu , Hualei Zhang , Qinyu Yang , Rongwei Quan , Zhimin Li , Shuai Shao , Song Guo , Qinglin Lu

Recent self-supervised video representation learning methods focus on maximizing the similarity between multiple augmented views from the same video and largely rely on the quality of generated views. However, most existing methods lack a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jinhyung Kim , Taeoh Kim , Minho Shim , Dongyoon Han , Dongyoon Wee , Junmo Kim

Recent studies have demonstrated the efficacy of integrating Group Relative Policy Optimization (GRPO) into flow matching models, particularly for text-to-image and text-to-video generation. However, we find that directly applying these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jin Wang , Jianxiang Lu , Guangzheng Xu , Comi Chen , Haoyu Yang , Linqing Wang , Peng Chen , Mingtao Chen , Zhichao Hu , Longhuang Wu , Shuai Shao , Qinglin Lu , Ping Luo