中文
相关论文

相关论文: HiAR: Efficient Autoregressive Long Video Generati…

200 篇论文

Autoregressive (AR) visual generation has emerged as a powerful paradigm for image and multimodal synthesis, owing to its scalability and generality. However, existing AR image generation suffers from severe memory bottlenecks due to the…

计算机视觉与模式识别 · 计算机科学 2025-12-05 Ziran Qin , Youru Lv , Mingbao Lin , Zeren Zhang , Chanfan Gan , Tieyuan Chen , Weiyao Lin

Causality -- referring to temporal, uni-directional cause-effect relationships between components -- underlies many complex generative processes, including videos, language, and robot trajectories. Current causal diffusion models entangle…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Xingjian Bai , Guande He , Zhengqi Li , Eli Shechtman , Xun Huang , Zongze Wu

Autoregressive (AR) image generators are becoming increasingly popular due to their ability to produce high-quality images and their scalability. Typical AR models are locked onto a specific generation order, often a raster-scan from…

Long-context video modeling is essential for enabling generative models to function as world simulators, as they must maintain temporal coherence over extended time spans. However, most existing models are trained on short clips, limiting…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Yuchao Gu , Weijia Mao , Mike Zheng Shou

High dynamic range (HDR) video reconstruction from sequences captured with alternating exposures is a very challenging problem. Existing methods often align low dynamic range (LDR) input sequence in the image space using optical flow, and…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Guanying Chen , Chaofeng Chen , Shi Guo , Zhetong Liang , Kwan-Yee K. Wong , Lei Zhang

This paper presents Randomized AutoRegressive modeling (RAR) for visual generation, which sets a new state-of-the-art performance on the image generation task while maintaining full compatibility with language modeling frameworks. The…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Qihang Yu , Ju He , Xueqing Deng , Xiaohui Shen , Liang-Chieh Chen

Diffusion language models hold the promise of fast parallel generation, while autoregressive (AR) models typically excel in quality due to their causal structure aligning naturally with language modeling. This raises a fundamental question:…

计算与语言 · 计算机科学 2025-11-13 Jingyu Liu , Xin Dong , Zhifan Ye , Rishabh Mehta , Yonggan Fu , Vartika Singh , Jan Kautz , Ce Zhang , Pavlo Molchanov

The advancements in automatic text-to-3D generation have been remarkable. Most existing methods use pre-trained text-to-image diffusion models to optimize 3D representations like Neural Radiance Fields (NeRFs) via latent-space denoising…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Junzhe Zhu , Peiye Zhuang , Sanmi Koyejo

Coarse-guided visual generation, which synthesizes fine visual samples from degraded or low-fidelity coarse references, is essential for various real-world applications. While training-based approaches are effective, they are inherently…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yanghao Wang , Ziqi Jiang , Zhen Wang , Long Chen

We introduce Self Forcing, a novel training paradigm for autoregressive video diffusion models. It addresses the longstanding issue of exposure bias, where models trained on ground-truth context must generate sequences conditioned on their…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Xun Huang , Zhengqi Li , Guande He , Mingyuan Zhou , Eli Shechtman

While diffusion models have achieved great success in generating continuous signals such as images and audio, it remains elusive for diffusion models in learning discrete sequence data like natural languages. Although recent advances…

计算与语言 · 计算机科学 2024-05-02 Jiasheng Ye , Zaixiang Zheng , Yu Bao , Lihua Qian , Mingxuan Wang

We introduce a new class of generative diffusion models that, unlike conventional denoising diffusion models, achieve a time-homogeneous structure for both the noising and denoising processes, allowing the number of steps to adaptively…

机器学习 · 统计学 2026-01-23 Sören Christensen , Jan Kallsen , Claudia Strauch , Lukas Trottner

Real-time streaming joint audio-video generation for character animation requires a generator to speak the requested transcript, maintain visual identity across chunks, and run within a strict playback budget. These requirements are…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Linrui Tian , Qi Wang , Bang Zhang

We present DiffIR2VR-Zero, a zero-shot framework that enables any pre-trained image restoration diffusion model to perform high-quality video restoration without additional training. While image diffusion models have shown remarkable…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Chang-Han Yeh , Hau-Shiang Shiu , Chin-Yang Lin , Zhixiang Wang , Chi-Wei Hsiao , Ting-Hsuan Chen , Yu-Lun Liu

Autoregressive (AR) video diffusion models enable long-form video generation but remain expensive due to repeated multi-step denoising. Existing training-free acceleration methods rely on binary cache-or-recompute decisions, overlooking…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Hanshuai Cui , Zhiqing Tang , Zhi Yao , Fanshuai Meng , Weijia Jia , Wei Zhao

Autoregressive (AR) models remain the standard for natural language generation but still suffer from high latency due to strictly sequential decoding. Recent diffusion-inspired approaches, such as LlaDA and Dream, mitigate this by…

计算与语言 · 计算机科学 2025-10-16 Qinglin Zhu , Yizhen Yao , Runcong Zhao , Yanzheng Xiang , Amrutha Saseendran , Chen Jin , Philip Teare , Bin Liang , Yulan He , Lin Gui

While diffusion models dominate the field of visual generation, they are computationally inefficient, applying a uniform computational effort regardless of different complexity. In contrast, autoregressive (AR) models are inherently…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Jian Han , Jinlai Liu , Jiahuan Wang , Bingyue Peng , Zehuan Yuan

We introduce Hybrid Autoregressive Transformer (HART), an autoregressive (AR) visual generation model capable of directly generating 1024x1024 images, rivaling diffusion models in image generation quality. Existing AR models face…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Haotian Tang , Yecheng Wu , Shang Yang , Enze Xie , Junsong Chen , Junyu Chen , Zhuoyang Zhang , Han Cai , Yao Lu , Song Han

High dynamic range (HDR) videos provide a more visually realistic experience than the standard low dynamic range (LDR) videos. Despite having significant progress in HDR imaging, it is still a challenging task to capture high-quality HDR…

图像与视频处理 · 电气工程与系统科学 2021-11-04 Mrinal Anand , Nidhin Harilal , Chandan Kumar , Shanmuganathan Raman

While diffusion models excel at generating high-quality images from text prompts, they struggle with visual consistency when generating image sequences. Existing methods generate each image independently, leading to disjointed narratives -…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Guilherme Fernandes , Vasco Ramos , Regev Cohen , Idan Szpektor , João Magalhães