中文
相关论文

相关论文: HiAR: Efficient Autoregressive Long Video Generati…

200 篇论文

Discrete diffusion models have emerged as a promising direction for vision-language tasks, offering bidirectional context modeling and theoretical parallelization. However, their practical application is severely hindered by a…

计算与语言 · 计算机科学 2025-10-24 Yatai Ji , Teng Wang , Yuying Ge , Zhiheng Liu , Sidi Yang , Ying Shan , Ping Luo

Discrete Diffusion and Flow Matching models have significantly advanced generative modeling for discrete structures, including graphs. However, the dependencies between intermediate noisy states lead to error accumulation and propagation…

机器学习 · 计算机科学 2025-06-24 Yoann Boget

Autoregressive (AR) models are promising for image generation, yet continuous-token AR variants often trail latent diffusion and masked-generation models. The core issue is heterogeneous variance in VAE latents, which is amplified during AR…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Guolin Ke , Hui Xue

Diffusion models have recently been shown to be relevant for high-quality speech generation. Most work has been focused on generating spectrograms, and as such, they further require a subsequent model to convert the spectrogram to a…

声音 · 计算机科学 2024-03-12 Roi Benita , Michael Elad , Joseph Keshet

The first-in-first-out (FIFO) video diffusion, built on a pre-trained text-to-video model, has recently emerged as an effective approach for tuning-free long video generation. This technique maintains a queue of video frames with…

计算机视觉与模式识别 · 计算机科学 2025-01-16 Jingyuan Chen , Fuchen Long , Jie An , Zhaofan Qiu , Ting Yao , Jiebo Luo , Tao Mei

Autoregressive (AR) models have reformulated image generation as next-token prediction, demonstrating remarkable potential and emerging as strong competitors to diffusion models. However, control-to-image generation, akin to ControlNet,…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Zongming Li , Tianheng Cheng , Shoufa Chen , Peize Sun , Haocheng Shen , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

We seek to reconstruct sharp and noise-free high-dynamic range (HDR) video from a dual-exposure sensor that records different low-dynamic range (LDR) information in different pixel columns: Odd columns provide low-exposure, sharp, but noisy…

图像与视频处理 · 电气工程与系统科学 2021-04-14 Uğur Çoğalan , Mojtaba Bemana , Karol Myszkowski , Hans-Peter Seidel , Tobias Ritschel

Generative models have attracted significant interest due to their ability to handle uncertainty by learning the inherent data distributions. However, two prominent generative models, namely Generative Adversarial Networks (GANs) and…

机器学习 · 计算机科学 2023-04-25 Yu Wang , Zhiwei Liu , Liangwei Yang , Philip S. Yu

Surgical Video Synthesis has emerged as a promising research direction following the success of diffusion models in general-domain video generation. Although existing approaches achieve high-quality video generation, most are unconditional…

计算机视觉与模式识别 · 计算机科学 2025-06-27 Diego Biagini , Nassir Navab , Azade Farshad

Diffusion models have achieved remarkable progress across various visual generation tasks. However, their performance significantly declines when generating content at resolutions higher than those used during training. Although numerous…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Zhen Yang , Guibao Shen , Minyang Li , Liang Hou , Mushui Liu , Luozhou Wang , Xin Tao , Ying-Cong Chen

Autoregressive models have emerged as a powerful generative paradigm for visual generation. The current de-facto standard of next token prediction commonly operates over a single-scale sequence of dense image tokens, and is incapable of…

计算机视觉与模式识别 · 计算机科学 2025-05-27 Guangting Zheng , Yehao Li , Yingwei Pan , Jiajun Deng , Ting Yao , Yanyong Zhang , Tao Mei

Non-Autoregressive generation is a sequence generation paradigm, which removes the dependency between target tokens. It could efficiently reduce the text generation latency with parallel decoding in place of token-by-token sequential…

计算与语言 · 计算机科学 2022-05-24 Weizhen Qi , Yeyun Gong , Yelong Shen , Jian Jiao , Yu Yan , Houqiang Li , Ruofei Zhang , Weizhu Chen , Nan Duan

High Dynamic Range (HDR) generation remains challenging for generative models, which are largely limited to low dynamic range outputs. Recent diffusionbased approaches approximate HDR by generating multiple exposure-conditioned samples,…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Pedram Fekri , WenChen Li , William Chen , Peter Altamirano

Image Auto-regressive (AR) models have emerged as a powerful paradigm of visual generative models. Despite their promising performance, they suffer from slow generation speed due to the large number of sampling steps required. Although…

机器学习 · 计算机科学 2025-10-27 Enshu Liu , Qian Chen , Xuefei Ning , Shengen Yan , Guohao Dai , Zinan Lin , Yu Wang

Diffusion models promise efficient parallel text generation but rely on bidirectional attention, creating a structural mismatch with pre-trained Autoregressive (AR) models. This incompatibility precludes reusing robust AR priors,…

计算与语言 · 计算机科学 2026-05-29 Xiangyu Ma , Teng Xiao , Zuchao Li , Lefei Zhang

Video generation necessitates both global coherence and local realism. This work presents a novel non-autoregressive method GLOBER, which first generates global features to obtain comprehensive global guidance and then synthesizes video…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Mingzhen Sun , Weining Wang , Zihan Qin , Jiahui Sun , Sihan Chen , Jing Liu

Visual Auto-Regressive modeling (VAR) has shown promise in bridging the speed and quality gap between autoregressive image models and diffusion models. VAR reformulates autoregressive modeling by decomposing an image into successive…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Hermann Kumbong , Xian Liu , Tsung-Yi Lin , Ming-Yu Liu , Xihui Liu , Ziwei Liu , Daniel Y. Fu , Christopher Ré , David W. Romero

The post-training pipeline for diffusion models currently has two stages: supervised fine-tuning (SFT) on curated data and reinforcement learning (RL) with reward models. A fundamental gap separates them. SFT optimizes the denoiser only on…

机器学习 · 计算机科学 2026-04-20 You Qin , Linqing Wang , Hao Fei , Roger Zimmermann , Liefeng Bo , Qinglin Lu , Chunyu Wang

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging. Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Yingqing He , Tianyu Yang , Yong Zhang , Ying Shan , Qifeng Chen

Autoregressive long video generation often adopts bounded-memory streaming for efficiency, typically combining local windows for short-term continuity with static early-frame sinks as long-range anchors. However, this fixed allocation keeps…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Bo Ye , Xinyu Cui , Jian Zhao , Tong Wei , Min-Ling Zhang