English
Related papers

Related papers: Q-ARVD: Quantizing Autoregressive Video Diffusion …

200 papers

In response to the rapid growth of global videomtraffic and the limitations of traditional wireless transmission systems, we propose a novel dual-stage vector quantization framework, VQ-DeepVSC, tailored to enhance video transmission over…

Networking and Internet Architecture · Computer Science 2024-09-06 Yongyi Miao , Zhongdang Li , Yang Wang , Die Hu , Jun Yan , Youfang Wang

Video quality assessment (VQA) remains an important and challenging problem that affects many applications at the widest scales. Recent advances in mobile devices and cloud computing techniques have made it possible to capture, process, and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Qi Zheng , Zhengzhong Tu , Pavan C. Madhusudana , Xiaoyang Zeng , Alan C. Bovik , Yibo Fan

This paper presents Diffusion via Autoregressive models (D-AR), a new paradigm recasting the image diffusion process as a vanilla autoregressive procedure in the standard next-token-prediction fashion. We start by designing the tokenizer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Ziteng Gao , Mike Zheng Shou

Video-to-video synthesis poses significant challenges in maintaining character consistency, smooth temporal transitions, and preserving visual quality during fast motion. While recent fully cross-frame self-attention mechanisms have…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Tanvir Mahmud , Mustafa Munir , Radu Marculescu , Diana Marculescu

Denoising diffusion models have emerged as state-of-the-art in generative tasks across image, audio, and video domains, producing high-quality, diverse, and contextually relevant data. However, their broader adoption is limited by high…

Sound · Computer Science 2024-09-24 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

The development of edge computing places critical demands on energy-efficient model deployment for multiple-input multiple-output (MIMO) detection tasks. Deploying deep unfolding models such as PGD-Nets and ADMM-Nets into…

Machine Learning · Computer Science 2025-05-20 Zeyi Ren , Jingreng Lei , Yichen Jin , Ermo Hua , Qingfeng Lin , Chen Zhang , Bowen Zhou , Yik-Chung Wu

Large language models (LLMs) have demonstrated remarkable performance across a wide range of natural language processing tasks. However, their exponentially increasing parameters pose significant challenges for deployment on…

Machine Learning · Computer Science 2025-10-03 Zukang Xu , Xing Hu , Qiang Wu , Dawei Yang

AI-generated content has attracted lots of attention recently, but photo-realistic video synthesis is still challenging. Although many attempts using GANs and autoregressive models have been made in this area, the visual quality and length…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yingqing He , Tianyu Yang , Yong Zhang , Ying Shan , Qifeng Chen

Video Anomaly Detection (VAD) is critical for surveillance and public safety. However, existing benchmarks are limited to either frame-level or video-level tasks, restricting a holistic view of model generalization. This work first…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Seoik Jung , Taekyung Song , Joshua Jordan Daniel , JinYoung Lee , SungJun Lee

We propose an image-conditioned diffusion model to estimate high angular resolution diffusion weighted imaging (DWI) from a low angular resolution acquisition. Our model, which we call QID$^2$, takes as input a set of low angular resolution…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Zijian Chen , Jueqi Wang , Archana Venkataraman

Video diffusion models have rapidly become the dominant paradigm for high-fidelity generative video synthesis, but their practical deployment remains constrained by severe inference costs. Compared with image generation, video synthesis…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Shitong Shao , Lichen Bai , Pengfei Wan , James Kwok , Zeke Xie

Recent advances in diffusion large language models (dLLMs) have introduced a promising alternative to autoregressive (AR) LLMs for natural language generation tasks, leveraging full attention and denoising-based decoding strategies.…

Computation and Language · Computer Science 2026-03-17 Haokun Lin , Haobo Xu , Yichen Wu , Ziyu Guo , Renrui Zhang , Zhichao Lu , Ying Wei , Qingfu Zhang , Zhenan Sun

While inference-time scaling has significantly enhanced generative quality in large language and diffusion models, its application to vector-quantized (VQ) visual autoregressive modeling (VAR) remains unexplored. We introduce VAR-Scaling,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Weidong Tang , Xinyan Wan , Siyu Li , Xiumei Wang

Free-view video (FVV) allows users to explore immersive video content from multiple views. However, delivering FVV poses significant challenges due to the uncertainty in view switching, combined with the substantial bandwidth and…

Multimedia · Computer Science 2025-01-24 Qiang Hu , Qihan He , Houqiang Zhong , Guo Lu , Xiaoyun Zhang , Guangtao Zhai , Yanfeng Wang

Vision-Language-Action (VLA) models have recently demonstrated strong performance across embodied tasks. Modern VLAs commonly employ diffusion action experts to efficiently generate high-precision continuous action chunks, while…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Chen Zhao , Zhuoran Wang , Haoyang Li , Shifeng Bao , Guanlin Li , Youhe Feng , Yang Li , Jie Tang , Jing Zhang

Recent advancements in diffusion-based video generation have produced impressive and high-fidelity short videos. To extend these successes to generate coherent long videos, most video diffusion models (VDMs) generate videos in an…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianle Cheng , Zeyan Zhang , Kaifeng Gao , Jun Xiao

As machine learning inferences increasingly move to edge devices, adapting to diverse computational capabilities, hardware, and memory constraints becomes more critical. Instead of relying on a pre-trained model fixed for all future…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-01 Xiangchen Li , Saeid Ghafouri , Bo Ji , Hans Vandierendonck , Deepu John , Dimitrios S. Nikolopoulos

We describe an adaptation of VACE (Video All-in-one Creation and Editing) for real-time autoregressive video generation. VACE provides unified video control (reference guidance, structural conditioning, inpainting, and temporal extension)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Ryan Fosdick

In real-world video super-resolution (VSR), videos suffer from in-the-wild degradations and artifacts. VSR methods, especially recurrent ones, tend to propagate artifacts over time in the real-world setting and are more vulnerable than…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuehan Zhang , Angela Yao

The inherent heavy computation of deep neural networks prevents their widespread applications. A widely used method for accelerating model inference is quantization, by replacing the input operands of a network using fixed-point values.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Hongwei Xie , Shuo Zhang , Huanghao Ding , Yafei Song , Baitao Shao , Conggang Hu , Ling Cai , Mingyang Li