English
Related papers

Related papers: QVGen: Pushing the Limit of Quantized Video Genera…

200 papers

Diffusion Models (DMs) utilize an iterative denoising process to transform random noise into synthetic data. Initally proposed with a UNet structure, DMs excel at producing images that are virtually indistinguishable with or without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yuewei Yang , Jialiang Wang , Xiaoliang Dai , Peizhao Zhang , Hongbo Zhang

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

While Diffusion Models (DM) exhibit remarkable performance across various image generative tasks, they nonetheless reflect the inherent bias presented in the training set. As DMs are now widely used in real-world applications, these biases…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yilei Jiang , Weihong Li , Yiyuan Zhang , Minghong Cai , Xiangyu Yue

Quantization of Large Language Models (LLMs) has recently gained popularity, particularly for on-device settings with limited hardware resources. While efficient, quantization inevitably degrades model quality, especially in aggressive…

Machine Learning · Computer Science 2025-06-25 Yeonhong Park , Jake Hyun , Hojoon Kim , Jae W. Lee

Learning-based 3D visual geometry models have benefited substantially from large-scale transformers. Among these, StreamVGGT leverages frame-wise causal attention for strong streaming reconstruction, but suffers from unbounded KV cache…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Zunhai Su , Weihao Ye , Hansen Feng , Keyu Fan , Jing Zhang , Dahai Yu , Zhengwu Liu , Ngai Wong

Neural network quantization aims to accelerate and trim full-precision neural network models by using low bit approximations. Methods adopting the quantization aware training (QAT) paradigm have recently seen a rapid growth, but are often…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Ke Zhu , Yin-Yin He , Jianxin Wu

The design of image and video quality assessment (QA) algorithms is extremely important to benchmark and calibrate user experience in modern visual systems. A major drawback of the state-of-the-art QA methods is their limited ability to…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Shankhanil Mitra , Diptanu De , Shika Rao , Rajiv Soundararajan

Diffusion models have shown remarkable performance in image synthesis by progressively estimating a smooth transition from a Gaussian distribution of noise to a real image. Unfortunately, their practical deployment is limited by slow…

Machine Learning · Computer Science 2026-03-03 Dung Anh Hoang , Cuong Pham anh Trung Le , Jianfei Cai , Thanh-Toan Do

Diffusion models have demonstrated remarkable performance on vision generation tasks. However, the high computational complexity hinders its wide application on edge devices. Quantization has emerged as a promising technique for inference…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Weilun Feng , Chuanguang Yang , Haotong Qin , Yuqi Li , Xiangqi Li , Zhulin An , Libo Huang , Boyu Diao , Fuzhen Zhuang , Michele Magno , Yongjun Xu , Yingli Tian , Tingwen Huang

One of the most significant bottleneck in training large scale machine learning models on parameter server (PS) is the communication overhead, because it needs to frequently exchange the model gradients between the workers and servers…

Machine Learning · Computer Science 2018-04-25 Guoxin Cui , Jun Xu , Wei Zeng , Yanyan Lan , Jiafeng Guo , Xueqi Cheng

Diffusion models have gained popularity for generating images from textual descriptions. Nonetheless, the substantial need for computational resources continues to present a noteworthy challenge, contributing to time-consuming processes.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Hanwen Chang , Haihao Shen , Yiyang Cai , Xinyu Ye , Zhenzhong Xu , Wenhua Cheng , Kaokao Lv , Weiwei Zhang , Yintong Lu , Heng Guo

Diffusion models have revolutionized video generation, becoming essential tools in creative content generation and physical simulation. Transformer-based architectures (DiTs) and classifier-free guidance (CFG) are two cornerstones of this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhiye Song , Steve Dai , Ben Keller , Brucek Khailany

Recent advances in video generation have made it possible to produce visually compelling videos, with wide-ranging applications in content creation, entertainment, and virtual reality. However, most existing diffusion transformer based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Teng Hu , Jiangning Zhang , Zihan Su , Ran Yi

Deploying Vision-Language Models (VLMs) on edge devices (e.g., smartphones and robots) is crucial for enabling low-latency and privacy-preserving intelligent applications. Given the resource constraints of these devices, quantization offers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Tianyu Guo , Shanwei Zhao , Shiai Zhu , Chenguang Ma

In this paper, we present VideoGen, a text-to-video generation approach, which can generate a high-definition video with high frame fidelity and strong temporal consistency using reference-guided latent diffusion. We leverage an…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Xin Li , Wenqing Chu , Ye Wu , Weihang Yuan , Fanglong Liu , Qi Zhang , Fu Li , Haocheng Feng , Errui Ding , Jingdong Wang

Bayesian Neural Networks (BNNs) provide principled uncertainty quantification but suffer from substantial computational and memory overhead compared to deterministic networks. While quantization techniques have successfully reduced resource…

Machine Learning · Computer Science 2025-12-12 Hendrik Borras , Yong Wu , Bernhard Klein , Holger Fröning

Evaluating generative video models remains an open problem. Reference-based metrics such as Structural Similarity Index Measure (SSIM) and Peak Signal to Noise Ratio (PSNR) reward pixel fidelity over semantic correctness, while Frechet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Karthik Inbasekar , Guy Rom , Omer Shlomovits

Quantum computing has recently emerged as a transformative technology. Yet, its promised advantages rely on efficiently translating quantum operations into viable physical realizations. In this work, we use generative machine learning…

Quantum Physics · Physics 2024-05-22 Florian Fürrutter , Gorka Muñoz-Gil , Hans J. Briegel

Diffusion models have demonstrated exceptional generative capabilities but are computationally intensive, posing significant challenges for deployment in resource-constrained or latency-sensitive environments. Quantization offers an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiaji Zhang , Ruichao Sun , Hailiang Zhao , Jiaju Wu , Peng Chen , Hao Li , Yuying Liu , Kingsum Chow , Gang Xiong , Shuiguang Deng

Despite the widespread use of text-to-image diffusion models across various tasks, their computational and memory demands limit practical applications. To mitigate this issue, quantization of diffusion models has been explored. It reduces…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Hyogon Ryu , NaHyeon Park , Hyunjung Shim