English
Related papers

Related papers: LSGQuant: Layer-Sensitivity Guided Quantization fo…

200 papers

In this work, we first propose DiffVC-OSD, a One-Step Diffusion-based Perceptual Neural Video Compression framework. Unlike conventional multi-step diffusion-based methods, DiffVC-OSD feeds the reconstructed latent representation directly…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Wenzhuo Ma , Zhenzhong Chen

Diffusion-based image generation models have achieved great success in recent years by showing the capability of synthesizing high-quality content. However, these models contain a huge number of parameters, resulting in a significantly…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yang Sui , Yanyu Li , Anil Kag , Yerlan Idelbayev , Junli Cao , Ju Hu , Dhritiman Sagar , Bo Yuan , Sergey Tulyakov , Jian Ren

The Diffusion Transformers Models (DiTs) have transitioned the network architecture from traditional UNets to transformers, demonstrating exceptional capabilities in image generation. Although DiTs have been widely applied to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Juncan Deng , Shuaiting Li , Zeyu Wang , Hong Gu , Kedong Xu , Kejie Huang

Diffusion models excel in image generation but are computational and resource-intensive due to their reliance on iterative Markov chain processes, leading to error accumulation and limiting the effectiveness of naive compression techniques.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Beomseok Ko , Hyeryung Jang

Diffusion models have received wide attention in generation tasks. However, the expensive computation cost prevents the application of diffusion models in resource-constrained scenarios. Quantization emerges as a practical solution that…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Weilun Feng , Haotong Qin , Chuanguang Yang , Zhulin An , Libo Huang , Boyu Diao , Fei Wang , Renshuai Tao , Yongjun Xu , Michele Magno

We present Stable Video Diffusion - a latent video diffusion model for high-resolution, state-of-the-art text-to-video and image-to-video generation. Recently, latent diffusion models trained for 2D image synthesis have been turned into…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Andreas Blattmann , Tim Dockhorn , Sumith Kulal , Daniel Mendelevitch , Maciej Kilian , Dominik Lorenz , Yam Levi , Zion English , Vikram Voleti , Adam Letts , Varun Jampani , Robin Rombach

Large reasoning models (LRMs) reach competition-level math and coding accuracy via long autoregressive decoding, making per-token decoding cost a primary deployment concern. Weight quantization is the standard tool for acceleration, but…

Machine Learning · Computer Science 2026-05-12 Euntae Choi , Sumin Song , Sungjoo Yoo

Model quantization is challenging due to many tedious hyper-parameters such as precision (bitwidth), dynamic range (minimum and maximum discrete values) and stepsize (interval between discrete values). Unlike prior arts that carefully tune…

Machine Learning · Computer Science 2021-07-08 Zhang Zhaoyang , Shao Wenqi , Gu Jinwei , Wang Xiaogang , Luo Ping

In this paper, we propose LSRNA, a novel framework for higher-resolution (exceeding 1K) image generation using diffusion models by leveraging super-resolution directly in the latent space. Existing diffusion models struggle with scaling…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jinho Jeong , Sangmin Han , Jinwoo Kim , Seon Joo Kim

Despite recent advances, single-image super-resolution (SR) remains challenging, especially in real-world scenarios with complex degradations. Diffusion-based SR methods, particularly those built on Stable Diffusion, leverage strong…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Fabio D'Oronzio , Federico Putamorsi , Leonardo Zini , Marcella Cornia , Lorenzo Baraldi

Diffusion Transformers (DiTs) have shown remarkable performance in generating high-quality videos. However, the quadratic complexity of 3D full attention remains a bottleneck in scaling DiT training, especially with high-definition, lengthy…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-02 Xin Tan , Yuetao Chen , Yimin Jiang , Xing Chen , Kun Yan , Nan Duan , Yibo Zhu , Daxin Jiang , Hong Xu

Artistic style transfer aims to transfer the learned artistic style onto an arbitrary content image, generating artistic stylized images. Existing generative adversarial network-based methods fail to generate highly realistic stylized…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zhanjie Zhang , Quanwei Zhang , Huaizhong Lin , Wei Xing , Juncheng Mo , Shuaicheng Huang , Jinheng Xie , Guangyuan Li , Junsheng Luan , Lei Zhao , Dalong Zhang , Lixia Chen

This work introduces NeuroQuant, a novel post-training quantization (PTQ) approach tailored to non-generalized Implicit Neural Representations for variable-rate Video Coding (INR-VC). Unlike existing methods that require extensive weight…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Junqi Shi , Zhujia Chen , Hanfei Li , Qi Zhao , Ming Lu , Tong Chen , Zhan Ma

Zero-shot quantization (ZSQ) enables neural network compression without original training data, making it a promising solution for restricted data access scenarios. To compensate for the lack of data, recent ZSQ methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Inpyo Hong , Youngwan Jo , Hyojeong Lee , Sunghyun Ahn , Kijung Lee , Sanghyun Park

Diffusion-based image super-resolution (SR) methods are mainly limited by the low inference speed due to the requirements of hundreds or even thousands of sampling steps. Existing acceleration sampling techniques inevitably sacrifice…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Large Language Model (LLM) inference is typically memory-intensive, especially when processing large batch sizes and long sequences, due to the large size of key-value (KV) cache. Vector Quantization (VQ) is recently adopted to alleviate…

Machine Learning · Computer Science 2025-12-16 Donghyun Son , Euntae Choi , Sungjoo Yoo

Diffusion Transformer(DiT)-based generation models have achieved remarkable success in video generation. However, their inherent computational demands pose significant efficiency challenges. In this paper, we exploit the inherent temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Zhihang Yuan , Rui Xie , Yuzhang Shang , Hanling Zhang , Siyuan Wang , Shengen Yan , Guohao Dai , Yu Wang

While traditional and neural video codecs (NVCs) have achieved remarkable rate-distortion performance, improving perceptual quality at low bitrates remains challenging. Some NVCs incorporate perceptual or adversarial objectives but still…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Naifu Xue , Zhaoyang Jia , Jiahao Li , Bin Li , Zihan Zheng , Yuan Zhang , Yan Lu

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

Machine Learning · Computer Science 2025-06-12 Bowen Zheng , Tianming Yang

The rapid growth of visual data under stringent storage and bandwidth constraints makes extremely low-bitrate image compression increasingly important. While Vector Quantization (VQ) offers strong structural fidelity, existing methods lack…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Shiyin Jiang , Wei Long , Minghao Han , Zhenghao Chen , Ce Zhu , Shuhang Gu