中文
相关论文

相关论文: PQCAD-DM: Progressive Quantization and Calibration…

200 篇论文

Large Language Models (LLMs) enable advanced natural language processing but face deployment challenges on resource-constrained edge devices due to high computational, memory, and energy demands. Optimizing these models requires addressing…

机器学习 · 计算机科学 2026-01-16 Jacob Sander , Brian Jalaian , Venkat R. Dasari

Recently, video diffusion models (VDMs) have garnered significant attention due to their notable advancements in generating coherent and realistic video content. However, processing multiple frame features concurrently, coupled with the…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Shilong Tian , Hong Chen , Chengtao Lv , Yu Liu , Jinyang Guo , Xianglong Liu , Shengxi Li , Hao Yang , Tao Xie

Deploying large and complex deep neural networks on resource-constrained edge devices poses significant challenges due to their computational demands and the complexities of non-convex optimization. Traditional compression methods such as…

机器学习 · 计算机科学 2024-10-10 Prateek Varshney , Mert Pilanci

Deep learning models for image compression often face practical limitations in hardware-constrained applications. Although these models achieve high-quality reconstructions, they are typically complex, heavyweight, and require substantial…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Caroline Mazini Rodrigues , Nicolas Keriven , Thomas Maugey

Diffusion models have transformed image synthesis by establishing unprecedented quality and creativity benchmarks. Nevertheless, their large-scale deployment faces challenges due to computationally intensive iterative denoising processes.…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Songwei Liu , Chao Zeng , Chenqian Yan , Xurui Peng , Xing Wang , Fangmin Chen , Xing Mei

Knowledge distillation is a mainstream algorithm in model compression by transferring knowledge from the larger model (teacher) to the smaller model (student) to improve the performance of student. Despite many efforts, existing methods…

计算机视觉与模式识别 · 计算机科学 2024-10-21 Muhe Ding , Jianlong Wu , Xue Dong , Xiaojie Li , Pengda Qin , Tian Gan , Liqiang Nie

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

This paper introduces a novel quantum diffusion model designed for Noisy Intermediate-Scale Quantum (NISQ) devices. Unlike previous methods, this model efficiently processes higher-dimensional images with complex pixel structures, even on…

量子物理 · 物理学 2024-11-26 Shivalee Shah , Mayank Vatsa

Diffusion-based generative image compression has demonstrated remarkable potential for achieving realistic reconstruction at ultra-low bitrates. The key to unlocking this potential lies in making the entire compression process…

计算机视觉与模式识别 · 计算机科学 2026-03-26 Xihua Sheng , Lingyu Zhu , Tianyu Zhang , Dong Liu , Shiqi Wang , Jing Wang

While diffusion models can learn complex distributions, sampling requires a computationally expensive iterative process. Existing distillation methods enable efficient sampling, but have notable limitations, such as performance degradation…

Diffusion models have shown remarkable performance in image synthesis, but they demand extensive computational and memory resources for training, fine-tuning and inference. Although advanced quantization techniques have successfully…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Hoigi Seo , Wongi Jeong , Kyungryeol Lee , Se Young Chun

With the advancement of diffusion models (DMs) and the substantially increased computational requirements, quantization emerges as a practical solution to obtain compact and efficient low-bit DMs. However, the highly discrete representation…

计算机视觉与模式识别 · 计算机科学 2025-02-03 Xingyu Zheng , Xianglong Liu , Haotong Qin , Xudong Ma , Mingyuan Zhang , Haojie Hao , Jiakai Wang , Zixiang Zhao , Jinyang Guo , Michele Magno

Diffusion models generate high-quality images through progressive denoising but are computationally intensive due to large model sizes and repeated sampling. Knowledge distillation, which transfers knowledge from a complex teacher to a…

机器学习 · 计算机科学 2025-04-04 Dohyun Kim , Sehwan Park , Geonhee Han , Seung Wook Kim , Paul Hongsuck Seo

By embedding discrete representations into a continuous latent space, we can leverage continuous-space latent diffusion models to handle generative modeling of discrete data. However, despite their initial success, most latent diffusion…

机器学习 · 计算机科学 2025-04-02 Bac Nguyen , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Toshimitsu Uesaka , Stefano Ermon , Yuki Mitsufuji

The Segment Anything Model 3 (SAM3) advances visual understanding with Promptable Concept Segmentation (PCS) across images and videos, but its unified architecture (shared vision backbone, DETR-style detector, dense-memory tracker) remains…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Chengxi Zeng , Yuxuan Jiang , Aaron Zhang

The practical deployment of diffusion models is still hindered by the high memory and computational overhead. Although quantization paves a way for model compression and acceleration, existing methods face challenges in achieving low-bit…

计算机视觉与模式识别 · 计算机科学 2025-07-16 Haoxuan Wang , Yuzhang Shang , Zhihang Yuan , Junyi Wu , Junchi Yan , Yan Yan

Diffusion Models (DM) have revolutionized the text-to-image visual generation process. However, the large computational cost and model footprint of DMs hinders practical deployment, especially on edge devices. Post-training quantization…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Ruichen Chen , Keith G. Mills , Di Niu

In the era of AIGC, the demand for low-budget or even on-device applications of diffusion models emerged. In terms of compressing the Stable Diffusion models (SDMs), several approaches have been proposed, and most of them leveraged the…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Dingkun Zhang , Sijia Li , Chen Chen , Qingsong Xie , Haonan Lu

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

In modern process industries, data-driven models are important tools for real-time monitoring when key performance indicators are difficult to measure directly. While accurate predictions are essential, reliable uncertainty quantification…

机器学习 · 计算机科学 2026-04-07 Yiran Ma , Jerome Le Ny , Zhichao Chen , Zhihuan Song