English
Related papers

Related papers: Diff-ES: Stage-wise Structural Diffusion Pruning v…

200 papers

Diffusion models (DMs) are a powerful type of generative models that have achieved state-of-the-art results in various image synthesis tasks and have shown potential in other domains, such as natural language processing and temporal data…

Machine Learning · Computer Science 2026-02-05 Inês Cardoso Oliveira , Decebal Constantin Mocanu , Luis A. Leiva

Accurately segmenting the pancreas remains a huge challenge. Traditional methods encounter difficulties in semantic localization due to the small volume and distorted structure of the pancreas, while deep learning methods encounter…

Image and Video Processing · Electrical Eng. & Systems 2024-04-12 Yue Gou , Yuming Xing , Shengzhu Shi , Zhichang Guo

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

Machine Learning · Computer Science 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

In recent years, Denoising Diffusion Models have demonstrated remarkable success in generating semantically valuable pixel-wise representations for image generative modeling. In this study, we propose a novel end-to-end framework, called…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Zhaohu Xing , Liang Wan , Huazhu Fu , Guang Yang , Lei Zhu

We present a novel network pruning algorithm called Dynamic Sparse Training that can jointly find the optimal network parameters and sparse network structure in a unified optimization process with trainable pruning thresholds. These…

Machine Learning · Computer Science 2020-05-15 Junjie Liu , Zhe Xu , Runbin Shi , Ray C. C. Cheung , Hayden K. H. So

Conditional diffusion models have demonstrated impressive performance in image manipulation tasks. The general pipeline involves adding noise to the image and then denoising it. However, this method faces a trade-off problem: adding too…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Luozhou Wang , Shuai Yang , Shu Liu , Ying-cong Chen

To fully leverage the capabilities of diffusion models, we are often interested in optimizing downstream reward functions during inference. While numerous algorithms for reward-guided generation have been recently proposed due to their…

Machine Learning · Computer Science 2025-04-18 Masatoshi Uehara , Xingyu Su , Yulai Zhao , Xiner Li , Aviv Regev , Shuiwang Ji , Sergey Levine , Tommaso Biancalani

Diffusion models have emerged as powerful generative tools, rivaling GANs in sample quality and mirroring the likelihood scores of autoregressive models. A subset of these models, exemplified by DDIMs, exhibit an inherent asymmetry: they…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yixuan Wang , Shuangyin Li

Diffusion models have emerged as powerful generative priors for high-dimensional inverse problems, yet learning them when only corrupted or noisy observations are available remains challenging. In this work, we propose a new method for…

Machine Learning · Computer Science 2025-12-23 Danial Hosseintabar , Fan Chen , Giannis Daras , Antonio Torralba , Constantinos Daskalakis

We propose DiffuStereo, a novel system using only sparse cameras (8 in this work) for high-quality 3D human reconstruction. At its core is a novel diffusion-based stereo module, which introduces diffusion models, a type of powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Ruizhi Shao , Zerong Zheng , Hongwen Zhang , Jingxiang Sun , Yebin Liu

As one of the most popular and sought-after generative models in the recent years, diffusion models have sparked the interests of many researchers and steadily shown excellent advantage in various generative tasks such as image synthesis,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Zhiyuan Ma , Yuzhu Zhang , Guoli Jia , Liangliang Zhao , Yichao Ma , Mingjie Ma , Gaofeng Liu , Kaiyan Zhang , Jianjun Li , Bowen Zhou

Deep learning models for Time Series Classification (TSC) have achieved strong predictive performance but their high computational and memory requirements often limit deployment on resource-constrained devices. While structured pruning can…

Machine Learning · Computer Science 2026-02-16 Javidan Abdullayev , Maxime Devanne , Cyril Meyer , Ali Ismail-Fawaz , Jonathan Weber , Germain Forestier

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic sets while preserving training efficacy. However, existing studies mainly focus on image classification, leaving dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wenjie Zheng , Haoji Hu , Jiali Lu , Xingze Zou , Jing Wang

Diffusion Transformer (DiT), an emerging diffusion model for visual generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs primarily stem from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Hao Luo , Yibing Song , Gao Huang , Fan Wang , Yang You

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

Diffusion models have shown remarkable performance in generation problems over various domains including images, videos, text, and audio. A practical bottleneck of diffusion models is their sampling speed, due to the repeated evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Taehong Moon , Moonseok Choi , EungGu Yun , Jongmin Yoon , Gayoung Lee , Jaewoong Cho , Juho Lee

Phase retrieval aims to recover a signal from intensity-only measurements, a fundamental problem in many fields such as imaging, holography, optical computing, crystallography, and microscopy. Although there are several well-known phase…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Mehmet Onurcan Kaya , Figen S. Oktem

Generative models have been successfully used in the field of time series generation. However, when dealing with long-term time series, which span over extended periods and exhibit more complex long-term temporal patterns, the task of…

Machine Learning · Computer Science 2025-09-01 Xuan Hou , Shuhan Liu , Zhaohui Peng , Yaohui Chu , Yue Zhang , Yining Wang

The evolutionary processes of complex systems contain critical information regarding their functional characteristics. The generation time of edges provides insights into the historical evolution of various networked complex systems, such…

Artificial Intelligence · Computer Science 2025-01-14 En Xu , Can Rong , Jingtao Ding , Yong Li