English
Related papers

Related papers: Lightweight Diffusion Models for Resource-Constrai…

200 papers

Semantic information refers to the meaning conveyed through words, phrases, and contextual relationships within a given linguistic structure. Humans can leverage semantic information, such as familiar linguistic patterns and contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Jixun Yao , Hexin Liu , Chen Chen , Yuchen Hu , EngSiong Chng , Lei Xie

Task-Oriented Semantic Communication (TOSC) has been regarded as a promising communication framework, serving for various Artificial Intelligence (AI) task driven applications. The existing TOSC frameworks focus on extracting the full…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Yuzhou Fu , Wenchi Cheng , Jingqing Wang , Liuguo Yin , Wei Zhang

Generative Artificial Intelligence (GAI) shows remarkable productivity and creativity in Mobile Edge Networks, such as the metaverse and the Industrial Internet of Things. Federated learning is a promising technique for effectively training…

Machine Learning · Computer Science 2024-03-08 Bingkun Lai , Jiayi He , Jiawen Kang , Gaolei Li , Minrui Xu , Tao zhang , Shengli Xie

With the significant advances in generative AI (GAI) and the proliferation of mobile devices, providing high-quality AI-generated content (AIGC) services via wireless networks is becoming the future direction. However, the primary…

Machine Learning · Computer Science 2025-03-25 Runze Cheng , Yao Sun , Lan Zhang , Lei Feng , Lei Zhang , Muhammad Ali Imran

Image synthesis approaches, e.g., generative adversarial networks, have been popular as a form of data augmentation in medical image analysis tasks. It is primarily beneficial to overcome the shortage of publicly accessible data and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Shiyi Du , Xiaosong Wang , Yongyi Lu , Yuyin Zhou , Shaoting Zhang , Alan Yuille , Kang Li , Zongwei Zhou

Text-based image segmentation aims to delineate object boundaries within an image from text prompts, offering higher flexibility and broader application scope compared to traditional fixed-category segmentation tasks. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zishen Qu , Xuesong Li , Haijian Gu , Hongwei Kang , Quan Meng , Tianrui Niu , Xin Yang , Ruidong Pan

Attention-based models have demonstrated remarkable success in various natural language understanding tasks. However, efficient execution remains a challenge for these models which are memory-bound due to their massive number of parameters.…

Machine Learning · Computer Science 2022-03-25 Ali Hadi Zadeh , Isak Edo , Omar Mohamed Awad , Andreas Moshovos

Diffusion Transformers achieve impressive generative quality but remain computationally expensive due to iterative sampling. Recently, dynamic resolution sampling has emerged as a promising acceleration technique by reducing the resolution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Shikang Zheng , Guantao Chen , Lixuan He , Jiacheng Liu , Yuqi Lin , Chang Zou , Linfeng Zhang

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

Most current speech enhancement (SE) methods recover clean speech from noisy inputs by directly estimating time-frequency masks or spectrums. However, these approaches often neglect the distinct attributes, such as semantic content and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiang , Canan Huang , Desheng Hu , Jingguang Tian , Xinhui Hu , Chao Zhang

Quantum generative models offer a novel approach to exploring high-dimensional Hilbert spaces but face significant challenges in scalability and expressibility when applied to multi-modal distributions. In this study, we explore a Hybrid…

Quantum Physics · Physics 2026-02-06 Jeongbin Jo , Santanam Wishal , Shah Md Khalil Ullah , Shan Zeng , Dikshant Dulal

Remote sensing semantic segmentation must address both what the ground objects are within an image and where they are located. Consequently, segmentation models must ensure not only the semantic correctness of large-scale patches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Hao Wang , Keyan Hu , Xin Guo , Haifeng Li , Chao Tao

Diffusion-based generative models have had a high impact on the computer vision and speech processing communities these past years. Besides data generation tasks, they have also been employed for data restoration tasks like speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-17 Jean-Marie Lemercier , Julius Richter , Simon Welker , Timo Gerkmann

Negation is a fundamental linguistic operator, yet it remains inadequately modeled in diffusion-based generative systems. In this work, we present a formal treatment of linguistic negation in diffusion-based generative models by modeling it…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Taewon Kang , Ming C. Lin

Large-scale models for learning fixed-dimensional cross-lingual sentence representations like LASER (Artetxe and Schwenk, 2019b) lead to significant improvement in performance on downstream tasks. However, further increases and…

Computation and Language · Computer Science 2022-05-30 Zhuoyuan Mao , Prakhar Gupta , Pei Wang , Chenhui Chu , Martin Jaggi , Sadao Kurohashi

In this work, a self-attention based conditional generative adversarial network (SA-cGAN) framework for the sixth generation (6G) semantic communication system is proposed, explicitly designed to balance the trade-off between distortion…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Faizan Shafi , Rahul Jashvantbhai Pandya , Christo Kurisummoottil Thomas , Sridhar Iyer

We introduce EffiFusion-GAN (Efficient Fusion Generative Adversarial Network), a lightweight yet powerful model for speech enhancement. The model integrates depthwise separable convolutions within a multi-scale block to capture diverse…

Sound · Computer Science 2025-08-21 Bin Wen , Tien-Ping Tan

The introduction of quantum concepts is increasingly making its way into generative machine learning models. However, while there are various implementations of quantum Generative Adversarial Networks, the integration of quantum elements…

Diffusion models are primarily trained for image synthesis, yet their denoising trajectories encode rich, spatially aligned visual priors. In this paper, we demonstrate that these priors can be utilized for text-conditioned semantic and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Haoxiao Wang , Antao Xiang , Haiyang Sun , Peilin Sun , Changhao Pan , Yifu Chen , Minjie Hong , Weijie Wang , Shuang Chen , Yue Chen , Zhou Zhao

Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face challenges, including posterior collapse and limited…

Machine Learning · Computer Science 2024-10-28 Sharare Zolghadr , Ole Winther , Paul Jeha