English
Related papers

Related papers: Sampling-Free Diffusion Transformers for Low-Compl…

200 papers

Future sixth-generation (6G) systems are expected to leverage extremely large-scale multiple-input multiple-output (XL-MIMO) technology, which significantly expands the range of the near-field region. The spherical wavefront characteristics…

Information Theory · Computer Science 2025-05-20 Shicong Liu , Xianghao Yu , Zhen Gao , Jie Xu , Derrick Wing Kwan Ng , Shuguang Cui

Diffusion models with their powerful expressivity and high sample quality have achieved State-Of-The-Art (SOTA) performance in the generative domain. The pioneering Vision Transformer (ViT) has also demonstrated strong modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ali Hatamizadeh , Jiaming Song , Guilin Liu , Jan Kautz , Arash Vahdat

While Diffusion Transformers (DiT) have advanced non-autoregressive (NAR) speech synthesis, their high computational demands remain an limitation. Existing DiT-based text-to-speech (TTS) model acceleration approaches mainly focus on…

Sound · Computer Science 2025-09-15 Yanru Huo , Ziyue Jiang , Zuoli Tang , Qingyang Hong , Zhou Zhao

A low-complexity convolutional neural network estimator which learns the minimum mean squared error channel estimator for single-antenna users was recently proposed. We generalize the architecture to the estimation of MIMO channels with…

Information Theory · Computer Science 2021-04-27 B. Fesl , N. Turan , M. Koller , W. Utschick

Discrete diffusion models (DDMs) are a powerful class of generative models for categorical data, but they typically require many function evaluations for a single sample, making inference expensive. Existing acceleration methods either rely…

Machine Learning · Computer Science 2025-12-16 Yansong Gao , Yu Sun

In this paper, we consider an intelligent reflecting surface (IRS)-aided single-user system where an IRS with discrete phase shifts is deployed to assist the uplink communication. A practical transmission protocol is proposed to execute…

Information Theory · Computer Science 2019-12-24 Changsheng You , Beixiong Zheng , Rui Zhang

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in generative modeling, yet their high computational cost hinders real-time deployment. While feature caching offers a promising training-free acceleration solution by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Fanpu Cao , Yaofo Chen , Zeng You , Wei Luo

The acquisition of channel state information (CSI) is essential in MIMO-OFDM communication systems. Data-aided enhanced receivers, by incorporating domain knowledge, effectively mitigate performance degradation caused by imperfect CSI,…

Information Theory · Computer Science 2025-04-22 Xinjie Li , Jing Zhang , Xingyu Zhou , Chao-Kai Wen , Shi Jin

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Computer Science 2025-02-17 Pascal Jutras-Dubé , Patrick Pynadath , Ruqi Zhang

In massive multiple-input multiple-output (MIMO) systems, the knowledge of the users' channel covariance matrix is crucial for minimum mean square error (MMSE) channel estimation in the uplink as well as it plays an important role in…

Information Theory · Computer Science 2022-06-07 Tianyu Yang , Mahdi Barzegar Khalilsarai , Saeid Haghighatshoar , Giuseppe Caire

In this work, we address the challenge of accurately obtaining channel state information at the transmitter (CSIT) for frequency division duplexing (FDD) multiple input multiple output systems. Although CSIT is vital for maximizing spatial…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Sajad Daei , Mikael Skoglund , Gabor Fodor

Transformer-based Diffusion Probabilistic Models (DPMs) have shown more potential than CNN-based DPMs, yet their extensive computational requirements hinder widespread practical applications. To reduce the computation budget of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Xinwang Chen , Ning Liu , Yichen Zhu , Feifei Feng , Jian Tang

Despite recent advances in UNet-based image editing, methods for shape-aware object editing in high-resolution images are still lacking. Compared to UNet, Diffusion Transformers (DiT) demonstrate superior capabilities to effectively capture…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Kunyu Feng , Yue Ma , Bingyuan Wang , Chenyang Qi , Haozhe Chen , Qifeng Chen , Zeyu Wang

Recent progress in diffusion-based Singing Voice Synthesis (SVS) demonstrates strong expressiveness but remains limited by data scarcity and model scalability. We introduce a two-stage pipeline: a compact seed set of human-sung recordings…

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

In large scale dynamic wireless networks, the amount of overhead caused by channel estimation (CE) is becoming one of the main performance bottlenecks. This is due to the large number users whose channels should be estimated, the user…

Information Theory · Computer Science 2022-04-19 Mohanad Obeed , Yasser Al-Eryani , Anas Chaaban

Diffusion models have shown remarkable performance in image generation in recent years. However, due to a quadratic increase in memory during generating ultra-high-resolution images (e.g. 4096*4096), the resolution of generated images is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhuoyi Yang , Heyang Jiang , Wenyi Hong , Jiayan Teng , Wendi Zheng , Yuxiao Dong , Ming Ding , Jie Tang

Diffusion Transformers (DiTs) incur prohibitive computational costs due to the quadratic scaling of self-attention. Existing pruning methods fail to simultaneously satisfy differentiability, efficiency, and the strict static budgets…

Machine Learning · Computer Science 2026-02-06 Jiaji Zhang , Hailiang Zhao , Guoxuan Zhu , Ruichao Sun , Jiaju Wu , Xinkui Zhao , Hanlin Tang , Weiyi Lu , Kan Liu , Tao Lan , Lin Qu , Shuiguang Deng

Pre-trained stable diffusion models (SD) have shown great advances in visual correspondence. In this paper, we investigate the capabilities of Diffusion Transformers (DiTs) for accurate dense correspondence. Distinct from SD, DiTs exhibit a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chaofan Gan , Yuanpeng Tu , Xi Chen , Tieyuan Chen , Yuxi Li , Mehrtash Harandi , Weiyao Lin

Intelligent reflecting surfaces (IRSs)-assisted wireless communication promises improved system performance, while posing new challenges in channel estimation (CE) due to the passive nature of the reflecting elements. Although a few CE…

Signal Processing · Electrical Eng. & Systems 2020-09-25 Hibatallah Alwazani , Qurrat-Ul-Ain Nadeem , Anas Chaaban