English
Related papers

Related papers: Compression of Site-Specific Deep Neural Networks …

200 papers

This paper is dedicated to an efficient compression of weights and optimizer states (called checkpoints) obtained at different stages during a neural network training process. First, we propose a prediction-based compression approach, where…

Machine Learning · Computer Science 2025-06-16 Yuriy Kim , Evgeny Belyaev

Overparameterized models have proven to be powerful tools for solving various machine learning tasks. However, overparameterization often leads to a substantial increase in computational and memory costs, which in turn requires extensive…

Machine Learning · Computer Science 2024-03-13 Soo Min Kwon , Zekai Zhang , Dogyoon Song , Laura Balzano , Qing Qu

The recent advances in machine learning and deep neural networks have made them attractive candidates for wireless communications functions such as channel estimation, decoding, and downlink channel state information (CSI) compression.…

Networking and Internet Architecture · Computer Science 2023-11-15 Omar Erak , Hatem Abou-Zeid

Deep neural networks have shown great success in many diverse fields. The training of these networks can take significant amounts of time, compute and energy. As datasets get larger and models become more complex, the exploration of model…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-08 Siddharth Samsi , Michael Jones , Mark M. Veillette

In conventional multi-user multiple-input multiple-output (MU-MIMO) systems with frequency division duplexing (FDD), channel acquisition and precoder optimization processes have been designed separately although they are highly coupled.…

Information Theory · Computer Science 2022-09-22 Jeonghyeon Jang , Hoon Lee , Il-Min Kim , Inkyu Lee

Deep neural networks (DNNs) have been quite successful in solving many complex learning problems. However, DNNs tend to have a large number of learning parameters, leading to a large memory and computation requirement. In this paper, we…

Machine Learning · Computer Science 2019-05-21 Sangkyun Lee , Jeonghyun Lee

Deep learning (DL) has achieved great success in signal processing and communications and has become a promising technology for future wireless communications. Existing works mainly focus on exploiting DL to improve the performance of…

Information Theory · Computer Science 2024-10-30 Jiajia Guo , Jinghe Wang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Increasingly complex neural network architectures have achieved phenomenal performance. However, these complex models require massive computational resources that consume substantial amounts of electricity, which highlights the potential…

Machine Learning · Computer Science 2025-06-03 Leo Mei , Mark Stamp

To raise awareness of the environmental impact of deep learning (DL), many studies estimate the energy use of DL systems. However, energy estimates during DL training often rely on unverified assumptions. This work addresses that gap by…

Machine Learning · Computer Science 2025-09-26 Santiago del Rey , Luís Cruz , Xavier Franch , Silverio Martínez-Fernández

Neural networks have been applied to the physical layer of wireless communication systems to solve complex problems. In millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) systems, hybrid precoding has been considered as…

Networking and Internet Architecture · Computer Science 2019-03-22 Jing Yang , Kai Chen , Xiaohu Ge , Yonghui Li , Lin Tian

Training large-scale distributed machine learning models imposes considerable demands on network infrastructure, often resulting in sudden traffic spikes that lead to congestion, increased latency, and reduced throughput, which would…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-23 Yisu Wang , Xinjiao Li , Ruilong Wu , Huangxun Chen , Dirk Kutscher

Massive multiple-input multiple-output (mMIMO) downlink precoding offers high spectral efficiency but remains challenging to deploy in practice because near-optimal algorithms such as the weighted minimum mean squared error (WMMSE) are…

Machine Learning · Computer Science 2026-01-30 Ali Hasanzadeh Karkan , Ahmed Ibrahim , Jean-François Frigon , François Leduc-Primeau

Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of domains. However, DNNs are becoming computationally intensive and energy hungry at an exponential pace, while at the same time, there is a vast demand for…

Hybrid precoding is a cost-efficient technique for millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) communications. This paper proposes a deep learning approach by using a distributed neural network for hybrid…

Information Theory · Computer Science 2022-04-19 Kai Wei , Jindan Xu , Wei Xu , Ning Wang , Dong Chen

In this paper, we propose a deep reinforcement learning (RL)-based precoding framework that can be used to learn an optimal precoding policy for complex multiple-input multiple-output (MIMO) precoding problems. We model the precoding…

Information Theory · Computer Science 2024-10-30 Heunchul Lee , Maksym Girnyk , Jaeseong Jeong

This paper proposes the use of deep autoencoders to compress the channel information in a \review{massive} multiple input and multiple output (MIMO) system. Although autoencoders perform lossy compression, they still have adequate…

Networking and Internet Architecture · Computer Science 2024-10-07 Faris B. Mismar , Aliye Özge Kaya

Massive MIMO systems are typically designed assuming linear power amplifiers (PAs). However, PAs are most energy efficient close to saturation, where non-linear distortion arises. For conventional precoders, this distortion can coherently…

Information Theory · Computer Science 2023-12-11 Thomas Feys , Liesbet Van der Perre , François Rottenberg

Massive multiple-input multiple-output (MIMO) systems are a main enabler of the excessive throughput requirements in 5G and future generation wireless networks as they can serve many users simultaneously with high spectral and energy…

Information Theory · Computer Science 2021-02-15 Mahdi Boloursaz Mashhadi , Deniz Gündüz

This paper proposes a novel neural network architecture, that we call an auto-precoder, and a deep-learning based approach that jointly senses the millimeter wave (mmWave) channel and designs the hybrid precoding matrices with only a few…

Information Theory · Computer Science 2019-05-31 Xiaofeng Li , Ahmed Alkhateeb

Deep learning (DL) approaches have demonstrated high performance in compressing and reconstructing the channel state information (CSI) and reducing the CSI feedback overhead in massive MIMO systems. One key challenge, however, with the DL…

Information Theory · Computer Science 2024-03-04 Shuaifeng Jiang , Ahmed Alkhateeb