English
Related papers

Related papers: Training Over Sparse Multipath Channels in the Low…

200 papers

Channel estimation poses significant challenges in millimeter-wave massive multiple-input multiple-output systems, especially when the base station has fewer radio-frequency chains than antennas. To address this challenge, one promising…

Information Theory · Computer Science 2024-08-07 Pengxia Wu , Julian Cheng , Yonina C. Eldar , John M. Cioffi

Large MIMO transceivers are integral components of next-generation wireless networks. However, for such systems to be practical, their channel estimation process needs to be fast and reliable. Although several solutions for fast estimation…

Information Theory · Computer Science 2021-01-20 Yahia Shabara , C. Emre Koksal , Eylem Ekici

The use of sparse neural networks has seen rapid growth in recent years, particularly in computer vision. Their appeal stems largely from the reduced number of parameters required to train and store, as well as in an increase in learning…

Machine Learning · Computer Science 2022-06-22 Laura Graesser , Utku Evci , Erich Elsen , Pablo Samuel Castro

Improvements in the performance of deep neural networks have often come through the design of larger and more complex networks. As a result, fast memory is a significant limiting factor in our ability to improve network performance. One…

Machine Learning · Computer Science 2019-12-25 Simon Alford , Ryan Robinett , Lauren Milechin , Jeremy Kepner

We rigorously evaluate three state-of-the-art techniques for inducing sparsity in deep neural networks on two large-scale learning tasks: Transformer trained on WMT 2014 English-to-German, and ResNet-50 trained on ImageNet. Across thousands…

Machine Learning · Computer Science 2019-02-27 Trevor Gale , Erich Elsen , Sara Hooker

Channel Estimation is an essential component in applications such as radar and data communication. In multi path time varying environments, it is necessary to estimate time-shifts, scale-shifts (the wideband equivalent of Doppler-shifts),…

Information Theory · Computer Science 2009-06-05 Brian Carroll

Recent advances in optical systems make them ideal for undersampling multiband signals that have high bandwidths. In this paper we propose a new scheme for reconstructing multiband sparse signals using a small number of sampling channels.…

Information Theory · Computer Science 2008-06-04 Michael Fleyer , Amir Rosenthal , Alex Linden , Moshe Horowitz

This paper investigates the problem of estimating sparse channels in massive MIMO systems. Most wireless channels are sparse with large delay spread, while some channels can be observed having sparse common support (SCS) within a certain…

Information Theory · Computer Science 2017-04-24 Zhengdao Yuan , Chuanzong Zhang , Zhongyong Wang , Qinghua Guo

A new model for sparse time dispersive channels in pilot aided OFDM systems is developed by considering prior knowledge on channel time dispersions. Weighted atomic norm minimization is implemented in the model which enables a more accurate…

Information Theory · Computer Science 2018-10-26 Hoomaan Hezaveh , Iman Valiulahi , Mohammad Hossein Kahaei

Exploiting channel sparsity at millimeter wave (mmWave) frequencies reduces the high training overhead associated with the channel estimation stage. Compressive sensing (CS) channel estimation techniques usually adopt the (overcomplete)…

Information Theory · Computer Science 2019-09-23 Hongxiang Xie , Javier Rodríguez-Fernández , Nuria González-Prelcic

Convolutional neural networks (CNNs) are reported to be overparametrized. The search for optimal (minimal) and sufficient architecture is an NP-hard problem as the hyperparameter space for possible network configurations is vast. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Tin Barisin , Illia Horenko

Neural networks are becoming increasingly popular in applications, but our mathematical understanding of their potential and limitations is still limited. In this paper, we further this understanding by developing statistical guarantees for…

Machine Learning · Computer Science 2022-12-13 Johannes Lederer

The discovery of the theory of compressed sensing brought the realisation that many inverse problems can be solved even when measurements are "incomplete". This is particularly interesting in magnetic resonance imaging (MRI), where long…

Recent results in compressed sensing showed that the optimal subsampling strategy should take into account the sparsity pattern of the signal at hand. This oracle-like knowledge, even though desirable, nevertheless remains elusive in most…

Information Theory · Computer Science 2023-06-28 Simon Ruetz

We propose an iterative channel estimation algorithm based on the Least Square Estimation (LSE) and Sparse Message Passing (SMP) algorithm for the Millimeter Wave (mmWave) MIMO systems. The channel coefficients of the mmWave MIMO are…

Information Theory · Computer Science 2022-06-23 Chongwen Huang , Lei Liu , Chau Yuen , Sumei Sun

This paper develops alternative hyperparameters for specifying sparse Recurrent Neural Networks (RNNs). These hyperparameters allow for varying sparsity within the trainable weight matrices of the model while improving overall performance.…

Machine Learning · Computer Science 2025-09-19 Quincy Hershey , Randy Paffenroth

A low precision deep neural network training technique for producing sparse, ternary neural networks is presented. The technique incorporates hard- ware implementation costs during training to achieve significant model compression for…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Julian Faraone , Nicholas Fraser , Giulio Gambardella , Michaela Blott , Philip H. W. Leong

The success of the compressed sensing paradigm has shown that a substantial reduction in sampling and storage complexity can be achieved in certain linear and non-adaptive estimation problems. It is therefore an advisable strategy for…

Information Theory · Computer Science 2014-08-27 Peter Jung , Philipp Walk

We study efficient deep learning training algorithms that process received wireless signals, if a test Signal to Noise Ratio (SNR) estimate is available. We focus on two tasks that facilitate source identification: 1- Identifying the…

Machine Learning · Computer Science 2020-04-21 Xingchen Wang , Shengtai Ju , Xiwen Zhang , Sharan Ramjee , Aly El Gamal

This paper addresses the training signal design for the channel estimation in two-way multiple-input-and-multipleoutput (MIMO) relay systems, where the channels are correlated. We first derive the backward channel estimator with the optimal…

Information Theory · Computer Science 2021-12-15 Huiming Chen