English
Related papers

Related papers: Enhancing LMMSE Performance with Modest Complexity…

200 papers

In recent years data-driven machine learning approaches have been extensively studied to replace or enhance traditionally model-based processing in digital communication systems. In this work, we focus on equalization and propose a novel…

Signal Processing · Electrical Eng. & Systems 2024-03-12 Stefan Baumgartner , Oliver Lang , Mario Huemer

Deep neural networks achieve state-of-the-art performance for a range of classification and inference tasks. However, the use of stochastic gradient descent combined with the nonconvexity of the underlying optimization problems renders…

Machine Learning · Computer Science 2020-01-29 Ramina Ghods , Andrew S. Lan , Tom Goldstein , Christoph Studer

This study introduces a new normalization layer termed Batch Layer Normalization (BLN) to reduce the problem of internal covariate shift in deep neural network layers. As a combined version of batch and layer normalization, BLN adaptively…

Machine Learning · Computer Science 2023-01-16 Amir Ziaee , Erion Çano

In the linear minimum mean square error (LMMSE) estimation for orthogonal frequency division multiplexing (OFDM) systems, the problem about the determination of the algorithm's parameters, especially those related with channel frequency…

Signal Processing · Electrical Eng. & Systems 2021-07-13 Kai Mei , Jun Liu , Xiaoran Liu , Jun Xiong , Xiaoying Zhang , Jibo Wei

In this work, we propose a new training method for finding minimum weight norm solutions in over-parameterized neural networks (NNs). This method seeks to improve training speed and generalization performance by framing NN training as a…

Machine Learning · Statistics 2018-06-22 Yamini Bansal , Madhu Advani , David D Cox , Andrew M Saxe

Training neural networks (NNs) using combinatorial optimization solvers has gained attention in recent years. In low-data settings, state-of-the-art mixed integer linear programming solvers can train exactly a NN, avoiding intensive…

Optimization and Control · Mathematics 2024-09-12 Ambrogio Maria Bernardelli , Stefano Gualandi , Hoong Chuin Lau , Simone Milanesi , Neil Yorke-Smith

State-of-the-art methods for solving smooth optimization problems are nonlinear conjugate gradient, low memory BFGS, and Majorize-Minimize (MM) subspace algorithms. The MM subspace algorithm which has been introduced more recently has shown…

Optimization and Control · Mathematics 2016-08-24 Emilie Chouzenoux , Jean-Christophe Pesquet

This paper deals with the implementation of Least Mean Square (LMS) algorithm in Decision Feedback Equalizer (DFE) for removal of Inter Symbol Interference (ISI) at the receiver. The channel disrupts the transmitted signal by spreading it…

Artificial Intelligence · Computer Science 2012-08-13 Mohammad Havaei , Nandivada Krishna Prasad , Velleshala Sudheer

In this paper we propose a smoothing turbo equalizer based on the expectation propagation (EP) algorithm with quite improved performance compared to the Kalman smoother, at similar complexity. In scenarios where high-order modulations…

Signal Processing · Electrical Eng. & Systems 2019-02-05 Irene Santos , Juan José Murillo-Fuentes , Eva Arias-de-Reyna

The nuclear norm minimization (NNM) is commonly used to approximate the matrix rank by shrinking all singular values equally. However, the singular values have clear physical meanings in many practical problems, and NNM may not be able to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Zhiyuan Zha , Bihan Wen , Jiachao Zhang , Jiantao Zhou , Ce Zhu

Machine learning (ML) starts to be widely used to enhance the performance of multi-user multiple-input multiple-output (MU-MIMO) receivers. However, it is still unclear if such methods are truly competitive with respect to conventional…

Information Theory · Computer Science 2021-07-01 Mathieu Goutay , Fayçal Ait Aoudia , Jakob Hoydis , Jean-Marie Gorce

Linear minimum mean square error (MMSE) detector has been shown to alleviate the noise amplification problem, resulting in the conventional zero-forcing (ZF) detector. In this paper, we analyze the performance improvement by the MMSE…

Information Theory · Computer Science 2009-12-10 Manar Mohaisen , KyungHi Chang

Recently, it was demonstrated in [CS2012,CS2013] that the robustness of the classical Non-Local Means (NLM) algorithm [BCM2005] can be improved by incorporating $\ell^p (0 < p \leq 2)$ regression into the NLM framework. This general…

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Kunal N. Chaudhury

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

Baseband processing algorithms often require knowledge of the noise power, signal power, or signal-to-noise ratio (SNR). In practice, these parameters are typically unknown and must be estimated. Furthermore, the mean-square error (MSE) is…

Signal Processing · Electrical Eng. & Systems 2023-03-28 Alexandra Gallyas-Sanhueza , Christoph Studer

Conventional uplink equalization in massive MIMO systems relies on a centralized baseband processing architecture. However, as the number of base station antennas increases, centralized baseband processing architectures encounter two…

Signal Processing · Electrical Eng. & Systems 2021-06-24 Xiaotong Zhao , Xin Guan , Mian Li , Qingjiang Shi

In many estimation problems, e.g. linear and logistic regression, we wish to minimize an unknown objective given only unbiased samples of the objective function. Furthermore, we aim to achieve this using as few samples as possible. In the…

Machine Learning · Statistics 2015-02-26 Roy Frostig , Rong Ge , Sham M. Kakade , Aaron Sidford

Random classical codes have good error correcting properties, and yet they are notoriously hard to decode in practice. Despite many decades of extensive study, the fastest known algorithms still run in exponential time. The Learning Parity…

Quantum Physics · Physics 2025-04-16 Alexander Poremba , Yihui Quek , Peter Shor

In this paper, based on the limited memory techniques and subspace minimization conjugate gradient (SMCG) methods, a regularized limited memory subspace minimization conjugate gradient method is proposed, which contains two types of…

Optimization and Control · Mathematics 2023-01-10 Wumei Sun , Hongwei Liu , Zexian Liu