English
Related papers

Related papers: Deep Layered LMS Predictor

200 papers

Traditional recursive least square (RLS) adaptive filtering is widely used to estimate the impulse responses (IR) of an unknown system. Nevertheless, the RLS estimator shows poor performance when tracking rapidly time-varying systems. In…

Signal Processing · Electrical Eng. & Systems 2021-10-25 Mohammad Towliat , Zheng Guo , Leonard J. Cimini , Xiang-Gen Xia , Aijun Song

The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a…

Machine Learning · Statistics 2013-11-01 Jie Chen , Wei Gao , Cédric Richard , Jose-Carlos M. Bermudez

Developing efficient methods for solving parametric partial differential equations is crucial for addressing inverse problems. This work introduces a Least-Squares-based Neural Network (LS-Net) method for solving linear parametric PDEs. It…

Numerical Analysis · Mathematics 2025-02-13 Shima Baharlouei , Jamie M. Taylor , Carlos Uriarte , David Pardo

The kernel least mean squares (KLMS) algorithm is a computationally efficient nonlinear adaptive filtering method that "kernelizes" the celebrated (linear) least mean squares algorithm. We demonstrate that the least mean squares algorithm…

Machine Learning · Statistics 2013-10-22 Il Memming Park , Sohan Seth , Steven Van Vaerenbergh

A distributed adaptive algorithm is proposed to solve a node-specific parameter estimation problem where nodes are interested in estimating parameters of local interest, parameters of common interest to a subset of nodes and parameters of…

Computers and Society · Computer Science 2023-07-19 Jorge Plata-Chaves , Nikola Bogdanovic , Kostas Berberidis

In this paper, we present a diffusion multi-rate least-mean-square (LMS) algorithm, named DMLMS, which is an effective solution for distributed estimation when two or more observation sequences are available with different sampling rates.…

Systems and Control · Computer Science 2020-03-31 Lu Lu , Xiaomin Yang , Rongzhu Zhang

Neural networks with at least two hidden layers are called deep networks. Recent developments in AI and computer programming in general has led to development of tools such as Tensorflow, Keras, NumPy etc. making it easier to model and draw…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Ruthvik Vaila , Denver Lloyd , Kevin Tetz

This paper introduces a novel adaptive framework for processing dynamic flow signals over simplicial complexes, extending classical least-mean-squares (LMS) methods to high-order topological domains. Building on discrete Hodge theory, we…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Lorenzo Marinucci , Claudio Battiloro , Paolo Di Lorenzo

In this work, we study the problem of non-blind image deconvolution and propose a novel recurrent network architecture that leads to very competitive restoration results of high image quality. Motivated by the computational efficiency and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Iaroslav Koshelev , Daniil Selikhanovych , Stamatios Lefkimmiatis

A distributed adaptive algorithm is proposed to solve a node-specific parameter estimation problem where nodes are interested in estimating parameters of local interest and parameters of global interest to the whole network. To address the…

Systems and Control · Computer Science 2014-07-02 Nikola Bogdanović , Jorge Plata-Chaves , Kostas Berberidis

Differentiable optimization layers are traditionally integrated in predict-then-optimize frameworks where a neural model estimates parameters that subsequently serve as fixed inputs to downstream decision-making optimization problems. In…

Machine Learning · Computer Science 2026-05-19 David Troxell , Noah Roemer , Guido Montúfar

Neural networks are predominantly trained using gradient-based methods, yet in many applications their final predictions remain far from the accuracy attainable within the model's expressive capacity. We introduce Linearized Subspace…

Machine Learning · Computer Science 2026-01-21 Wenbo Cao , Weiwei Zhang

Proposed in 1991, Least Mean Square Error Reconstruction for self-organizing network, shortly Lmser, was a further development of the traditional auto-encoder (AE) by folding the architecture with respect to the central coding layer and…

Machine Learning · Computer Science 2019-04-15 Wenjing Huang , Shikui Tu , Lei Xu

We present a neural network based predictor which is derived by starting from the linear minimum mean squared error (LMMSE) predictor and by further making two key assumptions. With these assumptions, we first derive a weighted sum of LMMSE…

Information Theory · Computer Science 2019-11-19 Nurettin Turan , Wolfgang Utschick

The least mean-square (LMS) filter is one of the most common adaptive linear estimation algorithms. In many practical scenarios, and particularly in digital communications systems, the signal of interest (SOI) and the input signal are…

Systems and Control · Computer Science 2018-11-28 Nir Shlezinger , Koby Todros

We consider multi-antenna wireless systems aided by large intelligent surfaces (LIS). LIS presents a new physical layer technology for improving coverage and energy efficiency by intelligently controlling the propagation environment. In…

Signal Processing · Electrical Eng. & Systems 2020-11-17 Neel Kanth Kundu , Matthew R. McKay

There is some theoretical evidence that deep neural networks with multiple hidden layers have a potential for more efficient representation of multidimensional mappings than shallow networks with a single hidden layer. The question is…

Machine Learning · Computer Science 2019-10-08 Bernhard Bermeitinger , Tomas Hrycej , Siegfried Handschuh

This letter presents the first work introducing a deep learning (DL) framework for channel estimation in large intelligent surface (LIS) assisted massive MIMO (multiple-input multiple-output) systems. A twin convolutional neural network…

Signal Processing · Electrical Eng. & Systems 2020-09-11 Ahmet M. Elbir , A Papazafeiropoulos , P. Kourtessis , S. Chatzinotas

Over the past decade, deep learning has proven to be a highly effective tool for learning meaningful features from raw data. However, it remains an open question how deep networks perform hierarchical feature learning across layers. In this…

Machine Learning · Computer Science 2025-11-17 Peng Wang , Xiao Li , Can Yaras , Zhihui Zhu , Laura Balzano , Wei Hu , Qing Qu

In this paper, a novel diffusion estimation algorithm is proposed from a probabilistic perspective by combining diffusion strategy and the probabilistic least-mean-squares (PLMS) at all agents. The proposed method diffusion probabilistic…

Signal Processing · Electrical Eng. & Systems 2019-08-27 Sihai Guan , Chun Meng , Bharat Biswal