English
Related papers

Related papers: Steady-state performance of non-negative least-mea…

200 papers

Partial diffusion scheme is an effective method for reducing computational load and power consumption in adaptive network implementation. The Information is exchanged among the nodes, usually over noisy links. In this paper, we consider a…

Systems and Control · Computer Science 2015-12-01 Vahid Vadidpour , Amir Rastegarnia , Azam Khalili , Saeid Sanei

Classical state estimation algorithms rely on predefined target's state-space model, which complicates model derivation and limits adaptability when system dynamics change. Neural network based estimators offer a data-driven alternative,…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Minxing Sun , Li Miao , Qingyu Shen , Yao Mao , Qiliang Bao

Most studies of adaptive algorithm behavior consider performance measures based on mean values such as the mean-square error. The derived models are useful for understanding the algorithm behavior under different environments and can be…

Methodology · Statistics 2023-12-04 Marcos H. Maruo , José Carlos M. Bermudez

The least trimmed squares (LTS) estimator is a renowned robust alternative to the classic least squares estimator and is popular in location, regression, machine learning, and AI literature. Many studies exist on LTS, including its…

Machine Learning · Statistics 2025-01-10 Yijun Zuo

In large-scale data processing scenarios, data often arrive in sequential streams generated by complex systems that exhibit drifting distributions and time-varying system parameters. This nonstationarity challenges theoretical analysis, as…

Machine Learning · Computer Science 2026-02-13 Yifei Jin , Xin Zheng , Lei Guo

To estimate multiple-input multiple-output (MIMO) channels, invariable step-size normalized least mean square (ISSNLMS) algorithm was applied to adaptive channel estimation (ACE). Since the MIMO channel is often described by sparse channel…

Information Theory · Computer Science 2014-07-24 Guan Gui , Li Xu , Lin Shan , Fumiyuki Adachi

Recently, the leaky diffusion least-mean-square (DLMS) algorithm has obtained much attention because of its good performance for high input eigenvalue spread and low signal-to-noise ratio (SNR). However, the leaky DLMS algorithm may suffer…

Signal Processing · Electrical Eng. & Systems 2018-11-01 Long Shi , Haiquan Zhao

The online prediction of multivariate signals, existing simultaneously in space and time, from noisy partial observations is a fundamental task in numerous applications. We propose an efficient Neural Network architecture for the online…

Machine Learning · Computer Science 2024-01-30 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

This paper presents a method for jointly estimating the state, input, and parameters of linear systems in an online fashion. The method is specially designed for measurements that are corrupted with non-Gaussian noise or outliers, which are…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Jean-Sébastien Brouillon , Keith Moffat , Florian Dörfler , Giancarlo Ferrari-Trecate

There is a need to improve the capability of the adaptive filtering algorithm against Gaussian or multiple types of non-Gaussian noises, time-varying system, and systems with low SNR. In this paper, we propose an optimized least mean…

Signal Processing · Electrical Eng. & Systems 2019-08-23 Sihai Guan , Chun Meng , Bharat Biswal

The Mean Square Error (MSE) is commonly utilized to estimate the solution of the optimal value function in the vast majority of offline reinforcement learning (RL) models and has achieved outstanding performance. However, we find that its…

Machine Learning · Computer Science 2024-06-06 Yu Zhang , Rui Yu , Zhipeng Yao , Wenyuan Zhang , Jun Wang , Liming Zhang

In this letter, we investigate the shrinkage problem for the non-local means (NLM) image denoising. In particular, we derive the closed-form of the optimal blockwise shrinkage for NLM that minimizes the Stein's unbiased risk estimator…

Computer Vision and Pattern Recognition · Computer Science 2015-05-05 Yue Wu , Brian Tracey , Premkumar Natarajan , Joseph P. Noonan

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

Supervised learning by extreme learning machines resp. neural networks with random weights is studied under a non-stationary spatial-temporal sampling design which especially addresses settings where an autonomous object moving in a…

Machine Learning · Statistics 2021-09-02 Ansgar Steland

We study the problem of distributed adaptive estimation over networks where nodes cooperate to estimate physical parameters that can vary over both space and time domains. We use a set of basis functions to characterize the space-varying…

Systems and Control · Computer Science 2015-07-22 Reza Abdolee , Benoit Champagne , Ali H. Sayed

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

Information Theory · Computer Science 2016-09-06 Steffen Limmer , Sławomir Stańczak

This paper presents adaptive bidirectional minimum mean-square error (MMSE) parameter estimation algorithms for fast-fading channels. The time correlation between successive channel gains is exploited to improve the estimation and tracking…

Information Theory · Computer Science 2013-06-12 Patrick Clarke , Rodrigo C. de Lamare

Minimum mean square error (MMSE) estimation of block sparse signals from noisy linear measurements is considered. Unlike in the standard compressive sensing setup where the non-zero entries of the signal are independently and uniformly…

Information Theory · Computer Science 2012-04-26 Mikko Vehkaperä , Saikat Chatterjee , Mikael Skoglund

Structural equation models (SEMs) are widely used in sciences, ranging from economics to psychology, to uncover causal relationships underlying a complex system under consideration and estimate structural parameters of interest. We study…

Machine Learning · Statistics 2020-10-21 Luofeng Liao , You-Lin Chen , Zhuoran Yang , Bo Dai , Zhaoran Wang , Mladen Kolar

In this paper, we propose a sparse signal estimation algorithm that is suitable for many wireless communication systems, especially for the future millimeter wave and underwater communication systems. This algorithm is not only…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Lei Liu , Chau Yuen