English
Related papers

Related papers: A Diffusion Kernel LMS algorithm for nonlinear ada…

200 papers

An interference-normalised least mean square (INLMS) algorithm for robust adaptive filtering is proposed. The INLMS algorithm extends the gradient-adaptive learning rate approach to the case where the signals are non-stationary. In…

Systems and Control · Computer Science 2016-02-29 Jean-Marc Valin , Iain B. Collings

This paper presents adaptive link selection algorithms for distributed estimation and considers their application to wireless sensor networks and smart grids. In particular, exhaustive search--based least--mean--squares(LMS)/recursive least…

Systems and Control · Computer Science 2015-10-20 S. Xu , R. C. de Lamare , H. V. Poor

The diffusion least mean square (DLMS) and the diffusion normalized least mean square (DNLMS) algorithms are analyzed for a network having a fusion center. This structure reduces the dimensionality of the resulting stochastic models while…

Systems and Control · Electrical Eng. & Systems 2021-08-06 Eweda Eweda , Neil J. Bershad , Jose C. M. Bermudez

Recently, the leaky diffusion least-mean-square (DLMS) algorithm has obtained much attention because of its good performance for high input eigenvalue spread and low signal-to-noise ratio (SNR). However, the leaky DLMS algorithm may suffer…

Signal Processing · Electrical Eng. & Systems 2018-11-01 Long Shi , Haiquan Zhao

Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with…

Machine Learning · Computer Science 2017-08-29 R. C. de Lamare , André Flores

We consider the problem of learning a nonlinear function over a network of learners in a fully decentralized fashion. Online learning is additionally assumed, where every learner receives continuous streaming data locally. This learning…

Machine Learning · Computer Science 2021-03-01 Jeongmin Chae , Songnam Hong

We design a low complexity decentralized learning algorithm to train a recently proposed large neural network in distributed processing nodes (workers). We assume the communication network between the workers is synchronized and can be…

Machine Learning · Computer Science 2020-09-30 Xinyue Liang , Alireza M. Javid , Mikael Skoglund , Saikat Chatterjee

The purpose of this note is to discuss some aspects of recently proposed fractional-order variants of complex least mean square (CLMS) and normalized least mean square (NLMS) algorithms in ``Design of Fractional-order Variants of Complex…

Optimization and Control · Mathematics 2020-07-28 Shujaat Khan , Abdul Wahab , Imran Naseem , Muhammad Moinuddin

The multitask diffusion LMS is an efficient strategy to simultaneously infer, in a collaborative manner, multiple parameter vectors. Existing works on multitask problems assume that all agents respond to data synchronously. In several…

Systems and Control · Computer Science 2016-08-15 Roula Nassif , Cédric Richard , André Ferrari , Ali H. Sayed

We consider the problem of distributed dictionary learning, where a set of nodes is required to collectively learn a common dictionary from noisy measurements. This approach may be useful in several contexts including sensor networks.…

Machine Learning · Statistics 2013-04-15 Pierre Chainais , Cédric Richard

In order to improve the least mean squares (LMS) adaptation algorithm to accommodate the nonlinear transfer function, and to adjust the coefficients of adaptive filter during the actual implement of bias voltage and signal amplitude,…

Signal Processing · Electrical Eng. & Systems 2022-07-26 Zhengyang Zhang

To exploit the sparsity of the considered system, the diffusion proportionate-type least mean square (PtLMS) algorithms assign different gains to each tap in the convergence stage while the diffusion sparsity-constrained LMS (ScLMS)…

Information Theory · Computer Science 2017-03-27 Zongsheng Zheng , Zhigang Liu

Diffusion adaptation is a powerful strategy for distributed estimation and learning over networks. Motivated by the concept of combining adaptive filters, this work proposes a combination framework that aggregates the operation of multiple…

Signal Processing · Electrical Eng. & Systems 2020-02-11 Danqi Jin , Jie Chen , Cedric Richard , Jingdong Chen , Ali H. Sayed

Distributed learning is an effective way to analyze big data. In distributed regression, a typical approach is to divide the big data into multiple blocks, apply a base regression algorithm on each of them, and then simply average the…

Machine Learning · Computer Science 2017-08-08 Zhengchu Guo , Lei Shi , Qiang Wu

We study a distributed node-specific parameter estimation problem where each node in a wireless sensor network is interested in the simultaneous estimation of different vectors of parameters that can be of local interest, of common interest…

Systems and Control · Computer Science 2015-10-06 Jorge Plata-Chaves , Mohamad Hasan Bahari , Marc Moonen , Alexander Bertrand

This paper proposes distributed adaptive algorithms based on the conjugate gradient (CG) method and the diffusion strategy for parameter estimation over sensor networks. We present sparsity-aware conventional and modified distributed CG…

Information Theory · Computer Science 2015-11-23 Rodrigo C. de Lamare

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

We study the relationship between online Gaussian process (GP) regression and kernel least mean squares (KLMS) algorithms. While the latter have no capacity of storing the entire posterior distribution during online learning, we discover…

Machine Learning · Statistics 2016-09-13 Steven Van Vaerenbergh , Jesus Fernandez-Bes , Víctor Elvira

This paper presents distributed adaptive algorithms based on the conjugate gradient (CG) method for distributed networks. Both incremental and diffusion adaptive solutions are all considered. The distributed conventional (CG) and modified…

Information Theory · Computer Science 2013-06-19 Songcen Xu , Rodrigo C. de Lamare

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy between conditional distributions by drawing support from nonlinear kernel functions, thus it has been successfully used for pattern classification. However, CMMD does…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Chuan-Xian Ren , Pengfei Ge , Dao-Qing Dai , Hong Yan