English
Related papers

Related papers: Diffusion Leaky Zero Attracting Least Mean Square …

200 papers

Sparse signal recovery problems from noisy linear measurements appear in many areas of wireless communications. In recent years, deep learning (DL) based approaches have attracted interests of researchers to solve the sparse linear inverse…

Signal Processing · Electrical Eng. & Systems 2021-01-28 Wei Chen , Bowen Zhang , Shi Jin , Bo Ai , Zhangdui Zhong

In this paper, we introduce a new algorithm to deal with the stalling effect in the LMS algorithm used in adaptive filters. We modify the update rule of the tap weight vectors by adding noise, generated by a noise generator. The properties…

Signal Processing · Electrical Eng. & Systems 2018-07-20 Hamid Reza Shahdoosti

We attempt to answer the question what data brings adaptive diffusion algorithms converging to true parameters. The discussion begins with the diffusion recursive least squares (RLS). When unknown parameters are scalar, the necessary and…

Optimization and Control · Mathematics 2018-10-02 Zhaobo Liu , Chanying Li

In this technical report we analyse the performance of diffusion strategies applied to the Least-Mean-Square adaptive filter. We configure a network of cooperative agents running adaptive filters and discuss their behaviour when compared…

Machine Learning · Computer Science 2014-02-21 Jonathan Gelati , Sithan Kanna

We study the effect of fading in the communication channels between nodes on the performance of the incremental least mean square (ILMS) algorithm. We derive steady-state performance metrics, including the mean-square deviation (MSD),…

Systems and Control · Computer Science 2015-08-11 Azam Khalili , Amir Rastegarnia

The least-absolute shrinkage and selection operator (LASSO) is a regularization technique for estimating sparse signals of interest emerging in various applications and can be efficiently solved via the alternating direction method of…

Information Theory · Computer Science 2022-08-25 Huiyue Yi , Yan Xu , Wuxiong Zhang , Hui Xu

Some system identification problems impose nonnegativity constraints on the parameters to estimate due to inherent physical characteristics of the unknown system. The nonnegative least-mean-square (NNLMS) algorithm and its variants allow to…

Numerical Analysis · Computer Science 2015-08-25 Jingen Ni , Jian Yang , Jie Chen , Cédric Richard , José Carlos M. Bermudez

In recent years, the multitask diffusion least mean square (MD-LMS) algorithm has been extensively applied in the distributed parameter estimation and target tracking of multitask network. However, its performance is mainly limited by two…

Signal Processing · Electrical Eng. & Systems 2022-10-21 Wenjing Xu , Haiquan Zhao , Shaohui Lv

A distributed algorithm for least mean square (LMS) can be used in distributed signal estimation and in distributed training for multivariate regression models. The convergence speed of an algorithm is a critical factor because a faster…

Information Theory · Computer Science 2020-11-25 Tadashi Wadayama , Satoshi Takabe

Despite the recent visually-pleasing results achieved, the massive computational cost has been a long-standing flaw for diffusion probabilistic models (DPMs), which, in turn, greatly limits their applications on resource-limited platforms.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Xingyi Yang , Daquan Zhou , Jiashi Feng , Xinchao Wang

The present study proposes incorporating non-parametric knowledge into the diffusion least-mean-squares algorithm in the framework of a maximum a posteriori (MAP) estimation. The proposed algorithm leads to a robust estimation of an unknown…

Machine Learning · Computer Science 2023-12-05 Soheil Ashkezari-Toussi , Hadi sadoghi-Yazdi

Label distribution learning (LDL) trains a model to predict the relevance of a set of labels (called label distribution (LD)) to an instance. The previous LDL methods all assumed the LDs of the training instances are accurate. However,…

Machine Learning · Computer Science 2023-08-29 Zhiqiang Kou , Yuheng Jia , Jing Wang , Xin Geng

This work presents joint iterative power allocation and interference suppression algorithms for DS-CDMA networks which employ multiple relays and the amplify and forward cooperation strategy. We propose a joint constrained optimization…

Information Theory · Computer Science 2013-04-10 R. C. de Lamare , S. Li

In this paper, we propose a new greedy algorithm for sparse approximation, called SLS for Single L_1 Selection. SLS essentially consists of a greedy forward strategy, where the selection rule of a new component at each iteration is based on…

Optimization and Control · Mathematics 2021-02-12 Ramzi Ben Mhenni , Sébastien Bourguignon , Jérôme Idier

We study the performance of centralized least mean-squares (CLMS) algorithms in wireless sensor networks where nodes transmit their data over fading channels to a central processing unit (e.g., fusion center or cluster head), for parameter…

Systems and Control · Computer Science 2016-11-18 Reza Abdolee , Benoit Champagne

In this paper we consider the issue of reliability of measurements in distributed adaptive estimation problem. To this aim, we assume a sensor network with different observation noise variance among the sensors and propose new estimation…

Systems and Control · Computer Science 2015-07-27 Wael M. Bazzi , Amir Rastegarnia , Azam Khalili

We propose two sparsity-aware normalized subband adaptive filter (NSAF) algorithms by using the gradient descent method to minimize a combination of the original NSAF cost function and the l1-norm penalty function on the filter…

Signal Processing · Electrical Eng. & Systems 2018-10-18 Y. Yu , H. Zhao , R. C. de Lamare

Channel estimation problem is one of the key technical issues in time-variant multiple-input single-output (MSIO) communication systems. To estimate the MISO channel, least mean square (LMS) algorithm is applied to adaptive channel…

Information Theory · Computer Science 2013-02-07 Guan Gui , Wei Peng , Abolfazl Mehbodniya , Fumiyuki Adachi

Despite the efficacy of network sparsity in alleviating the deployment strain of Large Language Models (LLMs), it endures significant performance degradation. Applying Low-Rank Adaptation (LoRA) to fine-tune the sparse LLMs offers an…

Machine Learning · Computer Science 2025-02-21 Weizhong Huang , Yuxin Zhang , Xiawu Zheng , Yang Liu , Jing Lin , Yiwu Yao , Rongrong Ji

Limited by fixed step-size and sparsity penalty factor, the conventional sparsity-aware normalized subband adaptive filtering (NSAF) type algorithms suffer from trade-off requirements of high filtering accurateness and quicker convergence…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Dongxu Liu , Haiquan Zhao , Yang Zhou