English
Related papers

Related papers: Interference-Normalised Least Mean Square Algorith…

200 papers

In this paper, we propose a novel leaky least mean square (leaky LMS, LLMS) algorithm which employs a p-norm-like constraint to force the solution to be sparse in the application of system identification. As an extension of the LMS…

Systems and Control · Computer Science 2015-03-06 Yong Feng , Rui Zeng , Jiasong Wu

Iteratively reweighted least square (IRLS) is a popular approach to solve sparsity-enforcing regression problems in machine learning. State of the art approaches are more efficient but typically rely on specific coordinate pruning schemes.…

Machine Learning · Statistics 2022-10-03 Clarice Poon , Gabriel Peyré

In recent years, the Deep Learning Alternating Minimization (DLAM), which is actually the alternating minimization applied to the penalty form of the deep neutral networks training, has been developed as an alternative algorithm to overcome…

Machine Learning · Computer Science 2021-02-02 Linbo Qiao , Tao Sun , Hengyue Pan , Dongsheng Li

We investigate the potential of adaptive equalization techniques to mitigate inter-channel nonlinear interference noise (NLIN). We derive a lower bound on the mutual information of a system using adaptive equalization, showing that the…

Signal Processing · Electrical Eng. & Systems 2017-10-03 Ori Golani , Meir Feder , Mark Shtaif

This paper presents adaptive bidirectional minimum mean-square error parameter estimation algorithms for fast-fading channels. The time correlation between successive channel gains is exploited to improve the estimation and tracking…

Information Theory · Computer Science 2015-10-14 P. Clarke , R. C. de Lamare

We introduce a novel semi-supervised version of the least squares classifier. This implicitly constrained least squares (ICLS) classifier minimizes the squared loss on the labeled data among the set of parameters implied by all possible…

Machine Learning · Statistics 2015-07-27 Jesse H. Krijthe , Marco Loog

This work proposes a general learned proximal alternating minimization algorithm, LPAM, for solving learnable two-block nonsmooth and nonconvex optimization problems. We tackle the nonsmoothness by an appropriate smoothing technique with…

Optimization and Control · Mathematics 2026-03-10 Yunmei Chen , Lezhi Liu , Lei Zhang

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

This paper presents a normalization mechanism called Instance-Level Meta Normalization (ILM~Norm) to address a learning-to-normalize problem. ILM~Norm learns to predict the normalization parameters via both the feature feed-forward and the…

Machine Learning · Computer Science 2019-04-09 Songhao Jia , Ding-Jie Chen , Hwann-Tzong Chen

A new Lp-norm constraint least mean square (Lp-LMS) algorithm with new strategy of varying p is presented, which is applied to system identification in this letter. The parameter p is iteratively adjusted by the gradient method applied to…

Systems and Control · Computer Science 2016-03-31 Yong Feng , Fei Chen , Jiasong Wu

The robustness of the kernel recursive least square (KRLS) algorithm has recently been improved by combining them with more robust information-theoretic learning criteria, such as minimum error entropy (MEE) and generalized MEE (GMEE),…

Information Theory · Computer Science 2023-09-07 Jiacheng He , Gang Wang , Kun Zhang , Shan Zhong , Bei Peng

Broadband signal transmission over frequency-selective fading channel often requires accurate channel state information at receiver. One of the most attracting adaptive channel estimation methods is least mean square (LMS) algorithm.…

Information Theory · Computer Science 2013-04-16 Guan Gui , Abolfazl Mehbodniya , Fumiyuki Adachi

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

Machine Learning · Computer Science 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

Statistics Theory · Mathematics 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

In linear regression, the least squares (LS) estimator has certain optimality properties if the errors are normally distributed. This assumption is often violated in practice, partly caused by data outliers. Robust estimators can cope with…

Methodology · Statistics 2020-07-01 Sukru Acitas , Peter Filzmoser , Birdal Senoglu

For solving a wide class of nonconvex and nonsmooth problems, we propose a proximal linearized iteratively reweighted least squares (PL-IRLS) algorithm. We first approximate the original problem by smoothing methods, and second write the…

Optimization and Control · Mathematics 2016-11-02 Hui Zhang , Tao Sun , Lizhi Cheng

We study and introduce new gradient operators in the complex and bicomplex settings, inspired from the well-known Least Mean Square (LMS) algorithm invented in 1960 by Widrow and Hoff for Adaptive Linear Neuron (ADALINE). These gradient…

Machine Learning · Computer Science 2023-12-25 Daniel Alpay , Kamal Diki , Mihaela Vajiac

Iteratively reweighted least squares (IRLS) is a widely-used method in machine learning to estimate the parameters in the generalised linear models. In particular, IRLS for L1 minimisation under the linear model provides a closed-form…

Cryptography and Security · Computer Science 2016-05-25 Mijung Park , Max Welling

Reconfigurable intelligent surface (RIS) has become a promising technology for enhancing the reliability of wireless communications, which is capable of reflecting the desired signals through appropriate phase shifts. However, the intended…

Signal Processing · Electrical Eng. & Systems 2021-03-03 Bo Yang , Xuelin Cao , Chongwen Huang , Chau Yuen , Lijun Qian , Marco Di Renzo

To keep massive MIMO systems cost-efficient, power amplifiers with rather small output dynamic ranges are employed. They may distort the transmit signal and degrade the performance. This paper proposes a distortion aware precoding scheme…

Signal Processing · Electrical Eng. & Systems 2019-05-15 Ali Bereyhi , Saba Asaad , Ralf R. Müller , Symeon Chatzinotas