English
Related papers

Related papers: Statistical Analysis of the LMS Algorithm for Prop…

200 papers

In this research, a novel adaptive filtering algorithm is proposed for complex domain signal processing. The proposed algorithm is based on Wirtinger calculus and is called as q-Complex Least Mean Square (q-CLMS) algorithm. The proposed…

Information Theory · Computer Science 2021-10-12 Alishba Sadiq , Imran Naseem , Shujaat Khan , Muhammad Moinuddin , Roberto Togneri , Mohammed Bennamoun

We consider the problem of mixed linear regression (MLR), where each observed sample belongs to one of $K$ unknown linear models. In practical applications, the proportions of the $K$ components are often imbalanced. Unfortunately, most MLR…

Machine Learning · Statistics 2023-01-31 Pini Zilber , Boaz Nadler

We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic…

Machine Learning · Computer Science 2020-06-11 Silvan Melchior , Sebastian Curi , Felix Berkenkamp , Andreas Krause

In this paper, an algorithm for estimation and compensation of second-order nonlinearity in wireless sensor setwork (WSN) in distributed estimation framework is proposed. First, the effect of second-order nonlinearity on the performance of…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Hadi Zayyani , Mehdi Korki

A unified linear algebraic approach to adaptive signal processing (ASP) is presented. Starting from just Ax=b, key ASP algorithms are derived in a simple, systematic, and integrated manner without requiring any background knowledge to the…

Systems and Control · Computer Science 2015-04-24 Muhammad Ali Raza Anjum

Various versions of the Dynamical Systems Method (DSM) are proposed for solving linear ill-posed problems with bounded and unbounded operators. Convergence of the proposed methods is proved. Some new results concerning discrepancy principle…

Numerical Analysis · Mathematics 2007-05-23 A. G. Ramm

The Adaptive Multilevel Splitting (AMS) algorithm is a powerful and versatile method for the simulation of rare events. It is based on an interacting (via a mutation-selection procedure) system of replicas, and depends on two integer…

Probability · Mathematics 2015-02-25 Charles-Edouard Bréhier

This work presents a new variation of the commonly used Least Mean Squares Algorithm (LMS) for the identification of sparse signals with an a-priori known sparsity using a hard threshold operator in every iteration. It examines some useful…

Systems and Control · Computer Science 2016-08-04 Lampros Flokas , Petros Maragos

We develop a new model selection method for the adaptive robust efficient nonparametric signal estimation observed with impulse noise which is defined by the general non Gaussian L\'evy processes. On the basis of the developed method, we…

Statistics Theory · Mathematics 2018-11-27 Slim Beltaief , Oleg Chernoyarov , Serguei Pergamenchtchikov

In this paper, we introduce a new algorithm to deal with the stalling effect in the LMS algorithm used in adaptive filters. We modify the update rule of the tap weight vectors by adding noise, generated by a noise generator. The properties…

Signal Processing · Electrical Eng. & Systems 2018-07-20 Hamid Reza Shahdoosti

Anomaly detection is the task of detecting data which differs from the normal behaviour of a system in a given context. In order to approach this problem, data-driven models can be learned to predict current or future observations.…

Machine Learning · Computer Science 2020-10-30 Benedikt Eiteneuer , Oliver Niggemann

In this work, we are interested in adaptive and distributed estimation of graph filters from streaming data. We formulate this problem as a consensus estimation problem over graphs, which can be addressed with diffusion LMS strategies. Most…

Signal Processing · Electrical Eng. & Systems 2019-12-13 Fei Hua , Roula Nassif , Cédric Richard , Haiyan Wang , Ali H. Sayed

A major limitation of machine learning (ML) prediction models is that they recover associational, rather than causal, predictive relationships between variables. In high-stakes automation applications of ML this is problematic, as the model…

Machine Learning · Computer Science 2025-11-04 Jianqiao Mao , Max A. Little

In real-time applications the characteristics and properties of a signal vary inconsistently. So, to maintain the integrity of such signals there is a need for effective adaptive filters. The conventional Least Mean Squared(LMS) algorithm…

Signal Processing · Electrical Eng. & Systems 2021-12-01 R Sankara Prasad

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

A fundamental problem in modern supervised learning is computing reliable conditional prediction intervals in high-dimensional settings: existing methods often rely on restrictive modelling assumptions, do not scale as predictor dimension…

Machine Learning · Statistics 2026-02-24 Daniel Salnikov , Dan Leonte , Kevin Michalewicz

Linear mixed models (LMMs) are used as an important tool in the data analysis of repeated measures and longitudinal studies. The most common form of LMMs utilize a normal distribution to model the random effects. Such assumptions can often…

Methodology · Statistics 2016-02-16 Hien D. Nguyen , Geoffrey J. McLachlan

The online prediction of multivariate signals, existing simultaneously in space and time, from noisy partial observations is a fundamental task in numerous applications. We propose an efficient Neural Network architecture for the online…

Machine Learning · Computer Science 2024-01-30 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

A distributed adaptive algorithm is proposed to solve a node-specific parameter estimation problem where nodes are interested in estimating parameters of local interest and parameters of global interest to the whole network. To address the…

Systems and Control · Computer Science 2014-07-02 Nikola Bogdanović , Jorge Plata-Chaves , Kostas Berberidis

A framework of online adaptive statistical compressed sensing is introduced for signals following a mixture model. The scheme first uses non-adaptive measurements, from which an online decoding scheme estimates the model selection. As soon…

Computer Vision and Pattern Recognition · Computer Science 2011-12-30 Julio Duarte-Carvajalino , Guillermo Sapiro , Guoshen Yu , Lawrence Carin