English
Related papers

Related papers: On the Mean-Square Performance of the Constrained …

200 papers

The purpose of this paper is to indicate that the recently proposed Momentum fractional least mean squares (mFLMS) algorithm has some serious flaws in its design and analysis. Our apprehensions are based on the evidence we found in the…

Optimization and Control · Mathematics 2018-05-22 Shujaat Khan , Imran Naseem , Alishba Sadiq , Jawwad Ahmad , Muhammad Moinuddin

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Statistics Theory · Mathematics 2018-10-16 Michael Krikheli , Amir Leshem

The online prediction of multivariate signals, existing simultaneously in space and time, from noisy partial observations is a fundamental task in numerous applications. We propose an efficient Neural Network architecture for the online…

Machine Learning · Computer Science 2024-01-30 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

Least squares approximation is a technique to find an approximate solution to a system of linear equations that has no exact solution. In a typical setting, one lets $n$ be the number of constraints and $d$ be the number of variables, with…

Data Structures and Algorithms · Computer Science 2010-09-28 Petros Drineas , Michael W. Mahoney , S. Muthukrishnan , Tamas Sarlos

Channel state information (CSI) is very crucial for any wireless communication systems. Typically, CSI can be characterized at the receiver side using channel impulse response (CIR). Many observations have shown that the CIR of broadband…

Signal Processing · Electrical Eng. & Systems 2018-12-12 Ahmed M. Abd El-Moaty , Azzedine Zerguine

We study the effect of fading in the communication channels between sensor nodes on the performance of the incremental least mean square (ILMS) algorithm, and derive steady state performance metrics, including the mean-square deviation…

Information Theory · Computer Science 2015-09-10 Azam Khalili , Amir Rastegarnia

This paper proposes a novel adaptive reduced-rank filtering scheme based on the joint iterative optimization of adaptive filters. The proposed scheme consists of a joint iterative optimization of a bank of full-rank adaptive filters that…

Information Theory · Computer Science 2013-05-29 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

The least squares method provides the best-fit curve by minimizing the total squares error. In this work, we provide the modified least squares method based on the fractional orthogonal polynomials that belong to the space $M_{n}^{\lambda}…

Numerical Analysis · Mathematics 2024-05-02 Abhishek Kumar Singh , Mani Mehra , Anatoly A. Alikhanov

We develop a Recursive $\mathcal{L}_1$-Regularized Least Squares (SPARLS) algorithm for the estimation of a sparse tap-weight vector in the adaptive filtering setting. The SPARLS algorithm exploits noisy observations of the tap-weight…

Information Theory · Computer Science 2009-01-08 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh

This work presents joint iterative power allocation and interference suppression algorithms for DS-CDMA networks which employ multiple relays and the amplify and forward cooperation strategy. We propose a joint constrained optimization…

Information Theory · Computer Science 2013-04-10 R. C. de Lamare , S. Li

This paper generalizes the proportionate-type adaptive algorithm to the graph signal processing and proposes two proportionate-type adaptive graph signal recovery algorithms. The gain matrix of the proportionate algorithm leads to faster…

Signal Processing · Electrical Eng. & Systems 2022-09-21 Razieh Torkamani , Hadi Zayyani , Mehdi Korki

This paper presents a new approach to solve linear and nonlinear model predictive control (MPC) problems that requires small memory footprint and throughput and is particularly suitable when the model and/or controller parameters change at…

Optimization and Control · Mathematics 2021-03-25 Nilay Saraf , Alberto Bemporad

The convergence analysis for least-squares finite element methods led to various adaptive mesh-refinement strategies: Collective marking algorithms driven by the built-in a posteriori error estimator or an alternative explicit…

Numerical Analysis · Mathematics 2023-09-18 Philipp Bringmann

The least squares (LS) estimator and the best linear unbiased estimator (BLUE) are two well-studied approaches for the estimation of a deterministic but unknown parameter vector. In many applications it is known that the parameter vector…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Mario Huemer , Markus Steindl

Wave equation techniques have been an integral part of geophysical imaging workflows to investigate the Earth's subsurface. Least-squares reverse time migration (LSRTM) is a linearized inversion problem that iteratively minimizes a misfit…

Computational Physics · Physics 2019-12-11 Janaki Vamaraju , Jeremy Vila , Mauricio Araya-Polo , Debanjan Datta , Mohamed Sidahmed , Mrinal Sen

There is a need to improve the capability of the adaptive filtering algorithm against Gaussian or multiple types of non-Gaussian noises, time-varying system, and systems with low SNR. In this paper, we propose an optimized least mean…

Signal Processing · Electrical Eng. & Systems 2019-08-23 Sihai Guan , Chun Meng , Bharat Biswal

Simplicial-simplicial regression refers to the regression setting where both the responses and predictor variables lie within the simplex space, i.e. they are compositional. For this setting, constrained least squares, where the regression…

Methodology · Statistics 2024-12-24 Michail Tsagris

This paper proposes a new leaky least mean square (leaky LMS, LLMS) algorithm in which a norm penalty is introduced to force the solution to be sparse in the application of system identification. The leaky LMS algorithm is derived because…

Systems and Control · Computer Science 2015-03-05 Yong Feng , Rui Zeng , Jiasong Wu

In this paper, we investigate the impact of compression on stochastic gradient algorithms for machine learning, a technique widely used in distributed and federated learning. We underline differences in terms of convergence rates between…

Machine Learning · Computer Science 2025-07-25 Constantin Philippenko , Aymeric Dieuleveut

We propose an algorithm to restrict the switching signals of a constrained switched system in order to guarantee its stability, while at the same time attempting to keep the largest possible set of allowed switching signals. Our work is…

Optimization and Control · Mathematics 2018-09-11 Cláudio Gomes , Raphaël M. Jungers , Benoît Legat , Hans Vangheluwe