English
Related papers

Related papers: A Unified Analysis Approach for LMS-based Variable…

200 papers

A distributed algorithm for least mean square (LMS) can be used in distributed signal estimation and in distributed training for multivariate regression models. The convergence speed of an algorithm is a critical factor because a faster…

Information Theory · Computer Science 2020-11-25 Tadashi Wadayama , Satoshi Takabe

With the rapid development of large language models (LLMs) and the growing demand for personalized content, recommendation systems have become critical in enhancing user experience and driving engagement. Collaborative filtering algorithms,…

Artificial Intelligence · Computer Science 2024-12-30 Haowei Yang , Longfei Yun , Jinghan Cao , Qingyi Lu , Yuming Tu

Diabetes Mellitus is a major health problem all over the world. Many classification algorithms have been applied for its diagnoses and treatment. In this paper, a hybrid algorithm of Modified-Particle Swarm Optimization and Least Squares-…

Computational Engineering, Finance, and Science · Computer Science 2014-05-06 Omar S. Soliman , Eman AboElhamd

We investigate the performance of distributed least-mean square (LMS) algorithms for parameter estimation over sensor networks where the regression data of each node are corrupted by white measurement noise. Under this condition, we show…

Systems and Control · Computer Science 2016-11-18 Reza Abdolee , Benoit Champagne

The robustness of the kernel recursive least square (KRLS) algorithm has recently been improved by combining them with more robust information-theoretic learning criteria, such as minimum error entropy (MEE) and generalized MEE (GMEE),…

Information Theory · Computer Science 2023-09-07 Jiacheng He , Gang Wang , Kun Zhang , Shan Zhong , Bei Peng

Solving an integer least squares (ILS) problem usually consists of two stages: reduction and search. This thesis is concerned with the reduction process for the ordinary ILS problem and the ellipsoid-constrained ILS problem. For the…

Optimization and Control · Mathematics 2015-03-17 Mazen Al Borno

Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering…

Information Retrieval · Computer Science 2021-10-28 Steffen Rendle , Walid Krichene , Li Zhang , Yehuda Koren

Least squares approximation is a technique to find an approximate solution to a system of linear equations that has no exact solution. In a typical setting, one lets $n$ be the number of constraints and $d$ be the number of variables, with…

Data Structures and Algorithms · Computer Science 2010-09-28 Petros Drineas , Michael W. Mahoney , S. Muthukrishnan , Tamas Sarlos

The newly proposed $l_1$ norm constraint zero-point attraction Least Mean Square algorithm (ZA-LMS) demonstrates excellent performance on exact sparse system identification. However, ZA-LMS has less advantage against standard LMS when the…

Information Theory · Computer Science 2013-03-12 Jian Jin , Qing Qu , Yuantao Gu

Recommender systems can change our life a lot and help us select suitable and favorite items much more conveniently and easily. As a consequence, various kinds of algorithms have been proposed in last few years to improve the performance.…

Information Retrieval · Computer Science 2012-06-18 Jinhu Liu , Chengcheng Yang , Zi-Ke Zhang

This study reviews popular stochastic gradient-based schemes based on large least-square problems. These schemes, often called optimizers in machine learning, play a crucial role in finding better model parameters. Hence, this study focuses…

Machine Learning · Computer Science 2025-03-05 Ramkrishna Acharya

In this technical report we analyse the performance of diffusion strategies applied to the Least-Mean-Square adaptive filter. We configure a network of cooperative agents running adaptive filters and discuss their behaviour when compared…

Machine Learning · Computer Science 2014-02-21 Jonathan Gelati , Sithan Kanna

This work proposes a novel adaptive linearized alternating direction multiplier method (LADMM) to convex optimization, which improves the convergence rate of the LADMM-based algorithm by adjusting step-size iteratively.The innovation of…

Optimization and Control · Mathematics 2024-07-04 Boran Wang

This draft concerns the error analysis of a collocation method based on the moving least squares (MLS) approximation for integral equations, which improves the results of [2] in the analysis part. This is mainly a translation from Persian…

Numerical Analysis · Mathematics 2015-09-01 Davoud Mirzaei

In this paper, we investigate the diffusion least mean square (DLMS) algorithm over fading channel, where in addition to channel noise and path-loss the inter-node-interference (INI) among neighboring nodes of a host node is also taken into…

Signal Processing · Electrical Eng. & Systems 2023-03-21 Mohammadjavad Mirzazadeh Moallem , Mehdi Korki

Broadband signal transmission over frequency-selective fading channel often requires accurate channel state information at receiver. One of the most attracting adaptive channel estimation methods is least mean square (LMS) algorithm.…

Information Theory · Computer Science 2013-04-16 Guan Gui , Abolfazl Mehbodniya , Fumiyuki Adachi

In this paper we propose and test the validity of simple and easy-to-implement algorithms within the immersed boundary framework geared towards large scale simulations involving thousands of deformable bodies in highly turbulent flows.…

Computational Physics · Physics 2018-09-26 Vamsi Spandan , Detlef Lohse , Marco D. de Tullio , Roberto Verzicco

With a rapid increase in volume and complexity of data sets, there is a need for methods that can extract useful information, for example the relationship between two data sets measured for the same persons. The Partial Least Squares (PLS)…

The paper explores in detail the use of dynamic adaptation gain/step size (DAG) for improving the adaptation transient performance of variable step-size LMS (VS-LMS) adaptation algorithms. A generic form for the implementation of the DAG…

Optimization and Control · Mathematics 2024-03-21 Tudor-Bogdan Airimitoaie , Bernard Vau , Dariusz Bismor , Gabriel Buche , Ioan Doré Landau

The least mean squares (LMS) filter is often derived via the Wiener filter solution. For a system identification scenario, such a derivation makes it hard to incorporate prior information on the system's impulse response. We present an…

Signal Processing · Electrical Eng. & Systems 2017-12-07 Michael Lunglmayr , Oliver Lang , Mario Huemer