English
Related papers

Related papers: A Complete Transient Analysis for the Incremental …

200 papers

The goal of this paper is to propose novel strategies for adaptive learning of signals defined over graphs, which are observed over a (randomly time-varying) subset of vertices. We recast two classical adaptive algorithms in the graph…

Machine Learning · Computer Science 2018-08-01 Paolo Di Lorenzo , Paolo Banelli , Elvin Isufi , Sergio Barbarossa , Geert Leus

This paper proposes a new approach, grounded in Satisfiability Modulo Theories (SMT), to study the transient of a Max-Plus Linear (MPL) system, that is the number of steps leading to its periodic regime. Differently from state-of-the-art…

Systems and Control · Electrical Eng. & Systems 2020-07-09 Alessandro Abate , Alessandro Cimatti , Andrea Micheli , Muhammad Syifa'ul Mufid

We analyze an Iteratively Re-weighted Least Squares (IRLS) algorithm for promoting l1-minimization in sparse and compressible vector recovery. We prove its convergence and we estimate its local rate. We show how the algorithm can be…

Numerical Analysis · Mathematics 2008-07-04 Ingrid Daubechies , Ronald DeVore , Massimo Fornasier , C. Sinan Gunturk

The purpose of this paper is to indicate that the recently proposed Momentum fractional least mean squares (mFLMS) algorithm has some serious flaws in its design and analysis. Our apprehensions are based on the evidence we found in the…

Optimization and Control · Mathematics 2018-05-22 Shujaat Khan , Imran Naseem , Alishba Sadiq , Jawwad Ahmad , Muhammad Moinuddin

The diffusion least-mean square (dLMS) algorithms have attracted much attention owing to its robustness for distributed estimation problems. However, the performance of such filters may change when they are implemented for suppressing…

Systems and Control · Computer Science 2017-08-09 Lu Lu , Haiquan Zhao

We introduce a novel semi-supervised version of the least squares classifier. This implicitly constrained least squares (ICLS) classifier minimizes the squared loss on the labeled data among the set of parameters implied by all possible…

Machine Learning · Statistics 2015-07-27 Jesse H. Krijthe , Marco Loog

This paper introduces a novel adaptive framework for processing dynamic flow signals over simplicial complexes, extending classical least-mean-squares (LMS) methods to high-order topological domains. Building on discrete Hodge theory, we…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Lorenzo Marinucci , Claudio Battiloro , Paolo Di Lorenzo

In order to function reliably, synthetic molecular circuits require mechanisms that allow them to adapt to environmental disturbances. Least mean squares (LMS) schemes, such as commonly encountered in signal processing and control, provide…

Molecular Networks · Quantitative Biology 2017-01-04 Christoph Zechner , Mustafa Khammash

This paper introduces a novel constraint adaptive filtering algorithm based on a relative logarithmic cost function which is termed as Constrained Least Mean Logarithmic Square (CLMLS). The proposed CLMLS algorithm elegantly adjusts the…

Systems and Control · Computer Science 2018-01-22 Vinay Chakravarthi Gogineni , Subrahmanyam Mula

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

Machine Learning · Computer Science 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti

In this paper, we present the convergence analysis of proportionate-type least mean square (Pt-LMS) algorithm that identifies the sparse system effectively and more suitable for real time VLSI applications. Both first and second order…

Systems and Control · Computer Science 2015-12-15 Vinay Chakravarthi Gogineni , Subrahmanyam Mula

This paper investigates the optimality analysis of the recursive least-squares (RLS) algorithm for autoregressive systems with exogenous inputs (ARX systems). A key challenge in analyzing is managing the potential unboundedness of the…

Optimization and Control · Mathematics 2025-05-27 Xingrui Liu , Jieming Ke , Yanlong Zhao

The task of predicting missing entries of a matrix, from a subset of known entries, is known as \textit{matrix completion}. In today's data-driven world, data completion is essential whether it is the main goal or a pre-processing step.…

Numerical Analysis · Mathematics 2021-05-18 Henry Adams , Lara Kassab , Deanna Needell

In-context learning (ICL) has emerged as a powerful capability of large pretrained transformers, enabling them to solve new tasks implicit in example input-output pairs without any gradient updates. Despite its practical success, the…

Machine Learning · Computer Science 2025-07-15 Joshua Hill , Benjamin Eyre , Elliot Creager

Adaptive filtering algorithms operating in reproducing kernel Hilbert spaces have demonstrated superiority over their linear counterpart for nonlinear system identification. Unfortunately, an undesirable characteristic of these methods is…

Machine Learning · Statistics 2013-06-25 Wei Gao , Jie Chen , Cédric Richard , Jianguo Huang

Iteratively reweighted least squares (IRLS) is a widely-used method in machine learning to estimate the parameters in the generalised linear models. In particular, IRLS for L1 minimisation under the linear model provides a closed-form…

Cryptography and Security · Computer Science 2016-05-25 Mijung Park , Max Welling

An iteratively reweighted least squares (IRLS) method is proposed for estimating polyserial and polychoric correlation coefficients in this paper. It iteratively calculates the slopes in a series of weighted linear regression models fitting…

Methodology · Statistics 2022-10-21 Peng Zhang , Ben Liu , Jingjing Pan

Matrix factorization learned by implicit alternating least squares (iALS) is a popular baseline in recommender system research publications. iALS is known to be one of the most computationally efficient and scalable collaborative filtering…

Information Retrieval · Computer Science 2021-10-28 Steffen Rendle , Walid Krichene , Li Zhang , Yehuda Koren

The recursive least-squares (RLS) algorithm has well-documented merits for reducing complexity and storage requirements, when it comes to online estimation of stationary signals as well as for tracking slowly-varying nonstationary…

Networking and Internet Architecture · Computer Science 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

Partial diffusion scheme is an effective method for reducing computational load and power consumption in adaptive network implementation. The Information is exchanged among the nodes, usually over noisy links. In this paper, we consider a…

Systems and Control · Computer Science 2015-12-01 Vahid Vadidpour , Amir Rastegarnia , Azam Khalili , Saeid Sanei