English
Related papers

Related papers: Convergence of Recursive Least Squares Based Input…

200 papers

We introduce Invariant Risk Minimization (IRM), a learning paradigm to estimate invariant correlations across multiple training distributions. To achieve this goal, IRM learns a data representation such that the optimal classifier, on top…

Machine Learning · Statistics 2020-03-31 Martin Arjovsky , Léon Bottou , Ishaan Gulrajani , David Lopez-Paz

Real time model based control of high dimensional nonlinear systems presents severe computational challenges. Conventional reduced order model control relies heavily on expert tuning or parameter adaptation and seldom offers mechanisms for…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Jiachen Li , Shihao Li , Dongmei Chen

In this paper we present a connection between two dynamical systems arising in entirely different contexts: one in signal processing and the other in biology. The first is the famous Iteratively Reweighted Least Squares (IRLS) algorithm…

Data Structures and Algorithms · Computer Science 2016-01-13 Damian Straszak , Nisheeth K. Vishnoi

Iteratively Re-weighted Least Squares (IRLS) is a method for solving minimization problems involving non-quadratic cost functions, perhaps non-convex and non-smooth, which however can be described as the infimum over a family of quadratic…

Numerical Analysis · Mathematics 2016-02-24 Massimo Fornasier , Steffen Peter , Holger Rauhut , Stephan Worm

Deficit Round-Robin (DRR) is a widespread scheduling algorithm that provides fair queueing with variable-length packets. Bounds on worst-case delays for DRR were found by Boyer et al., who used a rigorous network calculus approach and…

Performance · Computer Science 2021-06-03 Seyed Mohammadhossein Tabatabaee , Jean-Yves Le Boudec

Intelligent reflecting surfaces (IRSs) are envisioned to provide reconfigurable wireless environments for future communication networks. In this paper, both downlink and uplink IRS-aided non-orthogonal multiple access (NOMA) and orthogonal…

Signal Processing · Electrical Eng. & Systems 2021-02-05 Yanyu Cheng , Kwok Hung Li , Yuanwei Liu , Kah Chan Teh , H. Vincent Poor

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

Machine Learning · Computer Science 2025-07-24 Shicheng Liu , Minghui Zhu

We consider the problem of offline reinforcement learning where only a set of system transitions is made available for policy optimization. Following recent advances in the field, we consider a model-based reinforcement learning algorithm…

Machine Learning · Computer Science 2024-02-06 Abdelhakim Benechehab , Albert Thomas , Balázs Kégl

Model-based deep learning methods such as loop unrolling (LU) and deep equilibrium model}(DEQ) extensions offer outstanding performance in solving inverse problems (IP). These methods unroll the optimization iterations into a sequence of…

Machine Learning · Computer Science 2024-06-11 Peimeng Guan , Naveed Iqbal , Mark A. Davenport , Mudassir Masood

Radar sensors have become an important part of the perception sensor suite due to their long range and their ability to work in adverse weather conditions. However, several shortcomings such as large amounts of noise and extreme sparsity of…

Robotics · Computer Science 2020-08-25 Nikhil Bharadwaj Gosala , Xiaoli Meng

The thinning-based integer-valued autoregressive moving-average (INARMA) models are popular for count time series. Recently, types of INARMA models have also been developed for count random fields, i.e., for spatial count data located on a…

Statistics Theory · Mathematics 2026-05-27 Angelika Silbernagel , Christian H. Weiß

The incremental least mean square (ILMS) algorithm was presented in \cite{Lopes2007}. The article included theoretical analysis of the algorithm along with simulation results under different scenarios. However, the transient analysis was…

Data Structures and Algorithms · Computer Science 2019-09-10 Muhammad Omer Bin Saeed

Reduced Rank Regression (RRR) is a widely used method for multi-response regression. However, RRR assumes a linear relationship between features and responses. While linear models are useful and often provide a good approximation, many…

Machine Learning · Statistics 2025-03-11 Leia Greenberg , Haim Avron

Latest least squares regression (LSR) methods mainly try to learn slack regression targets to replace strict zero-one labels. However, the difference of intra-class targets can also be highlighted when enlarging the distance between…

Computer Vision and Pattern Recognition · Computer Science 2019-10-09 Zhe Chen , Xiao-Jun Wu , Josef Kittler

Extremum seeking (ES) optimization approach has been very popular due to its non-model based analysis and implementation. This approach has been mostly used with gradient based search algorithms. Since least squares (LS) algorithms are…

Systems and Control · Electrical Eng. & Systems 2020-03-10 Nursefa Zengin , Baris Fidan

This paper is concerned with the following problem: given an upper bound of the state-space dimension and lag of a linear time-invariant system, design a sequence of inputs so that the system dynamics can be recovered from the resulting…

Optimization and Control · Mathematics 2024-07-18 M. Kanat Camlibel , Henk J. van Waarde , Paolo Rapisarda

We prove that the ordinary least-squares (OLS) estimator attains nearly minimax optimal performance for the identification of linear dynamical systems from a single observed trajectory. Our upper bound relies on a generalization of…

Machine Learning · Computer Science 2018-05-25 Max Simchowitz , Horia Mania , Stephen Tu , Michael I. Jordan , Benjamin Recht

Identifying a linear system model from data has wide applications in control theory. The existing work on finite sample analysis for linear system identification typically uses data from a single system trajectory under i.i.d random inputs,…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Lei Xin , George Chiu , Shreyas Sundaram

Feedback mechanism based algorithms are frequently used to solve network optimization problems. These schemes involve users and network exchanging information (e.g. requests for bandwidth allocation and pricing) to achieve convergence…

Networking and Internet Architecture · Computer Science 2016-04-12 Hengky Susanto , ByungGuk Kim

Inverse reinforcement learning (IRL) aims to explain observed strategic behavior by fitting reinforcement learning models to behavioral data. However, traditional IRL methods are only applicable when the observations are in the form of…

Machine Learning · Computer Science 2018-06-26 Antti Kangasrääsiö , Samuel Kaski