English
Related papers

Related papers: Generalized Forgetting Recursive Least Squares: St…

200 papers

We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an $\varepsilon$-fraction of our samples were chosen by an adversary. We give robust estimators that achieve…

Data Structures and Algorithms · Computer Science 2017-11-07 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

In this paper, a new two-parameter model called generalized Ramos-Louzada (GRL) distribution is proposed. The new model provides more flexibility in modeling data with increasing, decreasing, j shaped and reversed-J shaped hazard rate…

Applications · Statistics 2019-12-19 Hazem Al-Mofleh , Ahmed Z. Afify

Reactive synthesis is concerned with finding a correct-by-construction controller from formal specifications, typically expressed in Linear Temporal Logic (LTL). The specifications describe assumptions about an environment and guarantees to…

Logic in Computer Science · Computer Science 2019-10-15 Davide G. Cavezza , Dalal Alrajeh , Andras Gyorgy

The computation of global radial basis function (RBF) approximations requires the solution of a linear system which, depending on the choice of RBF parameters, may be ill-conditioned. We study the stability and accuracy of approximation…

Numerical Analysis · Mathematics 2022-11-24 Ben Adcock , Daan Huybrechs , Cécile Piret

We study the problem of exact support recovery: given an (unknown) vector $\theta \in \left\{-1,0,1\right\}^D$, we are given access to the noisy measurement $$ y = X\theta + \omega,$$ where $X \in \mathbb{R}^{N \times D}$ is a (known)…

Statistics Theory · Mathematics 2020-11-10 Ofir Lindenbaum , Stefan Steinerberger

This paper is devoted to the study of Lyapunov type inequalities for periodic conservative systems. The main results are derived from a previous analysis which relates the best Lyapunov constants to some especial (constrained or…

Classical Analysis and ODEs · Mathematics 2010-09-16 Antonio Canada , Salvador Villegas

We study the problem of signal estimation from non-linear observations when the signal belongs to a low-dimensional set buried in a high-dimensional space. A rough heuristic often used in practice postulates that non-linear observations may…

Information Theory · Computer Science 2015-11-17 Yaniv Plan , Roman Vershynin

In linear models, the generalized least squares (GLS) estimator is applicable when the structure of the error dependence is known. When it is unknown, such structure must be approximated and estimated in a manner that may lead to…

Statistics Theory · Mathematics 2019-02-12 Hien D Nguyen

This paper treats iterative solution methods to the generalized Lyapunov equation. Specifically it expands the existing theoretical justification for the alternating linear scheme (ALS) from the stable Lyapunov equation to the stable…

Numerical Analysis · Mathematics 2019-06-18 Tobias Breiten , Emil Ringh

In this note, we give a short information-theoretic proof of the consistency of the Gaussian maximum likelihood estimator in linear auto-regressive models. Our proof yields nearly optimal non-asymptotic rates for parameter recovery and…

Machine Learning · Computer Science 2024-09-11 Ingvar Ziemann

The paper contains several theoretical results related to the weighted nonlinear least-squares problem for low-rank signal estimation, which can be considered as a Hankel structured low-rank approximation problem. A parameterization of the…

Numerical Analysis · Mathematics 2022-07-29 Nikita Zvonarev , Nina Golyandina

The topic of this manuscript is the stability analysis of continuous-time switched nonlinear systems with constraints on the admissible switching signals. Our particular focus lies in considering signals characterized by upper and lower…

Optimization and Control · Mathematics 2024-01-17 Matteo Della Rossa

In this paper, we present a framework for online parameter estimation and uncertainty quantification in the context of adaptive safety-critical control. The key insight enabling our approach is that the parameter estimate generated by the…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Max H. Cohen , Makai Mann , Kevin Leahy , Calin Belta

A non-Bayesian, regression-based or generalized least squares (GLS)-based approach is formally proposed to estimate a class of time-varying AR parameter models. This approach has partly been used by Ito et al. (2014, 2016a,b), and is proven…

Methodology · Statistics 2017-12-22 Mikio Ito , Akihiko Noda , Tatsuma Wada

We present a modular approach to \emph{reinforcement learning} (RL) in environments consisting of simpler components evolving in parallel. A monolithic view of such modular environments may be prohibitively large to learn, or may require…

Machine Learning · Computer Science 2023-12-18 Milad Kazemi , Mateo Perez , Fabio Somenzi , Sadegh Soudjani , Ashutosh Trivedi , Alvaro Velasquez

This paper deals with learning stability of partially observed switched linear systems under arbitrary switching. Such systems are widely used to describe cyber-physical systems which arise by combining physical systems with digital…

Systems and Control · Electrical Eng. & Systems 2023-01-20 Zheming Wang , Raphaël M. Jungers , Mihály Petreczky , Bo Chen , Li Yu

In this correspondence, we introduce a minimax regret criteria to the least squares problems with bounded data uncertainties and solve it using semi-definite programming. We investigate a robust minimax least squares approach that minimizes…

Systems and Control · Computer Science 2012-03-20 Nargiz Kalantarova , Mehmet A. Donmez , Suleyman S. Kozat

This paper discusses the properties of certain risk estimators recently proposed to choose regularization parameters in ill-posed problems. A simple approach is Stein's unbiased risk estimator (SURE), which estimates the risk in the data…

Recent work established that rank overparameterization eliminates spurious local minima in nonconvex low-rank matrix recovery under the restricted isometry property (RIP). But this does not fully explain the practical success of…

Optimization and Control · Mathematics 2025-05-07 Richard Y. Zhang

Recently, the proposal of the least mean square (LMS) and recursive least squares (RLS) algorithm for graph signal processing (GSP) provides excellent solutions for processing signals defined on irregular structures such as sensor networks.…

Signal Processing · Electrical Eng. & Systems 2025-06-03 Haiquan Zhao , Chengjin Li