English
Related papers

Related papers: Exponential convergence of recursive least squares…

200 papers

Although persistent excitation is often acknowledged as a sufficient condition to exponentially converge in the field of adaptive parameter estimation, it must be noted that in practical applications this may be unguaranteed. Recently, more…

Systems and Control · Electrical Eng. & Systems 2024-03-19 Siyu Chen , Jing Na , Yingbo Huang

We develop a new approach for the estimation of a multivariate function based on the economic axioms of quasiconvexity (and monotonicity). On the computational side, we prove the existence of the quasiconvex constrained least squares…

Methodology · Statistics 2023-10-24 Somabha Mukherjee , Rohit K. Patra , Andrew L. Johnson , Hiroshi Morita

We investigate the problem of estimating the structure factor, or spectra, of stationary spatial point processes. In the first part, we establish a minimax lower bound for this estimation problem, using an approach tailored to second-order…

Statistics Theory · Mathematics 2025-11-19 Gabriel Mastrilli

Real-time identification of electrical equivalent circuit models is a critical requirement in many practical systems, such as batteries and electric motors. Significant work has been done in the past developing different types of algorithms…

Systems and Control · Electrical Eng. & Systems 2021-01-15 Balakumar Balasingam , Krishna Pattipati

In this article, we establish exponential contraction results for the diameter and variance of general first-order multiagent systems. Our approach is based on compactification techniques, and works under rather mild assumptions. Namely, we…

Optimization and Control · Mathematics 2024-06-06 Benoît Bonnet-Weill , Mario Sigalotti

We consider a general monotone regression estimation where we allow for independent and dependent regressors. We propose a modification of the classical isotonic least squares estimator and establish its rate of convergence for the…

Statistics Theory · Mathematics 2018-05-07 Konstantinos Fokianos , Anne Leucht , Michael H. Neumann

We consider least squares estimation in a general nonparametric regression model. The rate of convergence of the least squares estimator (LSE) for the unknown regression function is well studied when the errors are sub-Gaussian. We find…

Statistics Theory · Mathematics 2021-04-12 Arun K. Kuchibhotla , Rohit K. Patra

A convincing feature of least-squares finite element methods is the built-in a posteriori error estimator for any conforming discretization. In order to generalize this property to discontinuous finite element ansatz functions, this paper…

Numerical Analysis · Mathematics 2025-02-18 Philipp Bringmann

In this paper we propose a novel algorithm, factored value iteration (FVI), for the approximate solution of factored Markov decision processes (fMDPs). The traditional approximate value iteration algorithm is modified in two ways. For one,…

Artificial Intelligence · Computer Science 2008-08-13 Istvan Szita , Andras Lorincz

We study the asymptotic behavior of the least squares estimators of the unknown parameters of bifurcating autoregressive processes. Under very weak assumptions on the driven noise of the process, namely conditional pair-wise independence…

Probability · Mathematics 2009-06-29 Bernard Bercu , Benoite de Saporta , Anne Gegout-Petit

A proof for the point-wise convergence of the factors in the higher-order power method for tensors towards a critical point is given. It is obtained by applying established results from the theory of \L{}ojasiewicz inequalities to the…

Optimization and Control · Mathematics 2015-01-26 André Uschmajew

For a sample of Exponentially distributed durations we aim at point estimation and a confidence interval for its parameter. A duration is only observed if it has ended within a certain time interval, determined by a Uniform distribution.…

Methodology · Statistics 2021-10-19 Rafael Weißbach , Dominik Wied

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to…

Machine Learning · Statistics 2019-12-03 Namjoon Suh , Xiaoming Huo , Eric Heim , Lee Seversky

In this note we take a new look at the local convergence of alternating optimization methods for low-rank matrices and tensors. Our abstract interpretation as sequential optimization on moving subspaces yields insightful reformulations of…

Numerical Analysis · Mathematics 2019-01-14 Ivan Oseledets , Maxim Rakhuba , André Uschmajew

Many problems in financial engineering involve the estimation of unknown conditional expectations across a time interval. Often Least Squares Monte Carlo techniques are used for the estimation. One method that can be combined with Least…

Computational Finance · Quantitative Finance 2014-04-04 Eric Beutner , Janina Schweizer , Antoon Pelsser

We consider the estimation of a scalar parameter, when two estimators are available. The first is always consistent. The second is inconsistent in general, but has a smaller asymptotic variance than the first, and may be consistent if an…

Statistics Theory · Mathematics 2020-06-29 Clément de Chaisemartin , Xavier D'Haultfœuille

This paper focuses on recursive estimation of time varying autoregressive processes in a nonparametric setting. The stability of the model is revisited and uniform results are provided when the time-varying autoregressive parameters belong…

Statistics Theory · Mathematics 2007-06-13 Eric Moulines , Pierre Priouret , François Roueff

We develop a recursive least square (RLS) type algorithm with a minimax concave penalty (MCP) for adaptive identification of a sparse tap-weight vector that represents a communication channel. The proposed algorithm recursively yields its…

Signal Processing · Electrical Eng. & Systems 2023-04-03 Bowen Li , Suya Wu , Erin E. Tripp , Ali Pezeshki , Vahid Tarokh

We derive finite time error bounds for estimating general linear time-invariant (LTI) systems from a single observed trajectory using the method of least squares. We provide the first analysis of the general case when eigenvalues of the LTI…

Systems and Control · Computer Science 2019-02-14 Tuhin Sarkar , Alexander Rakhlin

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao