English
Related papers

Related papers: Weighted shape-constrained estimation for the auto…

200 papers

This article develops the asymptotic distribution of the least squares estimator of the model parameters in periodicvector autoregressive time series models (hereafter PVAR) with uncorrelated but dependent innovations. When theinnovations…

Statistics Theory · Mathematics 2024-04-22 Yacouba Boubacar Maïnassara , Eugen Ursu

Sparse inversion of gravity data based on $L_1$-norm regularization is discussed. An iteratively reweighted least squares algorithm is used to solve the problem. At each iteration the solution of a linear system of equations and the…

Geophysics · Physics 2022-08-16 Saeed Vatankhah , Rosemary A. Renaut , Vahid. E. Ardestani

When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of…

Machine Learning · Statistics 2020-06-12 Huamei Huang , Yujing Gao , Huiming Zhang , Bo Li

We consider the problem of estimating the asymptotic variance of a function defined on a Markov chain, an important step for statistical inference of the stationary mean. We design a novel recursive estimator that requires $O(1)$…

Statistics Theory · Mathematics 2024-09-24 Shubhada Agrawal , Prashanth L. A. , Siva Theja Maguluri

We propose nonparametric estimators for the second-order central moments of possibly anisotropic spherical random fields, within a functional data analysis context. We consider a measurement framework where each random field among an…

Statistics Theory · Mathematics 2022-06-28 Alessia Caponera , Julien Fageot , Matthieu Simeoni , Victor M. Panaretos

We settle the complexity of dynamic least-squares regression (LSR), where rows and labels $(\mathbf{A}^{(t)}, \mathbf{b}^{(t)})$ can be adaptively inserted and/or deleted, and the goal is to efficiently maintain an $\epsilon$-approximate…

Data Structures and Algorithms · Computer Science 2023-04-07 Shunhua Jiang , Binghui Peng , Omri Weinstein

We address the problem of sparse recovery in an online setting, where random linear measurements of a sparse signal are revealed sequentially and the objective is to recover the underlying signal. We propose a reweighted least squares (RLS)…

Machine Learning · Computer Science 2017-06-30 Subhadip Mukherjee , Deepak R. , Huaijin Chen , Ashok Veeraraghavan , Chandra Sekhar Seelamantula

We propose a penalized least-squares method to fit the linear regression model with fitted values that are invariant to invertible linear transformations of the design matrix. This invariance is important, for example, when practitioners…

Methodology · Statistics 2024-10-11 Daeyoung Ham , Adam J. Rothman

The weighted nonlinear least-squares problem for low-rank signal estimation is considered. The problem of constructing a numerical solution that is stable and fast for long time series is addressed. A modified weighted Gauss-Newton method,…

Numerical Analysis · Mathematics 2022-07-08 Nikita Zvonarev , Nina Golyandina

Modern developments in microscopy and image processing are revolutionising areas of physics, chemistry, and biology as nanoscale objects can be tracked with unprecedented accuracy. However, the price paid for having a direct visualisation…

Statistical Mechanics · Physics 2013-03-19 Denis Boyer , David S. Dean , Carlos Mejía-Monasterio , Gleb Oshanin

In this paper, we consider the problem of finding the Least Squares estimators of two isotonic regression curves $g^\circ_1$ and $g^\circ_2$ under the additional constraint that they are ordered; e.g., $g^\circ_1 \le g^\circ_2$. Given two…

Methodology · Statistics 2023-04-17 Fadoua Balabdaoui , Kaspar Rufibach , Filippo Santambrogio

We introduce a novel optimization algorithm for image recovery under learned sparse and low-rank constraints, which we parameterize as weighted extensions of the $\ell_p^p$-vector and $\mathcal S_p^p$ Schatten-matrix quasi-norms for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Stamatios Lefkimmiatis , Iaroslav Koshelev

We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze…

Information Theory · Computer Science 2017-04-05 Abbas Kazemipour , Sina Miran , Piya Pal , Behtash Babadi , Min Wu

In this paper we study the compressed sensing problem of recovering a sparse signal from a system of underdetermined linear equations when we have prior information about the probability of each entry of the unknown signal being nonzero. In…

Information Theory · Computer Science 2009-01-20 M. Amin Khajehnejad , Weiyu Xu , Salman Avestimehr , Babak Hassibi

We propose a distributionally robust formulation for simultaneously estimating the covariance matrix and the precision matrix of a random vector.The proposed model minimizes the worst-case weighted sum of the Frobenius loss of the…

Machine Learning · Statistics 2025-11-19 Renjie Chen , Viet Anh Nguyen , Huifu Xu

This paper provides an alternative to penalized estimators for estimation and vari- able selection in high dimensional linear regression models with measurement error or missing covariates. We propose estimation via bias corrected least…

Methodology · Statistics 2016-05-11 Abhishek Kaul , Hira L. Koul , Akshita Chawla , Soumendra N. Lahiri

The performance of Least Squares (LS) estimators is studied in isotonic, unimodal and convex regression. Our results have the form of sharp oracle inequalities that account for the model misspecification error. In isotonic and unimodal…

Statistics Theory · Mathematics 2016-08-09 Pierre C. Bellec

In this paper we investigate panel regression models with interactive fixed effects. We propose two new estimation methods that are based on minimizing convex objective functions. The first method minimizes the sum of squared residuals with…

Econometrics · Economics 2026-02-10 Hyungsik Roger Moon , Martin Weidner

The fixed-effects model estimates the regressor effects on the mean of the response, which is inadequate to summarize the variable relationships in the presence of heteroscedasticity. In this paper, we adapt the asymmetric least squares…

Econometrics · Economics 2021-08-11 Amadou Barry , Karim Oualkacha , Arthur Charpentier

The iteratively reweighted least squares method (IRLS) is a popular technique used in practice for solving regression problems. Various versions of this method have been proposed, but their theoretical analyses failed to capture the good…

Data Structures and Algorithms · Computer Science 2019-07-11 Alina Ene , Adrian Vladu