English
Related papers

Related papers: Nuclear Norm Regularized Estimation of Panel Regre…

200 papers

The low-rank matrix reconstruction (LRMR) approach is widely used in direction-of-arrival (DOA) estimation. As the rank norm penalty in an LRMR is NP-hard to compute, the nuclear norm (or the trace norm for a positive semidefinite (PSD)…

Information Theory · Computer Science 2017-12-07 Xiaohuan Wu , Wei-Ping Zhu , Jun Yan

In recent years, the nuclear norm minimization (NNM) problem has been attracting much attention in computer vision and machine learning. The NNM problem is capitalized on its convexity and it can be solved efficiently. The standard nuclear…

Computer Vision and Pattern Recognition · Computer Science 2014-05-26 Qi Xie , Deyu Meng , Shuhang Gu , Lei Zhang , Wangmeng Zuo , Xiangchu Feng , Zongben Xu

In applications throughout science and engineering one is often faced with the challenge of solving an ill-posed inverse problem, where the number of available measurements is smaller than the dimension of the model to be estimated. However…

Optimization and Control · Mathematics 2012-10-30 Venkat Chandrasekaran , Benjamin Recht , Pablo A. Parrilo , Alan S. Willsky

We study linear panel regression models in which the unobserved error term is an unknown smooth function of two-way unobserved fixed effects. In standard additive or interactive fixed effect models the individual specific and time specific…

Econometrics · Economics 2022-08-15 Hugo Freeman , Martin Weidner

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

Mixed-effect models are very popular for analyzing data with a hierarchical structure, e.g. repeated observations within subjects in a longitudinal design, patients nested within centers in a multicenter design. However, recently, due to…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Magne Thoresen

The nuclear norm is widely used as a convex surrogate of the rank function in compressive sensing for low rank matrix recovery with its applications in image recovery and signal processing. However, solving the nuclear norm based relaxed…

Machine Learning · Computer Science 2016-01-20 Canyi Lu , Jinhui Tang , Shuicheng Yan , Zhouchen Lin

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2020-02-27 Meixia Lin , Defeng Sun , Kim-Chuan Toh

This paper introduces a new fixed effects estimator for linear panel data models with clustered time patterns of unobserved heterogeneity. The method avoids non-convex and combinatorial optimization by combining a preliminary consistent…

Econometrics · Economics 2025-04-21 Martin Mugnier

Penalized estimation can conduct variable selection and parameter estimation simultaneously. The general framework is to minimize a loss function subject to a penalty designed to generate sparse variable selection. The…

Computation · Statistics 2024-01-11 Zhu Wang

Rates of convergence for empirical risk minimizers have been well studied in the literature. In this paper, we aim to provide a complementary set of results, in particular by showing that after normalization, the risk of the empirical…

Statistics Theory · Mathematics 2016-01-12 Sara van de Geer , Martin Wainwright

We study theoretical properties of regularized robust M-estimators, applicable when data are drawn from a sparse high-dimensional linear model and contaminated by heavy-tailed distributions and/or outliers in the additive errors and…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh

We propose a rate optimal estimator for the linear regression model on network data with interacted (unobservable) individual effects. The estimator achieves a faster rate of convergence $N$ compared to the standard estimators' $\sqrt{N}$…

Econometrics · Economics 2023-04-26 Yassine Sbai Sassi

Penalized least squares estimation is a popular technique in high-dimensional statistics. It includes such methods as the LASSO, the group LASSO, and the nuclear norm penalized least squares. The existing theory of these methods is not…

Statistics Theory · Mathematics 2017-07-10 Pierre C. Bellec , Guillaume Lecué , Alexandre B. Tsybakov

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

Methodology · Statistics 2016-10-23 P. Vellaisamy

Classical scalar-response regression methods treat covariates as a vector and estimate a corresponding vector of regression coefficients. In medical applications, however, regressors are often in a form of multi-dimensional arrays. For…

Methodology · Statistics 2020-02-03 Damian Brzyski , Xixi Hu , Joaquin Goni , Beau Ances , Timothy W. Randolph , Jaroslaw Harezlak

Rank minimization (RM) is a wildly investigated task of finding solutions by exploiting low-rank structure of parameter matrices. Recently, solving RM problem by leveraging non-convex relaxations has received significant attention. It has…

Machine Learning · Computer Science 2018-09-17 Zaiyi Chen

Within the context of recursive least squares (RLS) parameter estimation, the goal of the present paper is to study the effect of regularization-induced bias on the transient and asymptotic accuracy of the parameter estimates. We consider…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Brian Lai , Syed Aseem Ul Islam , Dennis S. Bernstein

Sparse approximate solutions to linear equations are classically obtained via L1 norm regularized least squares, but this method often underestimates the true solution. As an alternative to the L1 norm, this paper proposes a class of…

Optimization and Control · Mathematics 2018-03-20 Ivan Selesnick

Low-rank matrix models have been universally useful for numerous applications, from classical system identification to more modern matrix completion in signal processing and statistics. The nuclear norm has been employed as a convex…

Statistics Theory · Mathematics 2023-03-06 Kiryung Lee , Rakshith Sharma Srinivasa , Marius Junge , Justin Romberg