English
Related papers

Related papers: Sparse Multivariate ARCH Models: Finite Sample Pro…

200 papers

This paper is concerned with the selection and estimation of fixed and random effects in linear mixed effects models. We propose a class of nonconcave penalized profile likelihood methods for selecting and estimating important fixed…

Statistics Theory · Mathematics 2012-11-05 Yingying Fan , Runze Li

We introduce the arbitrary rectangle-range generalized elastic net penalty method, abbreviated to ARGEN, for performing constrained variable selection and regularization in high-dimensional sparse linear models. As a natural extension of…

Machine Learning · Statistics 2021-12-16 Yujia Ding , Qidi Peng , Zhengming Song , Hansen Chen

Nonconvex penalties are utilized for regularization in high-dimensional statistical learning algorithms primarily because they yield unbiased or nearly unbiased estimators for the parameters in the model. Nonconvex penalties existing in the…

Machine Learning · Statistics 2024-08-19 Majnu John , Sujit Vettam , Yihren Wu

We prove absolute regularity ($\beta$-mixing) for nonstationary and multivariate versions of two popular classes of integer-valued processes. We show how this result can be used to prove asymptotic normality of a least squares estimator of…

Statistics Theory · Mathematics 2024-08-29 Zinsou Max Debaly , Michael H. Neumann , Lionel Truquet

We study a linear observation model with an unknown permutation called \textit{permuted/shuffled linear regression}, where responses and covariates are mismatched and the permutation forms a discrete, factorial-size parameter. The…

Statistics Theory · Mathematics 2026-01-23 Hirofumi Ota , Masaaki Imaizumi

In this paper, we develop a complete methodology for detecting time-varying/non time-varying parameters in ARCH processes. For this purpose, we estimate and test various semiparametric versions of the time-varying ARCH model (tv-ARCH) which…

Statistics Theory · Mathematics 2016-11-04 Lionel Truquet

In a plethora of applications dealing with inverse problems, e.g. in image processing, social networks, compressive sensing, biological data processing etc., the signal of interest is known to be structured in several ways at the same time.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Paris Giampouras , Konstantinos Themelis , Athanasios Rontogiannis , Konstantinos Koutroumbas

It is well known that in a supervised classification setting when the number of features is smaller than the number of observations, Fisher's linear discriminant rule is asymptotically Bayes. However, there are numerous modern applications…

Machine Learning · Statistics 2014-09-17 Irina Gaynanova , James G. Booth , Martin T. Wells

The Ising model is a useful tool for studying complex interactions within a system. The estimation of such a model, however, is rather challenging, especially in the presence of high-dimensional parameters. In this work, we propose…

Statistics Theory · Mathematics 2012-08-20 Lingzhou Xue , Hui Zou , Tianxi Cai

We show that the high-dimensional behavior of symmetrically penalized least squares with a possibly non-separable, symmetric, convex penalty in both (i) the Gaussian sequence model and (ii) the linear model with uncorrelated Gaussian…

Statistics Theory · Mathematics 2019-06-26 Michael Celentano

Finite sample properties of multiple imputation estimators under the linear regression model are studied. The exact bias of the multiple imputation variance estimator is presented. A method of reducing the bias is presented and simulation…

Statistics Theory · Mathematics 2007-06-13 Jae Kwang Kim

A rich literature exists on constructing non-parametric estimators with optimal asymptotic properties. In addition to asymptotic guarantees, it is often of interest to design estimators with desirable finite-sample properties; such as…

Methodology · Statistics 2025-05-14 Herbert P. Susmann , Yiting Li , Mara A. McAdams-DeMarco , Wenbo Wu , Iván Díaz

The minimality of the penalization function associated with a convex risk measure is analyzed in this paper. First, in a general static framework, we provide necessary and sufficient conditions for a penalty function defined in a convex and…

Probability · Mathematics 2014-01-31 Daniel Hernández-Hernández , Leonel Pérez-Hernández

We propose an estimator of prediction error using an approximate message passing (AMP) algorithm that can be applied to a broad range of sparse penalties. Following Stein's lemma, the estimator of the generalized degrees of freedom, which…

Machine Learning · Statistics 2018-08-01 Ayaka Sakata

The standard quantile regression model assumes a linear relationship at the quantile of interest and that all variables are observed. We relax these assumptions by considering a partial linear model while allowing for missing linear…

Methodology · Statistics 2016-06-07 Ben Sherwood

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. While naturally cast as a combinatorial optimization problem, variable or feature selection admits a convex relaxation through the…

Machine Learning · Computer Science 2012-04-23 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

GARCH models are useful tools in the investigation of phenomena, where volatility changes are prominent features, like most financial data. The parameter estimation via quasi maximum likelihood (QMLE) and its properties are by now well…

Statistics Theory · Mathematics 2012-09-07 László Varga , András Zempléni

We consider goodness-of-fit methods for multivariate symmetric and asymmetric stable Paretian random vectors in arbitrary dimension. The methods are based on the empirical characteristic function and are implemented both in the i.i.d.…

Statistics Theory · Mathematics 2023-12-20 Simos G. Meintanis , John P. Nolan , Charl Pretorius

Stochastic processes with multiplicative noise have been studied independently in several different contexts over the past decades. We focus on the regime, found for a generic set of control parameters, in which stochastic processes with…

Statistical Mechanics · Physics 2015-06-25 D. Sornette

Sparse covariates are frequent in classification and regression problems and in these settings the task of variable selection is usually of interest. As it is well known, sparse statistical models correspond to situations where there are…

Methodology · Statistics 2020-02-14 Ana M. Bianco , Graciela Boente , Gonzalo Chebi