中文
相关论文

相关论文: On regularization methods based on R\'enyi's pseud…

200 篇论文

This paper considers the problem of estimation in the generalized semiparametric model for longitudinal data when the number of parameters diverges with the sample size. A penalization type of generalized estimating equation method is…

统计方法学 · 统计学 2020-06-09 M. Taavoni , M. Arashi

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

统计理论 · 数学 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

In this paper, the estimation problem for sparse reduced rank regression (SRRR) model is considered. The SRRR model is widely used for dimension reduction and variable selection with applications in signal processing, econometrics, etc. The…

机器学习 · 统计学 2018-03-21 Ziping Zhao , Daniel P. Palomar

We consider high-dimensional generalized linear models with Lipschitz loss functions, and prove a nonasymptotic oracle inequality for the empirical risk minimizer with Lasso penalty. The penalty is based on the coefficients in the linear…

统计理论 · 数学 2008-12-18 Sara A. van de Geer

It is of importance to develop statistical techniques to analyze high-dimensional data in the presence of both complex dependence and possible outliers in real-world applications such as imaging data analyses. We propose a new robust…

统计方法学 · 统计学 2021-10-01 Bingyuan Liu , Qi Zhang , Lingzhou Xue , Peter X. K. Song , Jian Kang

$\ell_1$-penalized quantile regression is widely used for analyzing high-dimensional data with heterogeneity. It is now recognized that the $\ell_1$-penalty introduces non-negligible estimation bias, while a proper use of concave…

统计方法学 · 统计学 2021-09-14 Kean Ming Tan , Lan Wang , Wen-Xin Zhou

In this paper, we study the effect of different regularizers and their implications in high dimensional image classification and sparse linear unmixing. Although kernelization or sparse methods are globally accepted solutions for processing…

机器学习 · 统计学 2016-11-03 Devis Tuia , Remi Flamary , Michel Barlaud

We consider regression with square loss and general classes of functions without the boundedness assumption. We introduce a notion of offset Rademacher complexity that provides a transparent way to study localization both in expectation and…

机器学习 · 统计学 2020-07-27 Tengyuan Liang , Alexander Rakhlin , Karthik Sridharan

In real life we often deal with independent but not identically distributed observations (i.n.i.d.o), for which the most well-known statistical model is the multiple linear regression model (MLRM) without random covariates. While the…

统计理论 · 数学 2021-02-25 Elena Castilla , Maria Jaenada , Leandro Pardo

We develop a constructive approach to estimating sparse, high-dimensional linear regression models. The approach is a computational algorithm motivated from the KKT conditions for the $\ell_0$-penalized least squares solutions. It generates…

统计计算 · 统计学 2017-01-19 Jian Huang , Yuling Jiao , Yanyan Liu , Xiliang Lu

In large-scale, data-driven applications, parameters are often only known approximately due to noise and limited data samples. In this paper, we focus on high-dimensional optimization problems with linear constraints under uncertain…

最优化与控制 · 数学 2024-03-01 Naqi Huang , Nestor Parolya , Theresia van Essen

We consider the problem of linear classification under general loss functions in the limited-data setting. Overfitting is a common problem here. The standard approaches to prevent overfitting are dimensionality reduction and regularization.…

机器学习 · 计算机科学 2021-11-22 Deepayan Chakrabarti

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

机器学习 · 统计学 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We consider the high-dimensional heteroscedastic regression model, where the mean and the log variance are modeled as a linear combination of input variables. Existing literature on high-dimensional linear regres- sion models has largely…

机器学习 · 统计学 2012-05-23 Mladen Kolar , James Sharpnack

Regularization techniques such as the lasso (Tibshirani 1996) and elastic net (Zou and Hastie 2005) can be used to improve regression model coefficient estimation and prediction accuracy, as well as to perform variable selection. Ordinal…

统计计算 · 统计学 2022-09-05 Michael J. Wurm , Paul J. Rathouz , Bret M. Hanlon

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

机器学习 · 统计学 2015-03-31 Ravi Ganti , Rebecca M. Willett

This paper develops tools to obtain robust probabilistic estimates for queueing models at the large deviations (LD) scale. These tools are based on the recently introduced robust R\'enyi bounds, which provide LD estimates (and more…

概率论 · 数学 2020-08-14 Rami Atar , Amarjit Budhiraja , Paul Dupuis , Ruoyu Wu

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

机器学习 · 统计学 2016-03-22 John P. Cunningham , Zoubin Ghahramani

The presence of outliers (anomalous values) in synthetic aperture radar (SAR) data and the misspecification in statistical image models may result in inaccurate inferences. To avoid such issues, the Rayleigh regression model based on a…

应用统计 · 统计学 2022-08-02 B. G. Palm , F. M. Bayer , R. Machado , M. I. Pettersson , V. T. Vu , R. J. Cintra

Numerous practical medical problems often involve data that possess a combination of both sparse and non-sparse structures. Traditional penalized regularizations techniques, primarily designed for promoting sparsity, are inadequate to…

统计方法学 · 统计学 2023-11-10 Shun Yu , Yuehan Yang