中文
相关论文

相关论文: Empirical Bayes Estimation for Lasso-Type Regulari…

200 篇论文

We consider a framework for determining and estimating the conditional pairwise relationships of variables when the observed samples are contaminated with measurement error in high dimensional settings. Assuming the true underlying…

统计方法学 · 统计学 2019-07-05 Michael Byrd , Linh Nghiem , Monnie McGee

Large scale, streaming datasets are ubiquitous in modern machine learning. Streaming algorithms must be scalable, amenable to incremental training and robust to the presence of non-stationarity. In this work consider the problem of learning…

机器学习 · 统计学 2017-12-15 Ricardo Pio Monti , Christoforos Anagnostopoulos , Giovanni Montana

In regression problems where covariates can be naturally grouped, the group Lasso is an attractive method for variable selection since it respects the grouping structure in the data. We study the selection and estimation properties of the…

统计理论 · 数学 2010-11-30 Fengrong Wei , Jian Huang

Researchers are often interested in learning not only the effect of treatments on outcomes, but also the pathways through which these effects operate. A mediator is a variable that is affected by treatment and subsequently affects outcome.…

统计方法学 · 统计学 2021-12-22 Jeremiah Jones , Ashkan Ertefaie , Robert L. Strawderman

Our paper discovers a new trade-off of using regression adjustments (RAs) in causal inference under covariate-adaptive randomizations (CARs). On one hand, RAs can improve the efficiency of causal estimators by incorporating information from…

计量经济学 · 经济学 2025-02-19 Liang Jiang , Liyao Li , Ke Miao , Yichong Zhang

In this paper we consider the problem of grouped variable selection in high-dimensional regression using $\ell_1-\ell_q$ regularization ($1\leq q \leq \infty$), which can be viewed as a natural generalization of the $\ell_1-\ell_2$…

机器学习 · 统计学 2008-02-12 Han Liu , Jian Zhang

Nowadays an increasing amount of data is available and we have to deal with models in high dimension (number of covariates much larger than the sample size). Under sparsity assumption it is reasonable to hope that we can make a good…

统计理论 · 数学 2014-01-23 Mélanie Blazère , Jean-Michel Loubes , Fabrice Gamboa

We consider the least-square linear regression problem with regularization by the $\ell^1$-norm, a problem usually referred to as the Lasso. In this paper, we first present a detailed asymptotic analysis of model consistency of the Lasso in…

机器学习 · 计算机科学 2009-01-22 Francis Bach

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

计量经济学 · 经济学 2020-06-12 Matteo Mogliani , Anna Simoni

We consider model selection and estimation for partial spline models and propose a new regularization method in the context of smoothing splines. The regularization method has a simple yet elegant form, consisting of roughness penalty on…

统计方法学 · 统计学 2013-11-25 Guang Cheng , Hao Helen Zhang , Zuofeng Shang

The lasso is a popular tool for sparse linear regression, especially for problems in which the number of variables p exceeds the number of observations n. But when p>n, the lasso criterion is not strictly convex, and hence it may not have a…

统计理论 · 数学 2012-11-06 Ryan J. Tibshirani

In this article, we apply non-convex regularization methods in order to obtain stable estimation of loss development factors in insurance claims reserving. Among the non-convex regularization methods, we focus on the use of the log-adjusted…

统计方法学 · 统计学 2020-12-08 Himchan Jeong , Hyunwoong Chang , Emiliano A. Valdez

LASSO regularization is a popular regression tool to enhance the prediction accuracy of statistical models by performing variable selection through the $\ell_1$ penalty, initially formulated for the linear model and its variants. In this…

机器学习 · 计算机科学 2023-05-09 Gen Li , Ganghua Wang , Jie Ding

In this paper, we propose a very efficient numerical method based on the L-BFGS-B algorithm for identifying linear and nonlinear discrete-time state-space models, possibly under $\ell_1$ and group-Lasso regularization for reducing model…

系统与控制 · 电气工程与系统科学 2024-12-05 Alberto Bemporad

Debiasing group graphical lasso estimates enables statistical inference when multiple Gaussian graphical models share a common sparsity pattern. We analyze the estimation properties of group graphical lasso, establishing convergence rates…

统计理论 · 数学 2025-10-07 Sayan Ranjan Bhowal , Debashis Paul , Gopal K Basak , Samarjit Das

The linear regression models are widely used statistical techniques in numerous practical applications. The standard regression model requires several assumptions about the regres- sors and the error term. The regression parameters are…

统计方法学 · 统计学 2016-10-23 P. Vellaisamy

Learning sparse models from data is an important task in all those frameworks where relevant information should be identified within a large dataset. This can be achieved by formulating and solving suitable sparsity promoting optimization…

最优化与控制 · 数学 2025-02-18 V. Cerone , S. M. Fosson , D. Regruto , A. Salam

Penalized selection criteria like AIC or BIC are among the most popular methods for variable selection. Their theoretical properties have been studied intensively and are well understood, but making use of them in case of high-dimensional…

统计方法学 · 统计学 2016-04-27 Florian Frommlet , Gregory Nuel

The Lasso regression is a popular regularization method for feature selection in statistics. Prior to computing the Lasso estimator in both linear and generalized linear models, it is common to conduct a preliminary rescaling of the feature…

统计方法学 · 统计学 2023-11-21 Anant Mathur , Sarat Moka , Zdravko Botev

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

统计方法学 · 统计学 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman