English
Related papers

Related papers: Tuning Parameter Selection for Penalized Estimatio…

200 papers

In recent years, a rich variety of regularization procedures have been proposed for high dimensional regression problems. However, tuning parameter choice and computational efficiency in ultra-high dimensional problems remain vexing issues.…

Computation · Statistics 2012-01-18 Hua Zhou , Artin Armagan , David B. Dunson

We present an approach for penalized tensor decomposition (PTD) that estimates smoothly varying latent factors in multi-way data. This generalizes existing work on sparse tensor decomposition and penalized matrix decompositions, in a manner…

Methodology · Statistics 2016-05-16 Oscar Hernan Madrid Padilla , James G. Scott

Statistical methods with empirical likelihood (EL) are appealing and effective especially in conjunction with estimating equations through which useful data information can be adaptively and flexibly incorporated. It is also known in the…

Statistics Theory · Mathematics 2018-12-21 Jinyuan Chang , Cheng Yong Tang , Tong Tong Wu

In the regression setting, given a set of hyper-parameters, a model-estimation procedure constructs a model from training data. The optimal hyper-parameters that minimize generalization error of the model are usually unknown. In practice…

Machine Learning · Statistics 2019-04-01 Jean Feng , Noah Simon

In this paper, we revisit the regret minimization problem in sparse stochastic contextual linear bandits, where feature vectors may be of large dimension $d$, but where the reward function depends on a few, say $s_0\ll d$, of these features…

Machine Learning · Statistics 2022-06-22 Kaito Ariu , Kenshi Abe , Alexandre Proutière

Many statistical methods have been proposed for variable selection in the past century, but few balance inference and prediction tasks well. Here we report on a novel variable selection approach called Penalized regression with…

Methodology · Statistics 2021-06-16 Yi Zuo , Thomas G. Stewart , Jeffrey D. Blume

Penalized least squares estimation is a popular technique in high-dimensional statistics. It includes such methods as the LASSO, the group LASSO, and the nuclear norm penalized least squares. The existing theory of these methods is not…

Statistics Theory · Mathematics 2017-07-10 Pierre C. Bellec , Guillaume Lecué , Alexandre B. Tsybakov

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

Machine Learning · Statistics 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

This paper studies an integrated learning and optimization problem in which a prediction model estimates the right-hand-side parameters of a linear program (LP) using a contextual vector. Considering that such a prediction alters the…

Optimization and Control · Mathematics 2026-05-15 Jackson Forner , Miju Ahn , Harsha Gangammanavar

This paper deals with the problem of estimating a slope parameter in a simple linear regression model, where independent variables have functional measurement errors. Measurement errors in independent variables, as is well known, cause…

Statistics Theory · Mathematics 2018-04-10 Hisayuki Tsukuma

In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings. Improving the calibration of classifiers is crucial for enhancing the…

Machine Learning · Computer Science 2025-02-24 Sebastian G. Gruber , Francis Bach

Many applied settings in empirical economics involve simultaneous estimation of a large number of parameters. In particular, applied economists are often interested in estimating the effects of many-valued treatments (like teacher effects…

Machine Learning · Statistics 2017-04-03 Alberto Abadie , Maximilian Kasy

We study the Cox models with semiparametric relative risk, which can be partially linear with one nonparametric component, or multiple additive or nonadditive nonparametric components. A penalized partial likelihood procedure is proposed to…

Statistics Theory · Mathematics 2010-10-20 Pang Du , Shuangge Ma , Hua Liang

We study the addition of shape constraints (SC) and their consideration during the parameter identification step of symbolic regression (SR). SC serve as a means to introduce prior knowledge about the shape of the otherwise unknown model…

Machine Learning · Computer Science 2024-08-07 Viktor Martinek , Julia Reuter , Ophelia Frotscher , Sanaz Mostaghim , Markus Richter , Roland Herzog

Penalized likelihood approaches are widely used for high-dimensional regression. Although many methods have been proposed and the associated theory is now well-developed, the relative efficacy of different approaches in finite-sample…

Methodology · Statistics 2020-01-29 Fan Wang , Sach Mukherjee , Sylvia Richardson , Steven M. Hill

The expectation-maximization (EM) algorithm and its variants are widely used in statistics. In high-dimensional mixture linear regression, the model is assumed to be a finite mixture of linear regression and the number of predictors is much…

Statistics Theory · Mathematics 2023-07-24 Ning Wang , Xin Zhang , Qing Mai

The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full control over the…

Penalised estimation methods for point processes usually rely on a large amount of independent repetitions for cross-validation purposes. However, in the case of a single realisation of the process, existing cross-validation methods may be…

Methodology · Statistics 2026-01-13 Miguel Martinez Herrera , Felix Cheysson

Algorithmic Bias can be due to bias in the training data or issues with the algorithm itself. These algorithmic issues typically relate to problems with model capacity and regularisation. This underestimation bias may arise because the…

Machine Learning · Computer Science 2021-06-01 William Blanzeisky , Pádraig Cunningham

This paper presents a new approach to solve linear and nonlinear model predictive control (MPC) problems that requires small memory footprint and throughput and is particularly suitable when the model and/or controller parameters change at…

Optimization and Control · Mathematics 2021-03-25 Nilay Saraf , Alberto Bemporad