English
Related papers

Related papers: Regularized Generalized Covariance (RGCov) Estimat…

200 papers

We develop a quadratic regularization approach for the solution of high-dimensional multistage stochastic optimization problems characterized by a potentially large number of time periods/stages (e.g. hundreds), a high-dimensional resource…

Optimization and Control · Mathematics 2017-02-28 Tsvetan Asamov , Warren B. Powell

The estimation of covariance matrices of multiple classes with limited training data is a difficult problem. The sample covariance matrix (SCM) is known to perform poorly when the number of variables is large compared to the available…

Methodology · Statistics 2021-11-10 Elias Raninen , Esa Ollila

When the regressors of a econometric linear model are nonorthogonal, it is well known that their estimation by ordinary least squares can present various problems that discourage the use of this model. The ridge regression is the most…

The conditional value-at-risk (CVaR) is a useful risk measure in fields such as machine learning, finance, insurance, energy, etc. When measuring very extreme risk, the commonly used CVaR estimation method of sample averaging does not work…

Methodology · Statistics 2021-03-10 Dylan Troop , Frédéric Godin , Jia Yuan Yu

Cross-validation (CV) is often used to select the regularization parameter in high dimensional problems. However, when applied to the sparse modeling method Lasso, CV leads to models that are unstable in high-dimensions, and consequently…

Methodology · Statistics 2015-10-28 Chinghway Lim , Bin Yu

The purpose of this work is to improve the efficiency in estimating the average causal effect (ACE) on the survival scale where right-censoring exists and high-dimensional covariate information is available. We propose new estimators using…

Methodology · Statistics 2021-06-29 Ran Dai , Cheng Zheng , Mei-Jie Zhang

Kernel Regularized Least Squares (KRLS) is a popular method for flexibly estimating models that may have complex relationships between variables. However, its usefulness to many researchers is limited for two reasons. First, existing…

Machine Learning · Statistics 2023-09-12 Qing Chang , Max Goplerud

An adaptive regularization algorithm for unconstrained nonconvex optimization is proposed that is capable of handling inexact objective-function and derivative values, and also of providing approximate minimizer of arbitrary order. In…

Optimization and Control · Mathematics 2021-11-30 N. I. M. Gould , Ph. L. Toint

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

In this paper, we propose a novel variable selection approach in the framework of high-dimensional linear models where the columns of the design matrix are highly correlated. It consists in rewriting the initial high-dimensional linear…

Statistics Theory · Mathematics 2021-06-11 Wencan Zhu , Eric Adjakossa , Céline Lévy-Leduc , Nils Ternès

Replica exchange stochastic gradient Langevin dynamics (reSGLD) has shown promise in accelerating the convergence in non-convex learning; however, an excessively large correction for avoiding biases from noisy energy estimators has limited…

Machine Learning · Statistics 2021-03-19 Wei Deng , Qi Feng , Georgios Karagiannis , Guang Lin , Faming Liang

We consider the problem of estimating and inferring treatment effects in randomized experiments. In practice, stratified randomization, or more generally, covariate-adaptive randomization, is routinely used in the design stage to balance…

Methodology · Statistics 2022-09-27 Hanzhong Liu , Fuyi Tu , Wei Ma

Total Variation (TV) based regularization has been widely applied in restoration problems due to its simple derivative filters based formulation and robust performance. While first order TV suffers from staircase effect, second order TV…

Signal Processing · Electrical Eng. & Systems 2019-04-08 Sanjay Viswanath , Muthuvel Arigovindan

Latent factor models that integrate data from multiple sources/studies or modalities have garnered considerable attention across various disciplines. However, existing methods predominantly focus either on multi-study integration or…

Methodology · Statistics 2025-07-15 Wei Liu , Qingzhi Zhong

We investigate the Randomized Stochastic Accelerated Gradient (RSAG) method, utilizing either constant or adaptive step sizes, for stochastic optimization problems with generalized smooth objective functions. Under relaxed affine variance…

Optimization and Control · Mathematics 2025-02-25 Chenhao Yu , Yusu Hong , Junhong Lin

In cluster-randomized trials, generalized linear mixed models and generalized estimating equations have conventionally been the default analytic methods for estimating the average treatment effect as routine practice. However, recent…

Methodology · Statistics 2025-09-19 Fan Li , Jiaqi Tong , Xi Fang , Chao Cheng , Brennan C. Kahan , Bingkai Wang

In this paper, we introduce the Generalized Mixed Regularized Reduced Rank Regression model (GMR4), an extension of the GMR3 model designed to improve performance in high-dimensional settings. GMR3 is a regression method for a mix of…

Methodology · Statistics 2025-12-16 Lorenza Cotugno , Mark de Rooij , Roberta Siciliano

Stochastic gradient descent (SGD) has been widely studied in the literature from different angles, and is commonly employed for solving many big data machine learning problems. However, the averaging technique, which combines all iterative…

Machine Learning · Computer Science 2020-05-28 Zhishuai Guo , Yan Yan , Tianbao Yang

Several statistical models used in genome-wide prediction assume independence of marker allele substitution effects, but it is known that these effects might be correlated. In statistics, graphical models have been identified as a useful…

Quantitative Methods · Quantitative Biology 2017-04-13 Carlos Alberto Martínez , Kshitij Khare , Syed Rahman , Mauricio A. Elzo

K-fold cross-validation (CV) with squared error loss is widely used for evaluating predictive models, especially when strong distributional assumptions cannot be taken. However, CV with squared error loss is not free from distributional…

Methodology · Statistics 2021-08-10 Assaf Rabinowicz , Saharon Rosset