English
Related papers

Related papers: Hierarchical Regularizers for Reverse Unrestricted…

200 papers

Variance estimation is a fundamental problem in statistical modeling. In ultrahigh dimensional linear regressions where the dimensionality is much larger than sample size, traditional variance estimation techniques are not applicable.…

Methodology · Statistics 2010-12-27 Jianqing Fan , Shaojun Guo , Ning Hao

Sparse hyperspectral unmixing from large spectral libraries has been considered to circumvent limitations of endmember extraction algorithms in many applications. This strategy often leads to ill-posed inverse problems, which can benefit…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Ricardo Augusto Borsoi , Tales Imbiriba , José Carlos Moreira Bermudez , Cédric Richard

The optimization of the variance supplemented by a budget constraint and an asymmetric $\ell_1$ regularizer is carried out analytically by the replica method borrowed from the theory of disordered systems. The asymmetric regularizer allows…

Portfolio Management · Quantitative Finance 2018-07-16 Imre Kondor , Gábor Papp , Fabio Caccioli

The use of convex regularizers allows for easy optimization, though they often produce biased estimation and inferior prediction performance. Recently, nonconvex regularizers have attracted a lot of attention and outperformed convex ones.…

Optimization and Control · Mathematics 2017-02-14 Quanming Yao , James. T Kwok

We introduce a new algorithm, extended regularized dual averaging (XRDA), for solving regularized stochastic optimization problems, which generalizes the regularized dual averaging (RDA) method. The main novelty of the method is that it…

Optimization and Control · Mathematics 2022-07-14 Jonathan W. Siegel , Jinchao Xu

Two methods are proposed for high-dimensional shape-constrained regression and classification. These methods reshape pre-trained prediction rules to satisfy shape constraints like monotonicity and convexity. The first method can be applied…

Machine Learning · Statistics 2018-05-17 Matt Bonakdarpour , Sabyasachi Chatterjee , Rina Foygel Barber , John Lafferty

Existing methods of vector autoregressive model for multivariate time series analysis make use of low-rank matrix approximation or Tucker decomposition to reduce the dimension of the over-parameterization issue. In this paper, we propose a…

Statistics Theory · Mathematics 2026-01-05 Sijia Xia , Michael K. Ng , Xiongjun Zhang

Regularization plays a pivotal role when facing the challenge of solving ill-posed inverse problems, where the number of observations is smaller than the ambient dimension of the object to be estimated. A line of recent work has studied…

Optimization and Control · Mathematics 2014-07-03 Samuel Vaiter , Mohammad Golbabaee , Jalal M. Fadili , Gabriel Peyré

We consider supervised dimension reduction problems, namely to identify a low dimensional projection of the predictors $\-x$ which can retain the statistical relationship between $\-x$ and the response variable $y$. We follow the idea of…

Computation · Statistics 2019-10-31 Xin Cai , Guang Lin , Jinglai Li

The sample covariance matrix becomes non-invertible in high-dimensional settings, making classical multivariate statistical methods inapplicable. Various regularization techniques address this issue by imposing a structured target matrix to…

Methodology · Statistics 2025-03-13 Atiq Ur Rehman , Muhammad Farooq

From benign overfitting in overparameterized models to rich power-law scalings in performance, simple ridge regression displays surprising behaviors sometimes thought to be limited to deep neural networks. This balance of phenomenological…

Machine Learning · Statistics 2026-05-08 Alexander Atanasov , Jacob A. Zavatone-Veth , Cengiz Pehlevan

Asymmetry along with heteroscedasticity or contamination often occurs with the growth of data dimensionality. In ultra-high dimensional data analysis, such irregular settings are usually overlooked for both theoretical and computational…

Statistics Theory · Mathematics 2022-07-20 Bin Luo , Xiaoli Gao

Low-complexity non-smooth convex regularizers are routinely used to impose some structure (such as sparsity or low-rank) on the coefficients for linear predictors in supervised learning. Model consistency consists then in selecting the…

Optimization and Control · Mathematics 2019-01-17 Jalal Fadili , Guillaume Garrigos , Jérome Malick , Gabriel Peyré

The reduced-rank vector autoregressive (VAR) model can be interpreted as a supervised factor model, where two factor modelings are simultaneously applied to response and predictor spaces. This article introduces a new model, called vector…

Methodology · Statistics 2023-06-16 Di Wang , Xiaoyu Zhang , Guodong Li , Ruey Tsay

Recent methods in quantile regression have adopted a classification perspective to handle challenges posed by heteroscedastic, multimodal, or skewed data by quantizing outputs into fixed bins. Although these regression-as-classification…

Machine Learning · Computer Science 2024-11-05 Batuhan Cengiz , Halil Faruk Karagoz , Tufan Kumbasar

Discrete inverse problems correspond to solving a system of equations in a stable way with respect to noise in the data. A typical approach to enforce uniqueness and select a meaningful solution is to introduce a regularizer. While for most…

Optimization and Control · Mathematics 2022-04-22 Cristian Vega , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

Machine Learning · Statistics 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang

We develop a highly scalable optimization method called "hierarchical group-thresholding" for solving a multi-task regression model with complex structured sparsity constraints on both input and output spaces. Despite the recent emergence…

Machine Learning · Statistics 2012-08-16 Seunghak Lee , Eric P. Xing

Optimization-based samplers such as randomize-then-optimize (RTO) [2] provide an efficient and parallellizable approach to solving large-scale Bayesian inverse problems. These methods solve randomly perturbed optimization problems to draw…

Computation · Statistics 2019-10-29 Johnathan Bardsley , Tiangang Cui , Youssef Marzouk , Zheng Wang

The application of distributed model predictive controllers (DMPC) for multi-agent systems (MASs) necessitates communication between agents, yet the consequence of communication data rates is typically overlooked. This work focuses on…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Yujia Yang , Ye Wang , Chris Manzie , Ye Pu