English
Related papers

Related papers: The Spectral Condition Number Plot for Regularizat…

200 papers

For many high-dimensional studies, additional information on the variables, like (genomic) annotation or external p-values, is available. In the context of binary and continuous prediction, we develop a method for adaptive group-regularized…

Covariance regression offers an effective way to model the large covariance matrix with the auxiliary similarity matrices. In this work, we propose a sparse covariance regression (SCR) approach to handle the potentially high-dimensional…

Methodology · Statistics 2024-10-17 Yuan Gao , Zhiyuan Zhang , Zhanrui Cai , Xuening Zhu , Tao Zou , Hansheng Wang

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

Machine Learning · Statistics 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

Path analysis is a model class of structural equation modeling (SEM), which it describes causal relations among measured variables in the form of a multiple linear regression. This paper presents two estimation formulations, one each for…

Optimization and Control · Mathematics 2019-05-03 Anupon Pruttiakaravanich , Jitkomut Songsiri

In this paper we present a general framework for estimating regression models subject to a user-defined level of fairness. We enforce fairness as a model selection step in which we choose the value of a ridge penalty to control the effect…

Machine Learning · Computer Science 2025-11-18 Marco Scutari , Francesca Panero , Manuel Proissl

We consider the P1/P1 or P1b/P1 finite element approximations to the Stokes equations in a bounded smooth domain subject to the slip boundary condition. A penalty method is applied to address the essential boundary condition $u\cdot n = g$…

Numerical Analysis · Mathematics 2015-05-26 Takahito Kashiwabara , Issei Oikawa , Guanyu Zhou

We study decision rule approximations for generic multi-stage robust linear optimization problems. We consider linear decision rules for the case when the objective coefficients, the recourse matrices, and the right-hand sides are…

Optimization and Control · Mathematics 2021-05-04 Guanglin Xu , Grani A. Hanasusanto

Speckle patterns are used in a broad range of applications including microscopy, imaging, and light-matter interactions. Tailoring speckles' statistics can dramatically enhance their performance in applications. We present an experimental…

Point processes are stochastic models generating interacting points or events in time, space, etc. Among characteristics of these models, first-order intensity and conditional intensity functions are often considered. We focus on…

Statistics Theory · Mathematics 2023-05-24 Jean-François Coeurjolly , Ismaïla Ba , Achmad Choiruddin

The use of improved covariance matrix estimators as an alternative to the sample estimator is considered an important approach for enhancing portfolio optimization. Here we empirically compare the performance of 9 improved covariance…

Portfolio Management · Quantitative Finance 2010-04-27 Ester Pantaleo , Michele Tumminello , Fabrizio Lillo , Rosario N. Mantegna

Maintaining numerical stability in machine learning models is crucial for their reliability and performance. One approach to maintain stability of a network layer is to integrate the condition number of the weight matrix as a regularizing…

Machine Learning · Computer Science 2024-10-02 Rossen Nenov , Daniel Haider , Peter Balazs

In this paper we consider the training of single hidden layer neural networks by pseudoinversion, which, in spite of its popularity, is sometimes affected by numerical instability issues. Regularization is known to be effective in such…

Neural and Evolutionary Computing · Computer Science 2015-08-26 Rossella Cancelliere , Mario Gai , Patrick Gallinari , Luca Rubini

This paper explores the calibration of a classifier output score in binary classification problems. A calibrator is a function that maps the arbitrary classifier score, of a testing observation, onto $[0,1]$ to provide an estimate for the…

Machine Learning · Computer Science 2022-04-29 Waleed A. Yousef , Issa Traore , William Briguglio

Modern data analysis depends increasingly on estimating models via flexible high-dimensional or nonparametric machine learning methods, where the identification of structural parameters is often challenging and untestable. In linear…

Statistics Theory · Mathematics 2026-01-21 Andrii Babii , Jean-Pierre Florens

G-computation has become a widely used robust method for estimating unconditional (marginal) treatment effects with covariate adjustment in the analysis of randomized clinical trials. Statistical inference in this context typically relies…

Methodology · Statistics 2025-03-18 Xin Zhang , Haitao Chu , Lin Liu , Satrajit Roychoudhury

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

This paper characterizes the conditional distribution properties of the finite sample ridge regression estimator and uses that result to evaluate total regression and generalization errors that incorporate the inaccuracies committed at the…

Machine Learning · Statistics 2016-05-31 Lyudmila Grigoryeva , Juan-Pablo Ortega

Target characterization is an important step in many defense missions, often relying on fitting a known target model to observed data. Optimization of model parameters can be computationally expensive depending on the model complexity, thus…

Signal Processing · Electrical Eng. & Systems 2022-06-07 Zachary Chance , Adam Kern , Arianna Burch , Justin Goodwin

We compute spectra of large stochastic matrices $W$, defined on sparse random graphs, where edges $(i,j)$ of the graph are given positive random weights $W_{ij}>0$ in such a fashion that column sums are normalized to one. We compute spectra…

Disordered Systems and Neural Networks · Physics 2015-06-23 Reimer Kuehn