English
Related papers

Related papers: Precision versus Shrinkage: A Comparative Analysis…

200 papers

In this paper, we document a novel machine learning based bottom-up approach for static and dynamic portfolio optimization on, potentially, a large number of assets. The methodology applies to general constrained optimization problems and…

Mathematical Finance · Quantitative Finance 2020-11-24 Qing Yang , Zhenning Hong , Ruyan Tian , Tingting Ye , Liangliang Zhang

In this work, we study the positive definiteness (PDness) problem in covariance matrix estimation. For high dimensional data, many regularized estimators are proposed under structural assumptions on the true covariance matrix including…

Methodology · Statistics 2019-04-16 Young-Geun Choi , Johan Lim , Anindya Roy , Junyong Park

We present a new method for estimating multivariate, second-order stationary Gaussian Random Field (GRF) models based on the Sparse Precision matrix Selection (SPS) algorithm, proposed by Davanloo et al. (2015) for estimating scalar GRF…

Machine Learning · Statistics 2021-01-12 Sam Davanloo Tajbakhsh , Necdet Serhat Aybat , Enrique del Castillo

We investigate whether sophisticated volatility estimation improves the out-of-sample performance of mean-variance portfolio strategies relative to the naive 1/N strategy. The portfolio strategies rely solely upon second moments. Using a…

General Finance · Quantitative Finance 2022-02-15 Michael Curran , Patrick O'Sullivan , Ryan Zalla

Portfolio optimization has been a central problem in finance, often approached with two steps: calibrating the parameters and then solving an optimization problem. Yet, the two-step procedure sometimes encounter the "error maximization"…

Portfolio Management · Quantitative Finance 2021-07-13 Ayse Sinem Uysal , Xiaoyue Li , John M. Mulvey

This paper is concerned with portfolio optimization models for creating high-quality lists of recommended items to balance the accuracy and diversity of recommendations. However, the statistics (i.e., expectation and covariance of ratings)…

Information Retrieval · Computer Science 2024-10-01 Tomoya Yanagi , Shunnosuke Ikeda , Yuichi Takano

Stochastic gradient methods are among the most widely used algorithms for large-scale optimization and machine learning. A key technique for improving the statistical efficiency and stability of these methods is the use of averaging schemes…

Optimization and Control · Mathematics 2026-03-11 K. Lakshmanan

Finding an unconstrained and statistically interpretable reparameterization of a covariance matrix is still an open problem in statistics. Its solution is of central importance in covariance estimation, particularly in the recent…

Methodology · Statistics 2012-02-09 Mohsen Pourahmadi

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

The spiked covariance model has gained increasing popularity in high-dimensional data analysis. A fundamental problem is determination of the number of spiked eigenvalues, $K$. For estimation of $K$, most attention has focused on the use of…

Methodology · Statistics 2021-01-07 Zheng Tracy Ke , Yucong Ma , Xihong Lin

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Choosing a shrinkage method can be done by selecting a penalty from a list of pre-specified penalties or by constructing a penalty based on the data. If a list of penalties for a class of linear models is given, we provide comparisons based…

Methodology · Statistics 2022-01-10 Dean Dustin , Bertrand Clarke , Jennifer Clarke

Graph generation is a crucial task in many fields, including network science and bioinformatics, as it enables the creation of synthetic graphs that mimic the properties of real-world networks for various applications. Graph Generative…

Machine Learning · Computer Science 2026-01-21 Salvatore Romano , Marco Grassia , Giuseppe Mangioni

We propose PACE-GGM, a data-adaptive differentially private method for covariance estimation that concentrates its privacy budget on the most informative entries of the empirical covariance matrix, rather than perturbing all entries. This…

Machine Learning · Computer Science 2026-05-26 Cecilia Ferrando , Miguel Fuentes , Brett Mullins , Cameron Musco , Daniel Sheldon

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

We introduce a unified framework for rapid, large-scale portfolio optimization that incorporates both shrinkage and regularization techniques. This framework addresses multiple objectives, including minimum variance, mean-variance, and the…

Portfolio Management · Quantitative Finance 2023-11-13 Weichuan Deng , Pawel Polak , Abolfazl Safikhani , Ronakdilip Shah

We address structured covariance estimation in elliptical distributions by assuming that the covariance is a priori known to belong to a given convex set, e.g., the set of Toeplitz or banded matrices. We consider the General Method of…

Machine Learning · Statistics 2023-07-19 Ilya Soloveychik , Ami Wiesel

We propose a new stochastic optimization framework for empirical risk minimization problems such as those that arise in machine learning. The traditional approaches, such as (mini-batch) stochastic gradient descent (SGD), utilize an…

Machine Learning · Statistics 2020-02-04 Kenji Kawaguchi , Haihao Lu

Weighting methods are widely used to adjust for covariates in observational studies, sample surveys, and regression settings. In this paper, we study a class of recently proposed weighting methods which find the weights of minimum…

Methodology · Statistics 2019-10-29 Yixin Wang , José R. Zubizarreta

Uncertainty estimation plays an important role for future reliable deployment of deep segmentation models in safety-critical scenarios such as medical applications. However, existing methods for uncertainty estimation have been limited by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Hongzheng Yang , Cheng Chen , Yueyao Chen , Markus Scheppach , Hon Chi Yip , Qi Dou