English
Related papers

Related papers: Removing noise from correlations in multivariate s…

200 papers

In this paper, we document a novel machine learning based bottom-up approach for static and dynamic portfolio optimization on, potentially, a large number of assets. The methodology applies to general constrained optimization problems and…

Mathematical Finance · Quantitative Finance 2020-11-24 Qing Yang , Zhenning Hong , Ruyan Tian , Tingting Ye , Liangliang Zhang

We present a new quantum Monte Carlo algorithm suitable for generically complex problems, such as systems coupled to external magnetic fields or anyons in two spatial dimensions. We find that the choice of gauge plays a nontrivial role, and…

Condensed Matter · Physics 2009-10-22 Lizeng Zhang , Geoff Canright , Ted Barnes

A host of problems involve the recovery of structured signals from a dimensionality reduced representation such as a random projection; examples include sparse signals (compressive sensing) and low-rank matrices (matrix completion). Given…

Information Theory · Computer Science 2012-05-22 Shirin Jalali , Arian Maleki , Richard Baraniuk

How can graph theory be applied to investing in the stock market? The answer may help investors realize the true risks of their investments, help prevent recessions like that of 2008, and increase financial literacy amongst students. Using…

Statistical Finance · Quantitative Finance 2019-02-05 Joseph Attia

This paper studies the time-varying structure of the equity market with respect to market capitalization. First, we analyze the distribution of the 100 largest companies' market capitalizations over time, in terms of inequality,…

Mathematical Finance · Quantitative Finance 2025-02-21 Nick James , Max Menzies

In recent years, deep or reinforcement learning approaches have been applied to optimise investment portfolios through learning the spatial and temporal information under the dynamic financial market. Yet in most cases, the existing…

Portfolio Management · Quantitative Finance 2024-04-16 Zhenglong Li , Vincent Tam

We study some properties of eigenvalue spectra of financial correlation matrices. In particular, we investigate the nature of the large eigenvalue bulks which are observed empirically, and which have often been regarded as a consequence of…

Statistical Finance · Quantitative Finance 2015-05-27 G. Livan , S. Alfarano , E. Scalas

We investigate financial market correlations using random matrix theory and principal component analysis. We use random matrix theory to demonstrate that correlation matrices of asset price changes contain structure that is incompatible…

Statistical Finance · Quantitative Finance 2015-03-17 Daniel J. Fenn , Mason A. Porter , Stacy Williams , Mark McDonald , Neil F. Johnson , Nick S. Jones

Verifying the performance of safety-critical, stochastic systems with complex noise distributions is difficult. We introduce a general procedure for the finite abstraction of nonlinear stochastic systems with non-standard (e.g., non-affine,…

Systems and Control · Electrical Eng. & Systems 2023-09-20 John Skovbekk , Luca Laurenti , Eric Frew , Morteza Lahijanian

We show how pre-averaging can be applied to the problem of measuring the ex-post covariance of financial asset returns under microstructure noise and non-synchronous trading. A pre-averaged realised covariance is proposed, and we present an…

Econometrics · Economics 2026-02-24 Kim Christensen , Silja Kinnebrock , Mark Podolskij

This paper examines a general class of noisy matrix completion tasks where the goal is to estimate a matrix from observations obtained at a subset of its entries, each of which is subject to random noise or corruption. Our specific focus is…

Machine Learning · Statistics 2016-11-18 Akshay Soni , Swayambhoo Jain , Jarvis Haupt , Stefano Gonella

In many situations, sample data is obtained from a noisy or imperfect source. In order to address such corruptions, this paper introduces the concept of a sampling corrector. Such algorithms use structure that the distribution is purported…

Data Structures and Algorithms · Computer Science 2018-04-03 Clément Canonne , Themis Gouleakis , Ronitt Rubinfeld

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

This paper develops a large-scale inference approach for the regularization of stock return covariance matrices. The framework allows for the presence of heavy tails and multivariate GARCH-type effects of unknown form among the stock…

Econometrics · Economics 2024-07-16 Richard Luger

Financial markets are highly correlated systems that reveal both the inter-market dependencies and the correlations among their different components. Standard analyzing techniques include correlation coefficients for pairs of signals and…

Physics and Society · Physics 2008-12-02 J. Kwapien , S. Drozdz , A. Z. Gorski , P. Oswiecimka

In this paper, we consider estimating spot/instantaneous volatility matrices of high-frequency data collected for a large number of assets. We first combine classic nonparametric kernel-based smoothing with a generalised shrinkage technique…

Econometrics · Economics 2026-04-22 Ruijun Bu , Degui Li , Oliver Linton , Hanchao Wang

Noise is a fundamental problem in learning theory with huge effects in the application of Machine Learning (ML) methods, due to real world data tendency to be noisy. Additionally, introduction of malicious noise can make ML methods fail…

Machine Learning · Computer Science 2024-06-13 Alfredo Ibias , Karol Capala , Varun Ravi Varma , Anna Drozdz , Jose Sousa

Distant and weak supervision allow to obtain large amounts of labeled training data quickly and cheaply, but these automatic annotations tend to contain a high amount of errors. A popular technique to overcome the negative effects of these…

Machine Learning · Computer Science 2021-03-02 Michael A. Hedderich , Dawei Zhu , Dietrich Klakow

We derive a method to reconstruct Gaussian signals from linear measurements with Gaussian noise. This new algorithm is intended for applications in astrophysics and other sciences. The starting point of our considerations is the principle…

Instrumentation and Methods for Astrophysics · Physics 2011-10-18 Niels Oppermann , Georg Robbers , Torsten A. Ensslin

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren