English
Related papers

Related papers: Removing noise from correlations in multivariate s…

200 papers

Numerical studies of quantum field theories usually rely upon an accurate determination of stochastically estimated correlation functions in order to extract information about the spectrum of the theory and matrix elements of operators. The…

High Energy Physics - Lattice · Physics 2014-09-22 William Detmold , Michael G. Endres

We introduce a method for describing eigenvalue distributions of correlation matrices from multidimensional time series. Using our newly developed matrix H theory, we improve the description of eigenvalue spectra for empirical correlation…

Statistical Finance · Quantitative Finance 2025-12-01 Luan M. T. de Moraes , Antônio M. S. Macêdo , Giovani L. Vasconcelos , Raydonal Ospina

By using Random Matrix Theory, we build covariance matrices between stocks of the BM&F-Bovespa (Bolsa de Valores, Mercadorias e Futuros de S\~ao Paulo) which are cleaned of some of the noise due to the complex interactions between the many…

Portfolio Management · Quantitative Finance 2014-08-11 Leonidas Sandoval Junior , Adriana Bruscato , Maria Kelly Venezuela

This review covers recent results concerning the estimation of large covariance matrices using tools from Random Matrix Theory (RMT). We introduce several RMT methods and analytical techniques, such as the Replica formalism and Free…

Statistical Mechanics · Physics 2017-02-01 Joël Bun , Jean-Philippe Bouchaud , Marc Potters

One of the major challenges in multivariate analysis is the estimation of population covariance matrix from sample covariance matrix (SCM). Most recent covariance matrix estimators use either shrinkage transformations or asymptotic results…

Methodology · Statistics 2019-12-10 Samruddhi Deshmukh , Amartansh Dubey

We propose an algorithm to impute and forecast a time series by transforming the observed time series into a matrix, utilizing matrix estimation to recover missing values and de-noise observed entries, and performing linear regression to…

Machine Learning · Computer Science 2019-04-29 Anish Agarwal , Muhammad Jehangir Amjad , Devavrat Shah , Dennis Shen

The following working document summarizes our work on the clustering of financial time series. It was written for a workshop on information geometry and its application for image and signal processing. This workshop brought several experts…

Statistical Finance · Quantitative Finance 2016-03-28 Gautier Marti , Frank Nielsen , Philippe Donnat , Sébastien Andler

This study first reviews fuzzy random Portfolio selection theory and describes the concept of portfolio optimization model as a useful instrument for helping finance practitioners and researchers. Second, this paper specifically aims at…

Optimization and Control · Mathematics 2014-02-18 Mir Ehsan Hesam Sadati , Ali Doniavi

In this paper, we apply tools from the random matrix theory (RMT) to estimates of correlations across volatility of various assets in the S&P 500. The volatility inputs are estimated by modeling price fluctuations as GARCH(1,1) process. The…

Statistical Finance · Quantitative Finance 2013-10-08 Ajay Singh , Dinghai Xu

We use a replica approach to deal with portfolio optimization problems. A given risk measure is minimized using empirical estimates of asset values correlations. We study the phase transition which happens when the time series is too short…

Physics and Society · Physics 2009-11-13 Stefano Ciliberti , Marc Mezard

This study addresses limited attention allocation in a stochastic linear quadratic system with multiplicative noise. Our approach enables strategic resource allocation to enhance noise estimation and improve control decisions. We provide…

Optimization and Control · Mathematics 2024-03-28 Xiangyu Cui , Jianjun Gao , Lingjie Kong

We present a comparison between various algorithms of inference of covariance and precision matrices in small datasets of real vectors, of the typical length and dimension of human brain activity time series retrieved by functional Magnetic…

Statistical Mechanics · Physics 2023-02-07 Miguel Ibáñez-Berganza , Carlo Lucibello , Francesca Santucci , Tommaso Gili , Andrea Gabrielli

We propose improved methods to identify stock groups using the correlation matrix of stock price changes. By filtering out the marketwide effect and the random noise, we construct the correlation matrix of stock groups in which nontrivial…

Physics and Society · Physics 2008-12-02 Dong-Hee Kim , Hawoong Jeong

We propose a data-driven way to reduce the noise of covariance matrices of nonstationary systems. In the case of stationary systems, asymptotic approaches were proved to converge to the optimal solutions. Such methods produce eigenvalues…

Applications · Statistics 2023-03-10 Christian Bongiorno , Damien Challet , Grégoire Loeper

Distant supervision significantly reduces human efforts in building training data for many classification tasks. While promising, this technique often introduces noise to the generated training data, which can severely affect the model…

Computation and Language · Computer Science 2018-05-16 Bingfeng Luo , Yansong Feng , Zheng Wang , Zhanxing Zhu , Songfang Huang , Rui Yan , Dongyan Zhao

Time changes of noise level at Warsaw Stock Market are analyzed using a recently developed method basing on properties of the coarse grained entropy. The condition of the minimal noise level is used to build an efficient portfolio. Our…

Physics and Society · Physics 2008-12-02 Krzysztof Urbanowicz , Janusz A. Holyst

Noisy optimization is the optimization of objective functions corrupted by noise. A portfolio of solvers is a set of solvers equipped with an algorithm selection tool for distributing the computational power among them. Portfolios are…

Optimization and Control · Mathematics 2015-11-05 Marie-Liesse Cauwet , Jialin Liu , Rozière Baptiste , Olivier Teytaud

Modern portfolio optimization is centered around creating a low-risk portfolio with extensive asset diversification. Following the seminal work of Markowitz, optimal asset allocation can be computed using a constrained optimization model…

Portfolio Management · Quantitative Finance 2023-10-24 Yuanrong Wang , Antonio Briola , Tomaso Aste

Probabilistic approach to Boolean matrix factorization can provide solutions robustagainst noise and missing values with linear computational complexity. However,the assumption about latent factors can be problematic in real world…

Machine Learning · Statistics 2019-05-31 Lifan Liang , Songjian Lu

Trend change prediction in complex systems with a large number of noisy time series is a problem with many applications for real-world phenomena, with stock markets as a notoriously difficult to predict example of such systems. We approach…

Computational Finance · Quantitative Finance 2018-11-30 Ben Moews , J. Michael Herrmann , Gbenga Ibikunle