English
Related papers

Related papers: Cleaning large correlation matrices: tools from ra…

200 papers

Randomized algorithms for very large matrix problems have received a great deal of attention in recent years. Much of this work was motivated by problems in large-scale data analysis, and this work was performed by individuals from many…

Data Structures and Algorithms · Computer Science 2011-11-16 Michael W. Mahoney

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

This paper investigates a statistical procedure for testing the equality of two independent estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Statistics Theory · Mathematics 2020-06-01 Rémy Mariétan , Stephan Morgenthaler

Incomplete relevance judgments limit the re-usability of test collections. When new systems are compared against previous systems used to build the pool of judged documents, they often do so at a disadvantage due to the ``holes'' in test…

Information Retrieval · Computer Science 2024-05-10 Zahra Abbasiantaeb , Chuan Meng , Leif Azzopardi , Mohammad Aliannejadi

Computation of the trace of a matrix function plays an important role in many scientific computing applications, including applications in machine learning, computational physics (e.g., lattice quantum chromodynamics), network analysis and…

Data Structures and Algorithms · Computer Science 2017-03-10 Insu Han , Dmitry Malioutov , Haim Avron , Jinwoo Shin

We study the problem of recovering an incomplete $m\times n$ matrix of rank $r$ with columns arriving online over time. This is known as the problem of life-long matrix completion, and is widely applied to recommendation system, computer…

Machine Learning · Computer Science 2016-12-04 Maria-Florina Balcan , Hongyang Zhang

We present new ways of producing a channel chart [1] employing model-based approaches. We estimate the angle of arrival theta and the distance rho between the base station and the user equipment by employing our algorithms, inverse of the…

Emerging Technologies · Computer Science 2025-05-13 Amr Aly , Ender Ayanoglu

The statistical properties of estimator using covariance matrix for the account of point-to-point correlations due to systematic errors are analyzed. It is shown that the covariance matrix estimator (CME) is consistent for the realistic…

High Energy Physics - Experiment · Physics 2007-05-23 Alekhin Sergey

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

A fundamental problem in multivariate analysis is testing general linear hypotheses for regression coefficients in a multivariate linear model. This framework encompasses a wide range of well-studied tasks, including MANOVA, joint…

Methodology · Statistics 2025-07-09 Haoran Li

Recovering a low rank matrix from a subset of its entries, some of which may be corrupted, is known as the robust matrix completion (RMC) problem. Existing RMC methods have several limitations: they require a relatively large number of…

Machine Learning · Computer Science 2025-12-16 Eilon Vaknin Laufer , Boaz Nadler

Instrumental variables estimation with many instruments is biased. Traditional bias-adjustments are closely connected to the Silverstein equation. Based on the theory of random matrices, we show that Ridge estimation of the first-stage…

Econometrics · Economics 2025-08-25 Helmut Farbmacher , Rebecca Groh , Michael Mühlegger , Gabriel Vollert

In this paper, we consider the problem of identifying a linear map from measurements which are subject to intermittent and arbitarily large errors. This is a fundamental problem in many estimation-related applications such as fault…

Systems and Control · Computer Science 2016-08-09 Laurent Bako , Henrik Ohlsson

We give a new algorithm for the estimation of the cross-covariance matrix $\mathbb{E} XY'$ of two large dimensional signals $X\in\mathbb{R}^n$, $Y\in \mathbb{R}^p$ in the context where the number $T$ of observations of the pair $(X,Y)$ is…

Statistics Theory · Mathematics 2021-11-19 Florent Benaych-Georges , Jean-Philippe Bouchaud , Marc Potters

Randomized matrix algorithms have become workhorse tools in scientific computing and machine learning. To use these algorithms safely in applications, they should be coupled with posterior error estimates to assess the quality of the…

Numerical Analysis · Mathematics 2024-10-03 Ethan N. Epperly , Joel A. Tropp

The recently introduced Tsetlin Machine (TM) has provided competitive pattern classification accuracy in several benchmarks, composing patterns with easy-to-interpret conjunctive clauses in propositional logic. In this paper, we go beyond…

Machine Learning · Computer Science 2019-06-25 K. Darshana Abeyrathna , Ole-Christoffer Granmo , Lei Jiao , Morten Goodwin

We analyse the structure of the distribution of eigenvalues of the stock market correlation matrix with increasing length of the time series representing the price changes. We use 100 highly-capitalized stocks from the American market and…

Physics and Society · Physics 2009-11-11 J. Kwapien , P. Oswiecimka , S. Drozdz

Correlation functions involving products and ratios of half-integer powers of characteristic polynomials of random matrices from the Gaussian Orthogonal Ensemble (GOE) frequently arise in applications of Random Matrix Theory (RMT) to…

Mathematical Physics · Physics 2015-04-23 Yan V. Fyodorov , André Nock

Results from Randomized Controlled Trials (RCTs) establish the comparative effectiveness of interventions, and are in turn critical inputs for evidence-based care. However, results from RCTs are presented in (often unstructured) natural…

Computation and Language · Computer Science 2023-07-19 Somin Wadhwa , Jay DeYoung , Benjamin Nye , Silvio Amir , Byron C. Wallace

The comovement phenomenon in financial markets creates decision scenarios with positively correlated asset returns. This paper addresses covariance matrix estimation under such conditions, motivated by observations of significant positive…

Econometrics · Economics 2025-07-03 Weilong Liu , Yanchu Liu