中文
相关论文

相关论文: Estimation of large covariance matrices via free d…

200 篇论文

Given a sample of i.i.d. high-dimensional centered random vectors, we consider a problem of estimation of their covariance matrix $\Sigma$ with an additional assumption that $\Sigma$ can be represented as a sum of a few Kronecker products…

统计理论 · 数学 2024-06-18 Nikita Puchkin , Maxim Rakhuba

We study online inference and asymptotic covariance estimation for the stochastic gradient descent (SGD) algorithm. While classical methods (such as plug-in and batch-means estimators) are available, they either require inaccessible…

机器学习 · 统计学 2026-04-24 Ziyang Wei , Wanrong Zhu , Jingyang Lyu , Wei Biao Wu

In these notes we discuss tools and concepts that emerge when studying high-dimensional random landscapes, i.e., random functions on high-dimensional spaces. As an illustrative example, we consider an inference problem in two forms:…

无序系统与神经网络 · 物理学 2025-08-12 Valentina Ros

Covariance matrix estimates are an essential part of many signal processing algorithms, and are often used to determine a low-dimensional principal subspace via their spectral decomposition. However, exact eigenanalysis is computationally…

应用统计 · 统计学 2011-12-01 Nicholas Arcolano , Patrick J. Wolfe

We propose a determinant-free approach for simulation-based Bayesian inference in high-dimensional Gaussian models. We introduce auxiliary variables with covariance equal to the inverse covariance of the model. The joint probability of the…

统计计算 · 统计学 2017-09-12 Louis Ellam , Heiko Strathmann , Mark Girolami , Iain Murray

AIMS. The maximum-likelihood method is the standard approach to obtain model fits to observational data and the corresponding confidence regions. We investigate possible sources of bias in the log-likelihood function and its subsequent…

天体物理学 · 物理学 2009-11-11 J. Hartlap , P. Simon , P. Schneider

Estimating copulas with discrete marginal distributions is challenging, especially in high dimensions, because computing the likelihood contribution of each observation requires evaluating $2^{J}$ terms, with $J$ the number of discrete…

统计方法学 · 统计学 2018-11-12 D. Gunawan , M. -N. Tran , K. Suzuki , J. Dick , R. Kohn

Large-scale distributed systems such as sensor networks, often need to achieve filtering and consensus on an estimated parameter from high-dimensional measurements. Running a Kalman filter on every node in such a network is computationally…

最优化与控制 · 数学 2017-04-12 Mathias Hudoba de Badyn , Mehran Mesbahi

Many problems of low-level computer vision and image processing, such as denoising, deconvolution, tomographic reconstruction or super-resolution, can be addressed by maximizing the posterior distribution of a sparse linear model (SLM). We…

机器学习 · 统计学 2010-08-16 Matthias W. Seeger , Hannes Nickisch

A Bayesian approach is used to estimate the covariance matrix of Gaussian data. Ideas from Gaussian graphical models and model selection are used to construct a prior for the covariance matrix that is a mixture over all decomposable graphs.…

统计方法学 · 统计学 2007-06-12 Helen Armstrong , Christopher K. Carter , Kevin F. Wong , Robert Kohn

Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly…

机器学习 · 计算机科学 2025-03-13 Marvin Pförtner , Jonathan Wenger , Jon Cockayne , Philipp Hennig

A method for correcting smearing effects using machine learning technique is presented. Compared to the standard deconvolution approaches in high energy particle physics, the method can use more than one reconstructed variable to predict…

数据分析、统计与概率 · 物理学 2020-01-30 Bora Işıldak , Alper Hayreter , Aidan R. Wiederhold

We study the problem of distribution to real-value regression, where one aims to regress a mapping $f$ that takes in a distribution input covariate $P\in \mathcal{I}$ (for a non-parametric family of distributions $\mathcal{I}$) and outputs…

机器学习 · 统计学 2014-03-11 Junier B. Oliva , Willie Neiswanger , Barnabas Poczos , Jeff Schneider , Eric Xing

High dimensional data analysis is known to be as a challenging problem. In this article, we give a theoretical analysis of high dimensional classification of Gaussian data which relies on a geometrical analysis of the error measure. It…

统计理论 · 数学 2008-07-10 Robin Girard

The aim of this paper is to show how free probability theory sheds light on spectral properties of deformed matricial models and provides a unified understanding of various asymptotic phenomena such as spectral measure description,…

概率论 · 数学 2016-07-20 M Capitaine , C Donati-Martin

Statistical models that possess symmetry arise in diverse settings such as random fields associated to geophysical phenomena, exchangeable processes in Bayesian statistics, and cyclostationary processes in engineering. We formalize the…

统计理论 · 数学 2011-12-01 Parikshit Shah , Venkat Chandrasekaran

We consider jointly estimating the coefficient matrix and the error precision matrix in high-dimensional multivariate linear regression models. Bayesian methods in this context often face computational challenges, leading to previous…

统计方法学 · 统计学 2025-08-25 Xuan Cao , Kyoungjae Lee

We introduce the concept of matrix liberation process, a random matrix counterpart of the liberation process in free probability, and prove a large deviation upper bound for its empirical distribution with several properties on its rate…

概率论 · 数学 2019-05-21 Yoshimichi Ueda

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

统计理论 · 数学 2024-05-09 Piotr Zwiernik

This paper studies methods for testing and estimating change-points in the covariance structure of a high-dimensional linear time series. The assumed framework allows for a large class of multivariate linear processes (including vector…

统计理论 · 数学 2020-01-14 Ansgar Steland