English
Related papers

Related papers: Geometric methods for estimation of structured cov…

200 papers

In this work we test Wasserstein distance in conjunction with persistent homology, as a tool for discriminating large scale structures of simulated universes with different values of $\sigma_8$ cosmological parameter (present…

Cosmology and Nongalactic Astrophysics · Physics 2023-05-11 Maksym Tsizh , Vitalii Tymchyshyn , Franco Vazza

A new nonparametric estimator for Toeplitz covariance matrices is proposed. This estimator is based on a data transformation that translates the problem of Toeplitz covariance matrix estimation to the problem of mean estimation in an…

Statistics Theory · Mathematics 2024-01-08 Karolina Klockmann , Tatyana Krivobokova

Covariance matrices have proven highly effective across many scientific fields. Since these matrices lie within the Symmetric Positive Definite (SPD) manifold - a Riemannian space with intrinsic non-Euclidean geometry, the primary challenge…

Machine Learning · Computer Science 2025-04-02 Rui Wang , Shaocheng Jin , Ziheng Chen , Xiaoqing Luo , Xiao-Jun Wu

We show that the Kullback-Leibler distance is a good measure of the statistical uncertainty of correlation matrices estimated by using a finite set of data. For correlation matrices of multivariate Gaussian variables we analytically…

Data Analysis, Statistics and Probability · Physics 2008-12-02 Michele Tumminello , Fabrizio Lillo , Rosario Nunzio Mantegna

Since the introduction of the Sliced Wasserstein distance in the literature, its simplicity and efficiency have made it one of the most interesting surrogate for the Wasserstein distance in image processing and machine learning. However,…

Optimization and Control · Mathematics 2025-08-05 Eloi Tanguy , Laetitia Chapel , Julie Delon

We provide an implementation to compute the flat metric in any dimension. The flat metric, also called dual bounded Lipschitz distance, generalizes the well-known Wasserstein distance $W_1$ to the case that the distributions are of unequal…

Machine Learning · Computer Science 2025-06-17 Henri Schmidt , Christian Düll

The challenge of describing model drift is an open question in unsupervised learning. It can be difficult to evaluate at what point an unsupervised model has deviated beyond what would be expected from a different sample from the same…

Computational Geometry · Computer Science 2018-12-18 Michael McCabe

We develop the theory of a metric, which we call the $\nu$-based Wasserstein metric and denote by $W_\nu$, on the set of probability measures $\mathcal P(X)$ on a domain $X \subseteq \mathbb{R}^m$. This metric is based on a slight…

Optimization and Control · Mathematics 2022-09-16 Luca Nenna , Brendan Pass

The problems of uniform linear array (with uniform mutual coupling) calibration and Toeplitz covariance matrix estimation are re-examined for application in the receive arrays of modern High Frequency Over-the-Horizon Radars (HF OTHR).…

Signal Processing · Electrical Eng. & Systems 2024-09-20 Yuri Abramovich , Tanit Pongsiri

We investigate the geometrical structure of probabilistic generative dimensionality reduction models using the tools of Riemannian geometry. We explicitly define a distribution over the natural metric given by the models. We provide the…

Machine Learning · Statistics 2014-12-01 Alessandra Tosi , Søren Hauberg , Alfredo Vellido , Neil D. Lawrence

In this work, we investigate Gaussian Processes indexed by multidimensional distributions. While directly constructing radial positive definite kernels based on the Wasserstein distance has been proven to be possible in the unidimensional…

Gaussian graphical models are used for determining conditional relationships between variables. This is accomplished by identifying off-diagonal elements in the inverse-covariance matrix that are non-zero. When the ratio of variables (p) to…

Applications · Statistics 2018-08-07 Donald R. Williams , Juho Piironen , Aki Vehtari , Philippe Rast

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

We introduce dynamic and static formulations that formally extend unbalanced optimal transport from the space of positive densities to the space of Riemannian metrics. The first construction is based on a dynamic variational formulation in…

Differential Geometry · Mathematics 2026-05-27 Martin Bauer , Peter W. Michor , François-Xavier Vialard

In this self-contained chapter, we revisit a fundamental problem of multivariate statistics: estimating covariance matrices from finitely many independent samples. Based on massive Multiple-Input Multiple-Output (MIMO) systems we illustrate…

Statistics Theory · Mathematics 2021-06-14 Johannes Maly , Tianyu Yang , Sjoerd Dirksen , Holger Rauhut , Giuseppe Caire

The space of probability densities is an infinite-dimensional Riemannian manifold, with Riemannian metrics in two flavors: Wasserstein and Fisher--Rao. The former is pivotal in optimal mass transport (OMT), whereas the latter occurs in…

Differential Geometry · Mathematics 2017-11-21 Klas Modin

A novel neural architecture was recently developed that enforces an exact upper bound on the Lipschitz constant of the model by constraining the norm of its weights in a minimal way, resulting in higher expressiveness compared to other…

Machine Learning · Statistics 2022-10-03 Ouail Kitouni , Niklas Nolte , Mike Williams

Variational Inference approximates an unnormalized distribution via the minimization of Kullback-Leibler (KL) divergence. Although this divergence is efficient for computation and has been widely used in applications, it suffers from some…

Machine Learning · Statistics 2022-07-28 Mingxuan Yi , Song Liu

We consider robust covariance estimation with group symmetry constraints. Non-Gaussian covariance estimation, e.g., Tyler scatter estimator and Multivariate Generalized Gaussian distribution methods, usually involve non-convex minimization…

Machine Learning · Statistics 2013-06-19 Ilya Soloveychik , Ami Wiesel

This paper focuses on a similarity measure, known as the Wasserstein distance, with which to compare images. The Wasserstein distance results from a partial differential equation (PDE) formulation of Monge's optimal transport problem. We…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Michael Snow , Jan Van lent