English
Related papers

Related papers: Geometry-Aware Langevin Sampling for Matrix-Valued…

200 papers

Symmetric Positive Definite (SPD) matrices have received wide attention in machine learning due to their intrinsic capacity to encode underlying structural correlation in data. Many successful Riemannian metrics have been proposed to…

Machine Learning · Computer Science 2024-08-30 Ziheng Chen , Yue Song , Tianyang Xu , Zhiwu Huang , Xiao-Jun Wu , Nicu Sebe

When performing Bayesian inference using Sequential Monte Carlo (SMC) methods, two considerations arise: the accuracy of the posterior approximation and computational efficiency. To address computational demands, Sequential Monte Carlo…

Machine Learning · Statistics 2025-07-11 Joshua Murphy , Conor Rosato , Andrew Millard , Lee Devlin , Paul Horridge , Simon Maskell

Symmetric positive definite (SPD) matrix has been demonstrated to be an effective feature descriptor in many scientific areas, as it can encode spatiotemporal statistics of the data adequately on a curved Riemannian manifold, i.e., SPD…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Rui Wang , Xiao-Jun Wu , Hui Li , Josef Kittler

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

We establish sample complexity guarantees for estimating the covariance matrix of a strongly log-concave smooth distribution using the unadjusted Langevin algorithm (ULA). We quantitatively compare our complexity estimates on single-chain…

Probability · Mathematics 2026-02-16 Shogo Nakakita

Recent research has shown that alignment between the structure of graph data and the geometry of an embedding space is crucial for learning high-quality representations of the data. The uniform geometry of Euclidean and hyperbolic spaces…

Machine Learning · Computer Science 2023-06-27 Wei Zhao , Federico Lopez , J. Maxwell Riestenberg , Michael Strube , Diaaeldin Taha , Steve Trettel

Symmetric Positive Definite (SPD) matrices have been widely used for data representation in many visual recognition tasks. The success mainly attributes to learning discriminative SPD matrices with encoding the Riemannian geometry of the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-18 Zhiwu Huang , Ruiping Wang , Xianqiu Li , Wenxian Liu , Shiguang Shan , Luc Van Gool , Xilin Chen

Learning a suitable graph is an important precursor to many graph signal processing (GSP) pipelines, such as graph spectral signal compression and denoising. Previous graph learning algorithms either i) make some assumptions on connectivity…

Signal Processing · Electrical Eng. & Systems 2021-02-19 Saghar Bagheri , Gene Cheung , Antonio Ortega , Fen Wang

The integration of Symmetric Positive Definite (SPD) matrices into deep learning has historically relied on fixed algebraic Riemannian metrics. Analogous to hand-crafted features in classical machine learning, these static formulations…

Machine Learning · Computer Science 2026-05-07 Tushar Das , Subrata Dutta , Sarmistha Neogy , Koushlendra Kumar Singh

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove a non-asymptotic upper bound on the mixing time of the Metropolis-adjusted Langevin algorithm (MALA). The method draws samples by…

Machine Learning · Statistics 2019-12-12 Raaz Dwivedi , Yuansi Chen , Martin J. Wainwright , Bin Yu

We develop sampling methods, which consist of Gaussian invariant versions of random walk Metropolis (RWM), Metropolis adjusted Langevin algorithm (MALA) and second order Hessian or Manifold MALA. Unlike standard RWM and MALA we show that…

Machine Learning · Statistics 2025-06-27 Michalis K. Titsias , Angelos Alexopoulos , Siran Liu , Petros Dellaportas

Given a convex and differentiable objective $Q(\M)$ for a real symmetric matrix $\M$ in the positive definite (PD) cone -- used to compute Mahalanobis distances -- we propose a fast general metric learning framework that is entirely…

Machine Learning · Computer Science 2021-06-14 Cheng Yang , Gene Cheung , Wei Hu

The pseudo-inverse of a graph Laplacian matrix, denoted as $L^\dagger$, finds extensive application in various graph analysis tasks. Notable examples include the calculation of electrical closeness centrality, determination of Kemeny's…

Data Structures and Algorithms · Computer Science 2023-11-20 Meihao Liao , Rong-Hua Li , Qiangqiang Dai , Hongyang Chen , Guoren Wang

The graphical lasso \citep{FHT2007a} is an algorithm for learning the structure in an undirected Gaussian graphical model, using $\ell_1$ regularization to control the number of zeros in the precision matrix ${\B\Theta}={\B\Sigma}^{-1}$…

Machine Learning · Statistics 2012-08-09 Rahul Mazumder , Trevor Hastie

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

It is well known in many settings that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding irreversible perturbations to the drift of a Langevin diffusion that maintain the same…

Methodology · Statistics 2019-07-02 Michela Ottobre , Natesh S. Pillai , Konstantinos Spiliopoulos

Selecting informative nodes over large-scale networks becomes increasingly important in many research areas. Most existing methods focus on the local network structure and incur heavy computational costs for the large-scale problem. In this…

Methodology · Statistics 2018-10-02 Qingpo Cai , Jian Kang , Tianwei Yu

We introduce a new family of MCMC samplers that combine auxiliary variables, Gibbs sampling and Taylor expansions of the target density. Our approach permits the marginalisation over the auxiliary variables yielding marginal samplers, or…

Machine Learning · Statistics 2018-01-26 Michalis K. Titsias , Omiros Papaspiliopoulos

Computed tomography (CT) metal artifact reduction (MAR) aims to reduce the severe streaking artifacts induced by metallic implants and other high-density objects. Effective MAR generally requires both accurate artifact localization and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zilong Li , Chenglong Ma , Yiming Lei , Yuanlin Li , Jing Han , Jiannan Liu , Huidong Xie , Junping Zhang , Yi Zhang , Hongming Shan

A signed directed graph is a graph with sign and direction information on the edges. Even though signed directed graphs are more informative than unsigned or undirected graphs, they are more complicated to analyze and have received less…

Machine Learning · Computer Science 2023-02-17 Taewook Ko , Chong-Kwon Kim