English
Related papers

Related papers: Riemannian Proximal Sampler for High-accuracy Samp…

200 papers

We address the estimation problem for general finite mixture models, with a particular focus on the elliptical mixture models (EMMs). Compared to the widely adopted Kullback-Leibler divergence, we show that the Wasserstein distance provides…

Machine Learning · Computer Science 2020-10-09 Shengxi Li , Zeyang Yu , Min Xiang , Danilo Mandic

We introduce the manifold density function, which is an intrinsic method to validate manifold learning techniques. Our approach adapts and extends Ripley's $K$-function, and categorizes in an unsupervised setting the extent to which an…

Machine Learning · Computer Science 2024-02-16 Benjamin Holmgren , Eli Quist , Jordan Schupbach , Brittany Terese Fasy , Bastian Rieck

This paper proposes a general framework of Riemannian adaptive optimization methods. The framework encapsulates several stochastic optimization algorithms on Riemannian manifolds and incorporates the mini-batch strategy that is often used…

Optimization and Control · Mathematics 2025-02-14 Hiroyuki Sakai , Hideaki Iiduka

A covariant energy density functional is calibrated using a principled Bayesian statistical framework informed by experimental binding energies and charge radii of several magic and semi-magic nuclei. The Bayesian sampling required for the…

Nuclear Theory · Physics 2022-09-28 Pablo Giuliani , Kyle Godbey , Edgard Bonilla , Frederi Viens , Jorge Piekarewicz

Two recent landmark experiments have performed Gaussian boson sampling (GBS) with a non-programmable linear interferometer and threshold detectors on up to 144 output modes (see Refs.~\onlinecite{zhong_quantum_2020,zhong2021phase}). Here we…

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

This article introduces Huber means on Riemannian manifolds, providing a robust alternative to the Frechet mean by integrating elements of both square and absolute loss functions. The Huber means are designed to be highly resistant to…

Statistics Theory · Mathematics 2025-08-20 Jongmin Lee , Sungkyu Jung

Gradient descent methods are fundamental first-order optimization algorithms in both Euclidean spaces and Riemannian manifolds. However, the exact gradient is not readily available in many scenarios. This paper proposes a novel inexact…

Optimization and Control · Mathematics 2024-09-18 Juan Zhou , Kangkang Deng , Hongxia Wang , Zheng Peng

In this paper we prove large and moderate deviations principles for the recursive kernel estimators of a probability density function defined by the stochastic approximation algorithm introduced by Mokkadem et al. [2009. The stochastic…

Statistics Theory · Mathematics 2013-01-29 Yousri Slaoui

Effective uncertainty quantification is important for training modern predictive models with limited data, enhancing both accuracy and robustness. While Bayesian methods are effective for this purpose, they can be challenging to scale. When…

Machine Learning · Computer Science 2025-05-30 Jasmeet Kaur

We establish sharp upper and lower bounds of Gaussian type for the heat kernel in the metric measure space satisfying $\RCD(0,N)$ ( equivalently, $\RCD^\ast(0,N)$) condition with $N\in \mathbb{N}\setminus\{1\}$ and having maximum volume…

Probability · Mathematics 2017-08-02 Huaiqian Li

We study empirical Bayes estimation in high-dimensional linear regression. To facilitate computationally efficient estimation of the underlying prior, we adopt a variational empirical Bayes approach, introduced originally in Carbonetto and…

Statistics Theory · Mathematics 2023-10-27 Sumit Mukherjee , Bodhisattva Sen , Subhabrata Sen

Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the…

Machine Learning · Statistics 2021-07-01 Ghassen Jerfel , Serena Wang , Clara Fannjiang , Katherine A. Heller , Yian Ma , Michael I. Jordan

Bilevel optimization has gained prominence in various applications. In this study, we introduce a framework for solving bilevel optimization problems, where the variables in both the lower and upper levels are constrained on Riemannian…

Optimization and Control · Mathematics 2024-11-05 Andi Han , Bamdev Mishra , Pratik Jawanpuria , Akiko Takeda

We analyze inexact Riemannian gradient descent (RGD) where Riemannian gradients and retractions are inexactly (and cheaply) computed. Our focus is on understanding when inexact RGD converges and what is the complexity in the general…

Optimization and Control · Mathematics 2024-05-10 Yuchen Li , Laura Balzano , Deanna Needell , Hanbaek Lyu

It is proven that encoding images and videos through Symmetric Positive Definite (SPD) matrices, and considering the Riemannian geometry of the resulting space, can lead to increased classification performance. Taking into account manifold…

Computer Vision and Pattern Recognition · Computer Science 2016-03-16 Azadeh Alavi , Vishal M Patel , Rama Chellappa

We present a randomized maximum a posteriori (rMAP) method for generating approximate samples of posteriors in high dimensional Bayesian inverse problems governed by large-scale forward problems. We derive the rMAP approach by: 1) casting…

Computation · Statistics 2016-02-12 Kainan Wang , Tan Bui-Thanh , Omar Ghattas

Spectral compressed sensing involves reconstructing a spectral-sparse signal from a subset of uniformly spaced samples, with applications in radar imaging and wireless channel estimation. By fully exploiting the signal structures, this…

Optimization and Control · Mathematics 2025-11-25 Wenlong Wang , Wen Huang , Zai Yang

This paper addresses the problem of detecting boundary points and estimating the sampling density of a dataset derived from a compact manifold with boundary, potentially in the presence of noise. We extend recent advances in doubly…

Statistics Theory · Mathematics 2026-04-03 Dhruv Kohli , Jesse He , Chester Holtz , Alexander Cloninger , Gal Mishne

The Riemannian metric on the manifold of positive definite matrices is defined by a kernel function $\phi$ in the form $K_D^\phi(H,K)=\sum_{i,j}\phi(\lambda_i,\lambda_j)^{-1} Tr P_iHP_jK$ when $\sum_i\lambda_iP_i$ is the spectral…

Mathematical Physics · Physics 2008-11-08 F. Hiai , D. Petz