English
Related papers

Related papers: Sampling From A Manifold

200 papers

Sampling from multivariate normal distributions, subjected to a variety of restrictions, is a problem that is recurrent in statistics and computing. In the present work, we demonstrate a general framework to efficiently sample a…

Suppose that there is a family of $n$ random points $X_v$ for $v \in V$, independently and uniformly distributed in the square $\left[-\sqrt{n}/2,\sqrt{n}/2\right]^2$ of area $n$. We do not see these points, but learn about them in one of…

Probability · Mathematics 2019-11-26 Josep Diaz , Colin McDiarmid , Dieter Mitsche

This paper studies the problem of estimation from relative measurements in a graph, in which a vector indexed over the nodes has to be reconstructed from pairwise measurements of differences between its components associated to nodes…

Systems and Control · Computer Science 2018-07-27 Chiara Ravazzi , Nelson P. K. Chan , Paolo Frasca

This paper proposes an original Riemmanian geometry for low-rank structured elliptical models, i.e., when samples are elliptically distributed with a covariance matrix that has a low-rank plus identity structure. The considered geometry is…

Differential Geometry · Mathematics 2020-01-07 Florent Bouchard , Arnaud Breloy , Guillaume Ginolhac , Alexandre Renaux , Frédéric Pascal

We propose a theoretically justified and practically applicable slice sampling based Markov chain Monte Carlo (MCMC) method for approximate sampling from probability measures on Riemannian manifolds. The latter naturally arise as posterior…

Computation · Statistics 2025-08-25 Alain Durmus , Samuel Gruffaz , Mareike Hasenpflug , Daniel Rudolf

This paper reviews the gradient sampling methodology for solving nonsmooth, nonconvex optimization problems. An intuitively straightforward gradient sampling algorithm is stated and its convergence properties are summarized. Throughout this…

Optimization and Control · Mathematics 2018-05-01 James V. Burke , Frank E. Curtis , Adrian S. Lewis , Michael L. Overton , Lucas E. A. Simões

Adaptive stochastic gradient algorithms in the Euclidean space have attracted much attention lately. Such explorations on Riemannian manifolds, on the other hand, are relatively new, limited, and challenging. This is because of the…

Machine Learning · Computer Science 2019-07-01 Hiroyuki Kasai , Pratik Jawanpuria , Bamdev Mishra

This paper advocates a novel framework for segmenting a dataset in a Riemannian manifold $M$ into clusters lying around low-dimensional submanifolds of $M$. Important examples of $M$, for which the proposed clustering algorithm is…

Machine Learning · Statistics 2014-10-02 Xu Wang , Konstantinos Slavakis , Gilad Lerman

Distributed systems have been widely used in practice to accomplish data analysis tasks of huge scales. In this work, we target on the estimation problem of generalized linear models on a distributed system with nonrandomly distributed…

Methodology · Statistics 2020-04-07 Feifei Wang , Danyang Huang , Yingqiu Zhu , Hansheng Wang

Manifold Learning is a class of algorithms seeking a low-dimensional non-linear representation of high-dimensional data. Thus manifold learning algorithms are, at least in theory, most applicable to high-dimensional data and sample sizes to…

Machine Learning · Computer Science 2016-03-10 James McQueen , Marina Meila , Jacob VanderPlas , Zhongyue Zhang

A central issue of the science of complex systems is the quantitative characterization of complexity. In the present work we address this issue by resorting to information geometry. Actually we propose a constructive way to associate to a -…

Mathematical Physics · Physics 2017-12-19 Roberto Franzosi , Domenico Felice , Stefano Mancini , Marco Pettini

Analyzing large volumes of high-dimensional data requires dimensionality reduction: finding meaningful low-dimensional structures hidden in their high-dimensional observations. Such practice is needed in atomistic simulations of complex…

Computational Physics · Physics 2023-10-17 Jakub Rydzewski , Ming Chen , Omar Valsson

Nested sampling has emerged as a valuable tool for Bayesian analysis, in particular for determining the Bayesian evidence. The method is based on a specific type of random sampling of the likelihood function and prior volume of the…

Instrumentation and Methods for Astrophysics · Physics 2015-05-27 Charles R. Keeton

This article presents an overview of robot learning and adaptive control applications that can benefit from a joint use of Riemannian geometry and probabilistic representations. The roles of Riemannian manifolds, geodesics and parallel…

Robotics · Computer Science 2020-03-31 Sylvain Calinon

Random orthogonal matrices play an important role in probability and statistics, arising in multivariate analysis, directional statistics, and models of physical systems, among other areas. Calculations involving random orthogonal matrices…

Statistics Theory · Mathematics 2018-10-09 Michael Jauch , Peter D. Hoff , David B. Dunson

Circular and non-flat data distributions are prevalent across diverse domains of data science, yet their specific geometric structures often remain underutilized in machine learning frameworks. A principled approach to accounting for the…

Methodology · Statistics 2025-09-25 Thibault de Surrel , Fabien Lotte , Sylvain Chevallier , Florian Yger

We consider inference from non-random samples in data-rich settings where high-dimensional auxiliary information is available both in the sample and the target population, with survey inference being a special case. We propose a regularized…

Methodology · Statistics 2021-04-13 Yutao Liu , Andrew Gelman , Qixuan Chen

Testing procedures for assessing specific parametric model forms, or for checking the plausibility of simplifying assumptions, play a central role in the mathematical treatment of the uncertain. No certain answers are obtained by testing…

Deep learning is the mainstream technique for many machine learning tasks, including image recognition, machine translation, speech recognition, and so on. It has outperformed conventional methods in various fields and achieved great…

Machine Learning · Computer Science 2018-06-01 Na Lei , Zhongxuan Luo , Shing-Tung Yau , David Xianfeng Gu

In the context of a species sampling problem we discuss a non-parametric maximum likelihood estimator for the underlying probability mass function. The estimator is known in the computer science literature as the high profile estimator. We…

Statistics Theory · Mathematics 2018-01-12 Dragi Anevski , Richard D. Gill , Stefan Zohren