English
Related papers

Related papers: Universal Approximation on the Hypersphere

200 papers

The Fisher-Bingham distribution ($\mathrm{FB}_8$) is an eight-parameter family of probability density functions (PDF) on $S^2$ that, under certain conditions, reduce to spherical analogues of bivariate normal PDFs. Due to difficulties in…

Data Analysis, Statistics and Probability · Physics 2021-04-06 Tianlu Yuan

For a separable finite diffuse measure space $\mathcal{M}$ and an orthonormal basis $\{\varphi_n\}$ of $L^2(\mathcal{M})$ consisting of bounded functions $\varphi_n\in L^\infty(\mathcal{M})$, we find a measurable subset…

Functional Analysis · Mathematics 2018-10-16 Zhirayr Avetisyan , Martin Grigoryan , Michael Ruzhansky

When observations are truncated, we are limited to an incomplete picture of our dataset. Recent methods propose to use score matching for truncated density estimation, where the access to the intractable normalising constant is not…

Methodology · Statistics 2024-04-15 Daniel J. Williams , Song Liu

We show a general relation between the spatially disjoint product of probability density functions and the sum of their Fisher information metric tensors. We then utilise this result to give a method for constructing the probability density…

Information Theory · Computer Science 2015-04-14 T. Clingman , Jeff Murugan , Jonathan P. Shock

By a mixture density is meant a density of the form $\pi_{\mu}(\cdot)=\int\pi_{\theta}(\cdot)\times\mu(d\theta)$, where $(\pi_{\theta})_{\theta\in\Theta}$ is a family of probability densities and $\mu$ is a probability measure on $\Theta$.…

Statistics Theory · Mathematics 2016-08-16 François Roueff , Tobias Rydén

We introduce some new classes of unimodal rotational invariant directional distributions, which generalize von Mises-Fisher distribution. We propose three types of distributions, one of which represents axial data. For each new type we…

Statistics Theory · Mathematics 2020-10-22 Nikolai Leonenko , Vitalii Makogin , Mehmet Siddik Cadirci

We consider the problem of estimating the population probability distribution given a finite set of multivariate samples, using the maximum entropy approach. In strict keeping with Jaynes' original definition, our precise formulation of the…

Data Analysis, Statistics and Probability · Physics 2007-07-13 Sabbir Rahman , Mahbub Majumdar

Traditional topic models do not account for semantic regularities in language. Recent distributional representations of words exhibit semantic consistency over directional metrics such as cosine similarity. However, neither categorical nor…

Computation and Language · Computer Science 2016-04-04 Kayhan Batmanghelich , Ardavan Saeedi , Karthik Narasimhan , Sam Gershman

We replicate recent experiments attempting to demonstrate an attractive hypothesis about the use of the Fisher kernel framework and mixture models for aggregating word embeddings towards document representations and the use of these…

Computation and Language · Computer Science 2020-01-15 Luca Papariello , Alexandros Bampoulidis , Mihai Lupu

This paper investigates probability density functions (PDFs) that are continuous everywhere, nearly uniform around the mode of distribution, and adaptable to a variety of distribution shapes ranging from bell-shaped to rectangular. From the…

Machine Learning · Computer Science 2022-04-01 Osamu Fujita

Probability distributions in Stiefel manifold such as the von-Mises Fisher and Bingham distributions find diverse applications in signal processing and other applied sciences. Use of these statistical models in practice is complicated by…

Statistics Theory · Mathematics 2016-02-15 Lu Wei , Jukka Corander

Suppose A is a finite set equipped with a probability measure P and let M be a ``mass'' function on A. We give a probabilistic characterization of the most efficient way in which A^n can be almost-covered using spheres of a fixed radius. An…

Probability · Mathematics 2007-07-16 Ioannis Kontoyiannis

Laplace's method approximates a target density with a Gaussian distribution at its mode. It is computationally efficient and asymptotically exact for Bayesian inference due to the Bernstein-von Mises theorem, but for complex targets and…

Machine Learning · Computer Science 2026-03-12 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Mark Girolami , Arto Klami

Robust estimation of location and concentration parameters for the von Mises-Fisher distribution is discussed. A key reparametrisation is achieved by expressing the two parameters as one vector on the Euclidean space. With this…

Methodology · Statistics 2012-02-01 Shogo Kato , Shinto Eguchi

We propose a novel model for generating graphs similar to a given example graph. Unlike standard approaches that compute features of graphs in Euclidean space, our approach obtains features on a surface of a hypersphere. We then utilize a…

Social and Information Networks · Computer Science 2011-05-20 Dalton Lunga , Sergey Kirshner

We establish a general semiparametric Bernstein-von Mises theorem for Bayesian nonparametric priors based on continuous observations in a periodic reversible multidimensional diffusion model. We consider a wide range of functionals…

Statistics Theory · Mathematics 2025-05-23 Matteo Giordano , Kolyan Ray

The rational function approximation method, density functional theory, and NVT Monte Carlo simulation are used to obtain the density profiles of multicomponent hard-sphere mixtures near a planar hard wall. Binary mixtures with a size ratio…

Statistical Mechanics · Physics 2007-06-06 Alexandr Malijevsky , Santos B. Yuste , Andres Santos , Mariano Lopez de Haro

We study the probability distribution $F(u)$ of the maximum of smooth Gaussian fields defined on compact subsets of $\R^d$ having some geometric regularity. Our main result is a general formula for the density of $F$. Even though this is an…

Probability · Mathematics 2016-08-16 Jean-Marc Azaïs Mario Wschebor

The universal approximation theorem, in one of its most general versions, says that if we consider only continuous activation functions $\sigma$, then a standard feedforward neural network with one hidden layer is able to approximate any…

Machine Learning · Computer Science 2020-02-18 Kai Fong Ernest Chong

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and…

Statistics Theory · Mathematics 2010-10-05 Andriy Norets