English
Related papers

Related papers: An Information-Theoretic View of Stochastic Locali…

200 papers

Estimating probabilistic deformable template models is a new approach in the fields of computer vision and probabilistic atlases in computational anatomy. A first coherent statistical framework modelling the variability as a hidden random…

Computation · Statistics 2009-01-16 Stéphanie Allassonnière , Estelle Kuhn

In information theory, one major goal is to find useful functions that summarize the amount of information contained in the interaction of several random variables. Specifically, one can ask how the classical Shannon entropy, mutual…

Information Theory · Computer Science 2025-02-14 Leon Lang , Pierre Baudot , Rick Quax , Patrick Forré

Given a sequence of random variables $X^n=X_1,\ldots, X_n$, discriminating between two hypotheses on the underlying probability distribution is a key task in statistics and information theory. Of interest here is the Stein exponent, i.e.…

Information Theory · Computer Science 2025-10-09 Ludovico Lami

Data coding as a building block of several image processing algorithms has been received great attention recently. Indeed, the importance of the locality assumption in coding approaches is studied in numerous works and several methods are…

Computer Vision and Pattern Recognition · Computer Science 2014-03-06 Amirreza Shaban , Hamid R. Rabiee , Mahyar Najibi

The singular value decomposition is widely used to approximate data matrices with lower rank matrices. Feng and He [Ann. Appl. Stat. 3 (2009) 1634-1654] developed tests on dimensionality of the mean structure of a data matrix based on the…

Statistics Theory · Mathematics 2014-02-28 Xingdong Feng , Xuming He

Consider a probability measure supported by a regular geodesic ball in a manifold. For any p larger than or equal to 1 we define a stochastic algorithm which converges almost surely to the p-mean of the measure. Assuming furthermore that…

Probability · Mathematics 2011-06-28 Marc Arnaudon , Clément Dombry , Anthony Phan , Le Yang

This paper presents a novel multi-scale method for elliptic partial differential equations with arbitrarily rough coefficients. In the spirit of numerical homogenization, the method constructs problem-adapted ansatz spaces with uniform…

Numerical Analysis · Mathematics 2024-08-05 Philip Freese , Moritz Hauck , Tim Keil , Daniel Peterseim

We deal with the random combinatorial structures called assemblies. By weakening the logarithmic condition which assures regularity of the number of components of a given order, we extend the notion of logarithmic assemblies. Using the…

Probability · Mathematics 2009-03-06 Eugenijus Manstavičius

In this work we show that, using the eigen-decomposition of the adjacency matrix, we can consistently estimate latent positions for random dot product graphs provided the latent positions are i.i.d. from some distribution. If class labels…

Machine Learning · Statistics 2012-07-31 Daniel L. Sussman , Minh Tang , Carey E. Priebe

Information entropy is applied to the state of knowledge of reaction amplitudes in pseudoscalar meson photoproduction, and a scheme is developed that quantifies the information content of a measured set of polarization observables. It is…

High Energy Physics - Phenomenology · Physics 2010-09-02 D. G. Ireland

In this manuscript, we consider a finite multivariate nonparametric mixture model where the dependence between the marginal densities is modeled using the copula device. Pseudo EM stochastic algorithms were recently proposed to estimate all…

Computation · Statistics 2022-12-14 Michael Levine , Gildas Mazo

Embeddings are a basic initial feature extraction step in many machine learning models, particularly in natural language processing. An embedding attempts to map data tokens to a low-dimensional space where similar tokens are mapped to…

Machine Learning · Computer Science 2025-04-10 Golara Ahmadi Azar , Melika Emami , Alyson Fletcher , Sundeep Rangan

An often-cited fact regarding mixing or mixture distributions is that their density functions are able to approximate the density function of any unknown distribution to arbitrary degrees of accuracy, provided that the mixing or mixture…

Other Statistics · Statistics 2018-03-05 Hien D. Nguyen , Geoffrey J. McLachlan

We give a decomposition of the posterior predictive variance using the law of total variance and conditioning on a finite dimensional discrete random variable. This random variable summarizes various features of modeling that are used to…

Methodology · Statistics 2022-09-02 Dean Dustin , Bertrand Clarke

We introduce a sequence of numerical tests that can determine the entanglement or separability of a state even when there is not enough information to completely determine its density matrix. Given partial information about the state in the…

Quantum Physics · Physics 2012-12-14 Federico M. Spedalieri

We construct a deterministic, Lagrangian many-particle approximation to a class of nonlocal transport PDEs with nonlinear mobility arising in many contexts in biology and social sciences. The approximating particle system is a nonlocal…

Analysis of PDEs · Mathematics 2018-01-29 M. Di Francesco , S. Fagioli , E. Radici

We review recent works that relate entanglement of random vectors to their localization properties. In particular, the linear entropy is related by a simple expression to the inverse participation ratio, while next orders of the entropy of…

Quantum Physics · Physics 2015-05-13 O. Giraud , J. Martin , B. Georgeot

Estimates of the approximate factor model are increasingly used in empirical work. Their theoretical properties, studied some twenty years ago, also laid the ground work for analysis on large dimensional panel data models with cross-section…

Econometrics · Economics 2020-08-04 Jushan Bai , Serena Ng

A critical reconsideration of the EPR (Einstein-Podolsky-Rosen) paper shows that the EPR argument can be developed without using the concept of `element of physical reality', thus eliminating any philosophical element in the logical chains…

Quantum Physics · Physics 2020-01-03 Giuseppe Giuliani

We apply two variations of the principle of Minimum Cross Entropy (the Kullback information measure) to fit parameterized probability density models to observed data densities. For an array beamforming problem with P incident narrowband…

Information Theory · Computer Science 2008-06-24 Cheng-Yuan Liou , Bruce R. Musicus