English
Related papers

Related papers: L-Divergence Consistency for a Discrete Prior

200 papers

This article describes a method for using optimization to derive efficient independent transition functions for Markov chain Monte Carlo simulations. Our interest is in sampling from a posterior density $\pi(x)$ for problems in which the…

Computation · Statistics 2022-06-03 Dean S. Oliver

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

We introduce a general model for the local obfuscation of probability distributions by probabilistic perturbation, e.g., by adding differentially private noise, and investigate its theoretical properties. Specifically, we relax a notion of…

Cryptography and Security · Computer Science 2023-07-19 Yusuke Kawamoto , Takao Murakami

Mutually uncorrelated random discrete events, manifesting a common basic process, are examined often in terms of their occurrence rate as a function of one or more of their distinguishing attributes, such as measurements of photon spectrum…

Instrumentation and Methods for Astrophysics · Physics 2012-07-26 Avinash A. Deshpande , Harsha Raichur

Bayesian model comparison is often based on the posterior distribution over the set of compared models. This distribution is often observed to concentrate on a single model even when other measures of model fit or forecasting ability…

Statistics Theory · Mathematics 2020-03-10 Oscar Oelrich , Shutong Ding , Måns Magnusson , Aki Vehtari , Mattias Villani

Consider a set of order statistics that arise from sorting samples from two different populations, each with their own, possibly different distribution function. The probability that these order statistics fall in disjoint, ordered…

Computation · Statistics 2007-06-26 Deborah H. Glueck , Anis Karimpour-Fard , Jan Mandel , Keith E. Muller

This paper provides closed-form expansions for the log-likelihood function of multivariate diffusions sampled at discrete time intervals. The coefficients of the expansion are calculated explicitly by exploiting the special structure…

Statistics Theory · Mathematics 2008-12-18 Yacine Aït-Sahalia

Given a domain G, a reflection vector field d(.) on the boundary of G, and drift and dispersion coefficients b(.) and \sigma(.), let L be the usual second-order elliptic operator associated with b(.) and \sigma(.). Under suitable…

Probability · Mathematics 2012-04-24 Weining Kang , Kavita Ramanan

We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected Stochastic Gradient Descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a…

Probability · Mathematics 2016-08-08 Sébastien Bubeck , Ronen Eldan , Joseph Lehec

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

We compute the uniform probability that finitely many polynomials over a finite field are pairwise coprime and compare the result with the formula one gets using the natural density as probability measure. It will turn out that the formulas…

Dynamical Systems · Mathematics 2017-11-09 Julia Lieb

A refinement of the multinomial distribution is presented where the number of inversions in the sequence of outcomes is tallied. This refinement of the multinomial distribution is its joint distribution with the number of inversions in the…

Probability · Mathematics 2025-08-19 Andrew V. Sills

Sampling algorithms play an important role in controlling the quality and runtime of diffusion model inference. In recent years, a number of works~\cite{chen2023sampling,chen2023ode,benton2023error,lee2022convergence} have proposed schemes…

Machine Learning · Computer Science 2024-10-18 Shivam Gupta , Linda Cai , Sitan Chen

We study a version of compact directed percolation (CDP) in one dimension in which occupation of a site for the first time requires that a "mine" or antiparticle be eliminated. This process is analogous to the variant of directed…

Statistical Mechanics · Physics 2009-11-07 Ronald Dickman , Daniel ben-Avraham

Considerable literature has been devoted to developing statistical inferential results for risk measures, especially for those that are of the form of L-functionals. However, practical and theoretical considerations have highlighted quite a…

Statistics Theory · Mathematics 2011-05-31 Abdelhakim Necir , Ričardas Zitikis

A random variable X is strictly stable if a sum of independent copies of X has the same distribution as X up to scaling, and is stable (in the broad sense) if the sum has the same distribution as X up to both scaling and shifting. Steutel…

Probability · Mathematics 2025-09-25 Matthew Aldridge

The posterior distribution of the number of components k in a finite mixture satisfies a set of inequality constraints. The result holds irrespective of the parametric form of the mixture components and under assumptions on the prior…

Statistics Theory · Mathematics 2007-06-13 Agostino Nobile

Although models for count data with over-dispersion have been widely considered in the literature, models for under-dispersion -- the opposite phenomenon -- have received less attention as it is only relatively common in particular research…

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb

On the plane, every random compact set with almost surely uncountable first projection intersects with a high probability the graph of some continuous function. Implication: every black noise over the plane fails to factorize when the plane…

Probability · Mathematics 2013-08-26 Boris Tsirelson