English
Related papers

Related papers: Kullback Leibler property of kernel mixture priors…

200 papers

Motivated by applications to the study of stochastic processes, we introduce a new analysis of positive definite kernels $K$, their reproducing kernel Hilbert spaces (RKHS), and an associated family of feature spaces that may be chosen in…

Functional Analysis · Mathematics 2017-07-27 Palle Jorgensen , Feng Tian

Nonparametric density estimation for compositional data supported on the simplex is examined under a missing at random mechanism. Rather than imputing missing values and estimating the density from a completed data set, we adopt a strategy…

Methodology · Statistics 2026-03-10 Hanen Daayeb , Wissem Jedidi , Salah Khardani , Guanjie Lyu , Frédéric Ouimet

To improve the predictability of complex computational models in the experimentally-unknown domains, we propose a Bayesian statistical machine learning framework utilizing the Dirichlet distribution that combines results of several…

Methodology · Statistics 2023-11-06 Vojtech Kejzlar , Léo Neufcourt , Witold Nazarewicz

The power prior is a class of informative priors designed to incorporate historical data alongside current data in a Bayesian framework. It includes a power parameter that controls the influence of historical data, providing flexibility and…

Machine Learning · Statistics 2025-05-23 Masanari Kimura , Howard Bondell

In this paper we introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence based (DB) priors. DB priors have simple forms…

Methodology · Statistics 2009-02-27 M. J. Bayarri , G. García-Donato

Kernel density estimation is a widely used nonparametric approach to estimate an unknown distribution. Recent work in Bayesian predictive inference has considered stochastic processes formed by specifying the predictive distribution for the…

Methodology · Statistics 2026-05-15 Torey Hilbert

A new canonical divergence is put forward for generalizing an information-geometric measure of complexity for both, classical and quantum systems. On the simplex of probability measures it is proved that the new divergence coincides with…

Mathematical Physics · Physics 2019-06-11 Domenico Felice , Stefano Mancini , Nihat Ay

Discrete normal distributions are defined as the distributions with prescribed means and covariance matrices which maximize entropy on the integer lattice support. The set of discrete normal distributions form an exponential family with…

Information Theory · Computer Science 2022-01-25 Frank Nielsen

The method of Bayesian variable selection via penalized credible regions separates model fitting and variable selection. The idea is to search for the sparsest solution within the joint posterior credible regions. Although the approach was…

Methodology · Statistics 2016-09-02 Yan Zhang , Howard D. Bondell

Dirichlet process mixtures are particularly sensitive to the value of the precision parameter controlling the behavior of the latent partition. Randomization of the precision through a prior distribution is a common solution, which leads to…

Methodology · Statistics 2024-09-04 Alessandro Zito , Tommaso Rigon , David B. Dunson

Prior sensitivity analysis is a fundamental method to check the effects of prior distributions on the posterior distribution in Bayesian inference. Exploring the posteriors under several alternative priors can be computationally intensive,…

Methodology · Statistics 2025-04-25 Shonosuke Sugasawa

In $\mathbb R^d$, it is well-known that cumulants provide an alternative to moments that can achieve the same goals with numerous benefits such as lower variance estimators. In this paper we extend cumulants to reproducing kernel Hilbert…

Machine Learning · Statistics 2023-10-31 Patric Bonnier , Harald Oberhauser , Zoltán Szabó

This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution $U$ which maximizes the KL…

Machine Learning · Computer Science 2020-12-11 Vincenzo Bonnici

We study the mixtures of factorizing probability distributions represented as visible marginal distributions in stochastic layered networks. We take the perspective of kernel transitions of distributions, which gives a unified picture of…

Machine Learning · Statistics 2012-11-06 Guido F. Montufar , Jason Morton

Approximate Bayesian Computation (ABC) enables statistical inference in simulator-based models whose likelihoods are difficult to calculate but easy to simulate from. ABC constructs a kernel-type approximation to the posterior distribution…

Methodology · Statistics 2022-12-02 Yuexi Wang , Tetsuya Kaji , Veronika Ročková

Let $X,U,Y$ be spherically symmetric distributed having density $$\eta^{d +k/2} \, f\left(\eta(\|x-\theta|^2+ \|u\|^2 + \|y-c\theta\|^2 ) \right)\,,$$ with unknown parameters $\theta \in \mathbb{R}^d$ and $\eta>0$, and with known density…

Statistics Theory · Mathematics 2018-07-13 Dominique Fourdrinier , Éric Marchand , William E. Strawderman

In this note we consider the stability of posterior measures occuring in Bayesian inference w.r.t. perturbations of the prior measure and the log-likelihood function. This extends the well-posedness analysis of Bayesian inverse problems. In…

Statistics Theory · Mathematics 2020-06-24 Björn Sprungk

The problem is sequence prediction in the following setting. A sequence $x_1,...,x_n,...$ of discrete-valued observations is generated according to some unknown probabilistic law (measure) $\mu$. After observing each outcome, it is required…

Artificial Intelligence · Computer Science 2012-03-20 Daniil Ryabko

We propose a method for estimating the posterior distribution of a standard geostatistical model. After choosing the model formulation and specifying a prior, we use normal mixture densities to approximate the posterior distribution. The…

Methodology · Statistics 2014-09-10 Zepu Zhang

We propose a closed-form spectral framework for relative log-density estimation in linearly parameterized probabilistic models, including unnormalized and conditional models. This is achieved by representing the Kullback-Leibler (KL)…

Machine Learning · Computer Science 2026-05-12 Francis Bach