English
Related papers

Related papers: Void Probabilities and Cauchy-Schwarz Divergence f…

200 papers

Many popular Bayesian nonparametric priors can be characterized in terms of exchangeable species sampling sequences. However, in some applications, exchangeability may not be appropriate. We introduce a {novel and probabilistically coherent…

Statistics Theory · Mathematics 2015-03-17 Edoardo M. Airoldi , Thiago Costa , Federico Bassetti , Fabrizio Leisen , Michele Guindani

Classification is a vital tool that is important for modelling many complex numerical models. A model or system may be such that, for certain areas of input space, the output either does not exist, or is not in a quantifiable form. Here, we…

Methodology · Statistics 2020-02-04 Louise Kimpton , Peter Challenor , Daniel Williamson

We propose Dirichlet Process mixtures of Generalized Linear Models (DP-GLM), a new method of nonparametric regression that accommodates continuous and categorical inputs, and responses that can be modeled by a generalized linear model. We…

Machine Learning · Statistics 2010-07-16 Lauren A. Hannah , David M. Blei , Warren B. Powell

We show that the log-likelihood of several probabilistic graphical models is Lipschitz continuous with respect to the lp-norm of the parameters. We discuss several implications of Lipschitz parametrization. We present an upper bound of the…

Machine Learning · Computer Science 2018-11-16 Jean Honorio

The Generalized Mallows Model (GMM) is a well known family of models for ranking data. A GMM is a distribution over $\mathbb{S}_n$, the set of permutations of n objects, characterized by a location parameter $\sigma \in \mathbb{S}_n$, known…

Statistics Theory · Mathematics 2025-03-25 Marina Meilă

Parameter estimation in HEP experiments often involves Monte-Carlo simulation to model the experimental response function. A typical application are forward-folding likelihood analyses with re-weighting, or time-consuming minimization…

Data Analysis, Statistics and Probability · Physics 2018-06-12 Thorsten Glüsenkamp

This article develops an analytical framework for studying information divergences and likelihood ratios associated with Poisson processes and point patterns on general measurable spaces. The main results include explicit analytical…

Statistics Theory · Mathematics 2024-10-07 Lasse Leskelä

This paper presents a framework for binary autoregressive time series in which each observation is a Bernoulli variable whose success probability evolves with past outcomes and probabilities, in the spirit of GARCH-type dynamics,…

Econometrics · Economics 2026-04-17 Anna Bykhovskaya , Nour Meddahi

Non-Gaussian concentration estimates are obtained for invariant probability measures of reversible Markov processes. We show that the functional inequalities approach combined with a suitable Lyapunov condition allows us to circumvent the…

Probability · Mathematics 2012-02-13 Arnaud Guillin , Aldéric Joulin

We propose a new approach for assigning weights to models using a divergence-based method ({\em D-probabilities}), relying on evaluating parametric models relative to a nonparametric Bayesian reference using Kullback-Leibler divergence.…

Methodology · Statistics 2019-04-30 Meng Li , David B. Dunson

Predictive models for binary data are fundamental in various fields, and the growing complexity of modern applications has motivated several flexible specifications for modeling the relationship between the observed predictors and the…

Computation · Statistics 2022-01-31 Jian Cao , Daniele Durante , Marc G. Genton

The Gaussian process latent variable model (GP-LVM) is a popular approach to non-linear probabilistic dimensionality reduction. One design choice for the model is the number of latent variables. We present a spike and slab prior for the…

Machine Learning · Statistics 2015-05-12 Zhenwen Dai , James Hensman , Neil Lawrence

We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures…

Applications · Statistics 2015-10-14 Jared S. Murray , Jerome P. Reiter

We pursue tractable Bayesian analysis of generalized linear models (GLMs) for categorical data. Thus far, GLMs are difficult to scale to more than a few dozen categories due to non-conjugacy or strong posterior dependencies when using…

Machine Learning · Statistics 2022-06-02 Michael T. Wojnowicz , Shuchin Aeron , Eric L. Miller , Michael C. Hughes

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covariance matrices for…

Machine Learning · Statistics 2018-05-23 Steven Atkinson , Nicholas Zabaras

Markov Chain Monte Carlo (MCMC) methods are a popular technique in Bayesian statistical modeling. They have long been used to obtain samples from posterior distributions, but recent research has focused on the scalability of these…

Methodology · Statistics 2016-02-02 Nicholas A. Johnson , Frank O. Kuehnel , Ali Nasiri Amini

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

Statistics Theory · Mathematics 2023-01-18 Martin Genzel , Christian Kipp

The mean field methods, which entail approximating intractable probability distributions variationally with distributions from a tractable family, enjoy high efficiency, guaranteed convergence, and provide lower bounds on the true…

Machine Learning · Computer Science 2012-12-12 Eric P. Xing , Michael I. Jordan , Stuart Russell

In this paper, we extend the notion of Cauchy-Schwarz divergence to point processes and establish that the Cauchy-Schwarz divergence between the probability densities of two Poisson point processes is half the squared…

Information Theory · Computer Science 2015-07-21 Hung Gia Hoang , Ba-Ngu Vo , Ba-Tuong Vo , Ronald Mahler

Latent variable models (LVMs) learn probabilistic models of data manifolds lying in an \emph{ambient} Euclidean space. In a number of applications, a priori known spatial constraints can shrink the ambient space into a considerably smaller…

Machine Learning · Statistics 2019-02-26 Anton Mallasto , Søren Hauberg , Aasa Feragen