English
Related papers

Related papers: Local mixture models of exponential families

200 papers

This paper introduces new methods based on exponential families for modeling the correlations between words in text and speech. While previous work assumed the effects of word co-occurrence statistics to be constant over a window of several…

cmp-lg · Computer Science 2008-02-03 Doug Beeferman , Adam Berger , John Lafferty

Copulas are now frequently used to construct or estimate multivariate distributions because of their ability to take into account the multivariate dependence of the different variables while separately specifying marginal distributions.…

Methodology · Statistics 2023-02-02 Mohamad A. Khaled , Robert Kohn

By linking conceptual theories with observed data, generative models can support reasoning in complex situations. They have come to play a central role both within and beyond statistics, providing the basis for power analysis in molecular…

Methodology · Statistics 2022-08-15 Kris Sankaran , Susan P. Holmes

As the application of deep neural networks proliferates in numerous areas such as medical imaging, video surveillance, and self driving cars, the need for explaining the decisions of these models has become a hot research topic, both at the…

Machine Learning · Computer Science 2021-06-01 Ronny Luss , Pin-Yu Chen , Amit Dhurandhar , Prasanna Sattigeri , Yunfeng Zhang , Karthikeyan Shanmugam , Chun-Chen Tu

Bayesian inference methods are useful in infectious diseases modeling due to their capability to propagate uncertainty, manage sparse data, incorporate latent structures, and address high-dimensional parameter spaces. However, parameter…

Methodology · Statistics 2025-04-29 Xiahui Li , Fergus Chadwick , Ben Swallow

Finite mixtures are a flexible modeling tool for irregularly shaped densities and samples from heterogeneous populations. When modeling with mixtures using an exchangeable prior on the component features, the component labels are arbitrary…

Methodology · Statistics 2020-07-10 Deborah Kunkel , Mario Peruggia

We develop a class of exponential-family point processes based on a latent social space to model the coevolution of social structure and behavior over time. Temporal dynamics are modeled as a discrete Markov process specified through…

Other Statistics · Statistics 2016-10-04 Joshua D. EmBree , Mark S. Handcock

In many applications, the curvature of the space supporting the data makes the statistical modelling challenging. In this paper we discuss the construction and use of probability distributions wrapped around manifolds using exponential…

Methodology · Statistics 2022-10-11 Emmanuel Chevallier , Didong Li , Yulong Lu , David B. Dunson

This paper describes a family of seasonal and non-seasonal time series models that can be viewed as generalisations of additive and multiplicative exponential smoothing models, to model series that grow faster than linear but slower than…

Machine Learning · Computer Science 2024-03-25 Slawek Smyl , Christoph Bergmeir , Alexander Dokumentov , Xueying Long , Erwin Wibowo , Daniel Schmidt

Pattern learning in an important problem in Natural Language Processing (NLP). Some exhaustive pattern learning (EPL) methods (Bod, 1992) were proved to be flawed (Johnson, 2002), while similar algorithms (Och and Ney, 2004) showed great…

Artificial Intelligence · Computer Science 2011-04-21 Libin Shen

Finite mixture models have been a very important tool for exploring complex data structures in many scientific areas, for example, economics, epidemiology, finance. In the past decade, semiparametric techniques have been popularly…

Methodology · Statistics 2018-11-15 Sijia Xiang , Weixin Yao , Guangren Yang

We present a general method for deriving collapsed variational inference algo- rithms for probabilistic models in the conjugate exponential family. Our method unifies many existing approaches to collapsed variational inference. Our…

Machine Learning · Computer Science 2012-12-05 James Hensman , Magnus Rattray , Neil D. Lawrence

Mixtures of experts models provide a framework in which covariates may be included in mixture models. This is achieved by modelling the parameters of the mixture model as functions of the concomitant covariates. Given their mixture model…

Methodology · Statistics 2018-06-22 Isobel Claire Gormley , Sylvia Frühwirth-Schnatter

Mixture models are often used to identify meaningful subpopulations (i.e., clusters) in observed data such that the subpopulations have a real-world interpretation (e.g., as cell types). However, when used for subpopulation discovery,…

Methodology · Statistics 2024-03-04 Jiawei Li , Jonathan H. Huggins

Targeted maximum likelihood estimation (TMLE) is a general method for estimating parameters in semiparametric and nonparametric models. Each iteration of TMLE involves fitting a parametric submodel that targets the parameter of interest. We…

Methodology · Statistics 2014-06-03 Iván Díaz , Michael Rosenblum

The link with exponential families has allowed $k$-means clustering to be generalized to a wide variety of data generating distributions in exponential families and clustering distortions among Bregman divergences. Getting the framework to…

Machine Learning · Computer Science 2022-11-08 Ehsan Amid , Richard Nock , Manfred Warmuth

This thesis explores the generation of local explanations for already deployed machine learning models, aiming to identify optimal conditions for producing meaningful explanations considering both data and user requirements. The primary…

Artificial Intelligence · Computer Science 2024-02-19 julien Delaunay

A family of parsimonious shifted asymmetric Laplace mixture models is introduced. We extend the mixture of factor analyzers model to the shifted asymmetric Laplace distribution. Imposing constraints on the constitute parts of the resulting…

Methodology · Statistics 2013-11-05 Brian C. Franczak , Paul D. McNicholas , Ryan P. Browne , Paula M. Murray

We give families of examples where sharp rates of convergence to stationarity of the widely used Gibbs sampler are available. The examples involve standard exponential families and their conjugate priors. In each case, the transition…

Methodology · Statistics 2008-10-01 Persi Diaconis , Kshitij Khare , Laurent Saloff-Coste

A new unimodal distribution family indexed by the mode and three other parameters is derived from a mixture of a Gumbel distribution for the maximum and a Gumbel distribution for the minimum. Properties of the proposed distribution are…

Methodology · Statistics 2024-07-02 Qingyang Liu , Xianzheng Huang , Haiming Zhou