English
Related papers

Related papers: Conjugacy properties of time-evolving Dirichlet an…

200 papers

We present a machine learning model for the analysis of randomly generated discrete signals, modeled as the points of an inhomogeneous, compound Poisson point process. Like the wavelet scattering transform introduced by Mallat, our…

Statistics Theory · Mathematics 2021-10-12 Michael Perlmutter , Jieqian He , Matthew Hirn

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

In this paper we propose a new methodology for solving a discrete time stochastic Markovian control problem under model uncertainty. By utilizing the Dirichlet process, we model the unknown distribution of the underlying stochastic process…

Optimization and Control · Mathematics 2022-03-29 Tao Chen , Jiyoun Myung

The beta distribution serves as a canonical tool for modeling probabilities in statistics and machine learning. However, there is limited work on flexible and computationally convenient stochastic process extensions for modeling dependent…

Methodology · Statistics 2025-03-18 Changwoo J. Lee , Alessandro Zito , Huiyan Sang , David B. Dunson

We present a nonparametric Bayesian joint model for multivariate continuous and categorical variables, with the intention of developing a flexible engine for multiple imputation of missing values. The model fuses Dirichlet process mixtures…

Applications · Statistics 2015-10-14 Jared S. Murray , Jerome P. Reiter

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises"…

We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet…

Methodology · Statistics 2021-06-22 Jingyu He , Nicholas Polson , Jianeng Xu

In this work we introduce a mixture of GPs to address the data association problem, i.e. to label a group of observations according to the sources that generated them. Unlike several previously proposed GP mixtures, the novel mixture has…

Machine Learning · Statistics 2011-08-18 Miguel Lázaro-Gredilla , Steven Van Vaerenbergh , Neil Lawrence

Doubly intractable problems occur when both the likelihood and the posterior are available only in unnormalised form, with computationally intractable normalisation constants. Bayesian inference then typically requires direct approximation…

We consider nonparametric Bayesian inference in a reflected diffusion model $dX_t = b (X_t)dt + \sigma(X_t) dW_t,$ with discretely sampled observations $X_0, X_\Delta, \dots, X_{n\Delta}$. We analyse the nonlinear inverse problem…

Statistics Theory · Mathematics 2020-05-26 Richard Nickl , Jakob Söhl

We discuss Bayesian inference for a known-mean Gaussian model with a compound symmetric variance-covariance matrix. Since the space of such matrices is a linear subspace of that of positive definite matrices, we utilize the methods of…

Methodology · Statistics 2023-03-20 Zachary M. Pisano

This paper introduces a novel family of geostatistical models designed to capture complex features beyond the reach of traditional Gaussian processes. The proposed family, termed the Poisson-Gaussian Mixture Process (POGAMP), is…

Methodology · Statistics 2024-12-09 F. B. Gonçalves , M. O. Prates , G. A. S. Aguilar

We describe nonparametric deconvolution models (NDMs), a family of Bayesian nonparametric models for collections of data in which each observation is the average over the features from heterogeneous particles. For example, these types of…

Machine Learning · Computer Science 2020-03-18 Allison J. B. Chaney , Archit Verma , Young-suk Lee , Barbara E. Engelhardt

In this paper we consider parameter estimation for discretely observed diffusion processes. In particular, we focus on data that are observed at low frequency and methodology that can estimate parameters with uncertainty quantification.…

Computation · Statistics 2026-05-01 Jingning Yao , Ajay Jasra , Sheng Jiang

Forecast combination integrates information from various sources by consolidating multiple forecast results from the target time series. Instead of the need to select a single optimal forecasting model, this paper introduces a deep learning…

Machine Learning · Computer Science 2023-11-27 Yinuo Ren , Feng Li , Yanfei Kang , Jue Wang

We present a concise, self-contained derivation of diffusion-based generative models. Starting from basic properties of Gaussian distributions (densities, quadratic expectations, re-parameterisation, products, and KL divergences), we…

Machine Learning · Computer Science 2025-11-18 Sepehr Maleki , Negar Pourmoazemi

We present a method that models the evolution of an unbounded number of time series clusters by switching among an unknown number of regimes with linear dynamics. We develop a Bayesian non-parametric approach using a hierarchical Dirichlet…

Machine Learning · Statistics 2025-10-09 Adrián Pérez-Herrero , Paulo Félix , Jesús Presedo , Carl Henrik Ek

To understand biological diversification, it is important to account for large-scale processes that affect the evolutionary history of groups of co-distributed populations of organisms. Such events predict temporally clustered divergences…

Populations and Evolution · Quantitative Biology 2014-08-11 Jamie R. Oaks

Mixture models are commonly used in applications with heterogeneity and overdispersion in the population, as they allow the identification of subpopulations. In the Bayesian framework, this entails the specification of suitable prior…

Methodology · Statistics 2023-06-21 Andrea Cremaschi , Timothy M. Wertz , Maria De Iorio

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

Machine Learning · Statistics 2022-04-29 Alexander Terenin