English
Related papers

Related papers: Fast Mixing for Discrete Point Processes

200 papers

Discrete distributions, particularly in high-dimensional deep models, are often highly multimodal due to inherent discontinuities. While gradient-based discrete sampling has proven effective, it is susceptible to becoming trapped in local…

Machine Learning · Computer Science 2024-10-28 Patrick Pynadath , Riddhiman Bhattacharya , Arun Hariharan , Ruqi Zhang

To sample from a general target distribution $p_*\propto e^{-f_*}$ beyond the isoperimetric condition, Huang et al. (2023) proposed to perform sampling through reverse diffusion, giving rise to Diffusion-based Monte Carlo (DMC).…

Machine Learning · Statistics 2024-01-15 Xunpeng Huang , Difan Zou , Hanze Dong , Yian Ma , Tong Zhang

We propose a covariate-dependent discrete graphical model for capturing dynamic networks among discrete random variables, allowing the dependence structure among vertices to vary with covariates. This discrete dynamic network encompasses…

Methodology · Statistics 2025-11-19 Lyndsay Roach , Qiong Li , Nanwei Wang , Xin Gao

We define a discrete-time Markov chain for abstract polymer models and show that under sufficient decay of the polymer weights, this chain mixes rapidly. We apply this Markov chain to polymer models derived from the hard-core and…

Data Structures and Algorithms · Computer Science 2021-04-14 Zongchen Chen , Andreas Galanis , Leslie Ann Goldberg , Will Perkins , James Stewart , Eric Vigoda

Determinantal point processes (DPPs) are probabilistic models for repulsion. When used to represent the occurrence of random subsets of a finite base set, DPPs allow to model global negative associations in a mathematically elegant and…

Statistics Theory · Mathematics 2019-01-29 Kayvan Sadeghi , Alessandro Rinaldo

Discrepancy is a well-known measure for the irregularity of the distribution of a point set. Point sets with small discrepancy are called low-discrepancy and are known to efficiently fill the space in a uniform manner. Low-discrepancy…

Machine Learning · Computer Science 2024-09-27 T. Konstantin Rusch , Nathan Kirk , Michael M. Bronstein , Christiane Lemieux , Daniela Rus

Dirichlet process mixtures are flexible non-parametric models, particularly suited to density estimation and probabilistic clustering. In this work we study the posterior distribution induced by Dirichlet process mixtures as the sample size…

Statistics Theory · Mathematics 2022-11-29 Filippo Ascolani , Antonio Lijoi , Giovanni Rebaudo , Giacomo Zanella

Markov combination is an operation that takes two statistical models and produces a third whose marginal distributions include those of the original models. Building upon and extending existing work in the Gaussian case, we develop Markov…

Statistics Theory · Mathematics 2025-09-24 Orlando Marigliano , Eva Riccomagno

Drawing a sample from a discrete distribution is one of the building components for Monte Carlo methods. Like other sampling algorithms, discrete sampling suffers from the high computational burden in large-scale inference problems. We…

Machine Learning · Statistics 2016-04-29 Yutian Chen , Zoubin Ghahramani

We introduce a discretization scheme for continuous localized frames using quasi-Monte Carlo integration and discrepancy theory. By generalizing classical concepts, we define a discrepancy measure on the entire phase space $\mathbb{R}^2$…

Functional Analysis · Mathematics 2025-07-02 Jan Zimmermann , Andreas Klotz , Nicki Holighaus

We study the existence of densities for distributions of piecewise deterministic Markov processes. We also obtain relationships between invariant densities of the continuous time process and that of the process observed at jump times. In…

Probability · Mathematics 2020-06-03 Piotr Gwiżdż , Marta Tyran-Kamińska

We prove finite sample complexities for sequential Monte Carlo (SMC) algorithms which require only local mixing times of the associated Markov kernels. Our bounds are particularly useful when the target distribution is multimodal and global…

Computation · Statistics 2022-08-16 Joseph Mathews , Scott C. Schmidler

Mixture distributions arise in many application areas, for example as marginal distributions or convolutions of distributions. We present a method of constructing an easily tractable discrete mixture distribution as an approximation to a…

Computation · Statistics 2017-02-20 Christian Röver , Tim Friede

Recent advances in Bayesian models for random partitions have led to the formulation and exploration of Exchangeable Sequences of Clusters (ESC) models. Under ESC models, it is the cluster sizes that are exchangeable, rather than the…

Statistics Theory · Mathematics 2022-09-08 Keith Levin , Brenda Betancourt

Probabilistic finite mixture models are widely used for unsupervised clustering. These models can often be improved by adapting them to the topology of the data. For instance, in order to classify spatially adjacent data points similarly,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Jonathan Vacher , Claire Launay , Ruben Coen-Cagli

Gradient-based Markov Chain Monte Carlo methods have recently received much attention for sampling discrete distributions, with notable examples such as Norm Constrained Gradient (NCG), Auxiliary Variable Gradient (AVG), and Discrete…

Methodology · Statistics 2025-08-04 Yuze Zhou , Zhiqiang Tan

Expressions for local discrete variance decay (DVD) rates are directly derived from discrete tracer equations without any assumptions on discrete fluxes of the second moment. Spurious mixing (SM) associated with numerical implementations of…

Atmospheric and Oceanic Physics · Physics 2026-03-26 Tridib Banerjee , Sergey Danilov , Knut Klingbeil

We propose a general modeling framework for marked Poisson processes observed over time or space. The modeling approach exploits the connection of the nonhomogeneous Poisson process intensity with a density function. Nonparametric Dirichlet…

Methodology · Statistics 2011-11-02 Matthew A. Taddy , Athanasios Kottas

In this paper, we study a strictly stationary Markov chain gradient descent algorithm operating in general Hilbert spaces. Our analysis focuses on the mixing coefficients of the underlying process, specifically the $\phi$- and…

Machine Learning · Statistics 2025-08-14 Priyanka Roy , Susanne Saminger-Platz

This paper proposes a new Bayesian multiple change-point model which is based on the hidden Markov approach. The Dirichlet process hidden Markov model does not require the specification of the number of change-points a priori. Hence our…

Statistics Theory · Mathematics 2015-05-08 Stanley I. M. Ko , Terence T. L. Chong , Pulak Ghosh