English
Related papers

Related papers: One step entropy variation in sequential sampling …

200 papers

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Computer Science 2025-02-17 Pascal Jutras-Dubé , Patrick Pynadath , Ruqi Zhang

We extend classic characterisations of posterior distributions under Dirichlet process and gamma random measures priors to a dynamic framework. We consider the problem of learning, from indirect observations, two families of time-dependent…

Statistics Theory · Mathematics 2016-11-23 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò

The two-parameter Poisson-Dirichlet distribution is the law of a sequence of decreasing nonnegative random variables with total sum one. It can be constructed from stable and Gamma subordinators with the two-parameters, $\alpha$ and…

Probability · Mathematics 2009-06-15 Shui Feng , Fuqing Gao

The purpose of this paper is to study the dynamical behavior of the sequence produced by a forward-backward algorithm involving two random maximal monotone operators and a sequence of decreasing step sizes. Defining a mean monotone operator…

Optimization and Control · Mathematics 2016-07-05 Pascal Bianchi , Walid Hachem

A stochastic Forward-Backward algorithm with a constant step is studied. At each time step, this algorithm involves an independent copy of a couple of random maximal monotone operators. Defining a mean operator as a selection integral, the…

Optimization and Control · Mathematics 2018-04-05 Pascal Bianchi , Walid Hachem , Adil Salim

We show that the stick-breaking construction of the beta process due to Paisley, et al. (2010) can be obtained from the characterization of the beta process as a Poisson process. Specifically, we show that the mean measure of the underlying…

Statistics Theory · Mathematics 2012-04-20 John Paisley , David Blei , Michael I. Jordan

A compound Poisson process whose parameters are all unknown is observed at finitely many equispaced times. Nonparametric estimators of the jump and L\'evy distributions are proposed and functional central limit theorems using the uniform…

Statistics Theory · Mathematics 2017-02-06 Alberto J. Coca

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

In our two preceding papers we studied bipartite composite boson (or quasiboson) systems through their realization in terms of deformed oscillators. Therein, the entanglement characteristics such as the entanglement entropy and purity were…

Quantum Physics · Physics 2015-04-03 A. M. Gavrilik , Yu. A. Mishchenko

Presence-only data, point locations where a species has been recorded as being present, are often used in modeling the distribution of a species as a function of a set of explanatory variables---whether to map species occurrence, to…

Applications · Statistics 2010-11-16 David I. Warton , Leah C. Shepherd

We present a machine learning model for the analysis of randomly generated discrete signals, modeled as the points of an inhomogeneous, compound Poisson point process. Like the wavelet scattering transform introduced by Mallat, our…

Statistics Theory · Mathematics 2021-10-12 Michael Perlmutter , Jieqian He , Matthew Hirn

The proposal and study of dependent prior processes has been a major research focus in the recent Bayesian nonparametric literature. In this paper, we introduce a flexible class of dependent nonparametric priors, investigate their…

Statistics Theory · Mathematics 2014-07-03 Antonio Lijoi , Bernardo Nipoti , Igor Prünster

The entropy of a binary symmetric Hidden Markov Process is calculated as an expansion in the noise parameter epsilon. We map the problem onto a one-dimensional Ising model in a large field of random signs and calculate the expansion…

Information Theory · Computer Science 2009-11-11 O. Zuk , I. Kanter , E. Domany

We say that a string of length $d$ occurs, in a Bernoulli sequence, if a success is followed by exactly $(d-1)$ failures before the next success. The counts of such $d$-strings are of interest, and in specific independent Bernoulli…

Probability · Mathematics 2008-01-15 Fred W. Huffer , Jayaram Sethuraman , Sunder Sethuraman

This study investigates the entanglement properties of disordered free fermion systems undergoing an Anderson phase transition from a delocalized to a localized phase. The entanglement entropy is employed to quantify the degree of…

Strongly Correlated Electrons · Physics 2023-09-26 Mohammad Pouranvari

The seemingly disjoint problems of count and mixture modeling are united under the negative binomial (NB) process. A gamma process is employed to model the rate measure of a Poisson process, whose normalization provides a random probability…

Methodology · Statistics 2013-10-15 Mingyuan Zhou , Lawrence Carin

This technical report proves components consistency for the Doubly Stochastic Dirichlet Process with exponential convergence of posterior probability. We also present the fundamental properties for DSDP as well as inference algorithms.…

Information Theory · Computer Science 2016-05-25 Xing Sun , Nelson H. C. Yung , Edmund Y. Lam , Hayden K. -H. So

We consider an inhomogeneous Poisson process $X$ on $[0,T]$. The intensity function of $X$ is supposed to be strictly positive and smooth on $[0,T]$ except at the point $\theta$, in which it has either a 0-type singularity (tends to 0 like…

Statistics Theory · Mathematics 2007-06-13 Serguei Dachian

Marked point process data arise when events occur in a space with event-level marks. We study clustering of replicated marked Poisson point processes and introduce Dirichlet process mixtures of marked Poisson point processes, a Bayesian…

Methodology · Statistics 2026-05-12 Minsung Choi , Seonghyun Jeong

Persistence diagrams offer a way to summarize topological and geometric properties latent in datasets. While several methods have been developed that utilize persistence diagrams in statistical inference, a full Bayesian treatment remains…

Methodology · Statistics 2019-08-08 Vasileios Maroulas , Farzana Nasrin , Christopher Oballe