English
Related papers

Related papers: One step entropy variation in sequential sampling …

200 papers

Observational entropy -- a quantity that unifies Boltzmann's entropy, Gibbs' entropy, von Neumann's macroscopic entropy, and the diagonal entropy -- has recently been argued to play a key role in a modern formulation of statistical…

Quantum Physics · Physics 2026-03-24 Teruaki Nagasawa , Kohtaro Kato , Eyuri Wakakuwa , Francesco Buscemi

We are interested in estimating the location of what we call "smooth change-point" from $n$ independent observations of an inhomogeneous Poisson process. The smooth change-point is a transition of the intensity function of the process from…

Statistics Theory · Mathematics 2021-02-17 A. Amiri , S Dachian

This paper deals with the study of dependencies between two given events modeled by point processes. In particular, we focus on the context of DNA to detect favored or avoided distances between two given motifs along a genome suggesting…

Statistics Theory · Mathematics 2011-07-22 Laure Sansonnet

Many popular Bayesian nonparametric priors can be characterized in terms of exchangeable species sampling sequences. However, in some applications, exchangeability may not be appropriate. We introduce a {novel and probabilistically coherent…

Statistics Theory · Mathematics 2015-03-17 Edoardo M. Airoldi , Thiago Costa , Federico Bassetti , Fabrizio Leisen , Michele Guindani

Filtered Poisson processes are often used as reference models for intermittent fluc- tuations in physical systems. Such a process is here extended by adding a noise term, either as a purely additive term to the process or as a dynamical…

Data Analysis, Statistics and Probability · Physics 2018-05-04 Audun Theodorsen , Odd Erik Garcia , Martin Rypdal

We introduce an online outlier detection algorithm to detect outliers in a sequentially observed data stream. For this purpose, we use a two-stage filtering and hedging approach. In the first stage, we construct a multi-modal probability…

Machine Learning · Computer Science 2018-03-13 Mohammadreza Mohaghegh Neyshabouri , Suleyman Serdar Kozat

Inferring models, predicting the future, and estimating the entropy rate of discrete-time, discrete-event processes is well-worn ground. However, a much broader class of discrete-event processes operates in continuous-time. Here, we provide…

Statistical Mechanics · Physics 2020-05-11 S. E. Marzen , J. P. Crutchfield

The length-scale dependence of the dynamic entropy is studied in a molecular dynamics simulation of a binary Lennard-Jones liquid above the mode-coupling critical temperature $T_c$. A number of methods exist for estimating the entropy of…

Soft Condensed Matter · Physics 2009-10-31 Paolo Allegrini , Jack F. Douglas , Sharon C. Glotzer

We develop nonparametric Bayesian modelling approaches for Poisson processes, using weighted combinations of structured beta densities to represent the point process intensity function. For a regular spatial domain, such as the unit square,…

Methodology · Statistics 2021-06-10 Chunyi Zhao , Athanasios Kottas

We show that when the proportions of a countable set of species are organized as an exchangeable partition of the unit interval and we take a sample on it, then the Bayesian posterior entropy converges a.s. and in L^1 to the entropy of the…

Probability · Mathematics 2023-11-20 Servet Martinez

This paper addresses the mapping problem. Using a conjugate prior form, we derive the exact theoretical batch multi-object posterior density of the map given a set of measurements. The landmarks in the map are modeled as extended objects,…

Machine Learning · Statistics 2018-11-09 Maryam Fatemi , Karl Granström , Lennart Svensson , Francisco J. R. Ruiz , Lars Hammarstrand

Our purpose in this paper is to apply the general methodology for model selection based on T-estimators developed in Birg\'{e} [Ann. Inst. H. Poincar\'{e} Probab. Statist. 42 (2006) 273--325] to the particular situation of the estimation of…

Statistics Theory · Mathematics 2009-09-29 Lucien Birgé

The so-called Froehlich entropy is the entropy variation of a material under the application of an electric field. This quantity can be calculated, under suitable hypotheses, directly from the measured real part of the dielectric function.…

Applied Physics · Physics 2021-04-16 Jacopo Parravicini , Gianbattista Parravicini

Estimation of permutation entropy (PE) using Bayesian statistical methods is presented for systems where the ordinal pattern sampling follows an independent, multinomial distribution. It is demonstrated that the PE posterior distribution is…

Data Analysis, Statistics and Probability · Physics 2022-02-09 Douglas J. Little , Joshua P. Toomey , Deb M. Kane

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

We consider Bayesian sample size determination using a criterion that utilizes the first two moments of the expected posterior variance. We study the resulting sample size in dependence on the chosen prior and explore the success rate for…

Statistics Theory · Mathematics 2020-02-28 Jörg Martin , Clemens Elster

Consider a compound Poisson process with jump measure $\nu$ supported by finitely many positive integers. We propose a method for estimating $\nu$ from a single, equidistantly sampled trajectory and develop associated statistical…

Statistics Theory · Mathematics 2009-09-29 Werner Ehm , Benjamin Staude , Stefan Rotter

The Poisson compound decision problem is a long-standing problem in statistics, where empirical Bayes methodologies are commonly used to estimate Poisson's means in static or batch domains. In this paper, we study the Poisson compound…

Methodology · Statistics 2025-06-10 Stefano Favaro , Sandra Fortini

We study the problem of non-parametric Bayesian estimation of the intensity function of a Poisson point process. The observations are $n$ independent realisations of a Poisson point process on the interval $[0,T]$. We propose two related…

Methodology · Statistics 2020-03-31 Shota Gugushvili , Frank van der Meulen , Moritz Schauer , Peter Spreij

We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction,…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal