English
Related papers

Related papers: Bias in Zipf's Law Estimators

200 papers

Approximate Bayesian computation (ABC) is a class of algorithmic methods in Bayesian inference using statistical summaries and computer simulations. ABC has become popular in evolutionary genetics and in other branches of biology. However…

Computation · Statistics 2011-05-03 Olivier Francois , Guillaume Laval

Many modern statistical applications involve inference for complex stochastic models, where it is easy to simulate from the models, but impossible to calculate likelihoods. Approximate Bayesian computation (ABC) is a method of inference for…

Methodology · Statistics 2015-03-14 Paul Fearnhead , Dennis Prangle

In Bayesian statistics probability distributions express beliefs. However, for many problems the beliefs cannot be computed analytically and approximations of beliefs are needed. We seek a loss function that quantifies how "embarrassing" it…

Statistics Theory · Mathematics 2017-08-07 Reimar H. Leike , Torsten A. Enßlin

There is an increasing amount of literature focused on Bayesian computational methods to address problems with intractable likelihood. One approach is a set of algorithms known as Approximate Bayesian Computational (ABC) methods. One of the…

Methodology · Statistics 2015-10-27 Weixuan Zhu , Juan Miguel Marin , Fabrizio Leisen

Models with intractable likelihood functions arise in areas including network analysis and spatial statistics, especially those involving Gibbs random fields. Posterior parameter es timation in these settings is termed a doubly-intractable…

Computation · Statistics 2018-10-16 Lampros Bouranis , Nial Friel , Florian Maire

A computationally simple approach to inference in state space models is proposed, using approximate Bayesian computation (ABC). ABC avoids evaluation of an intractable likelihood by matching summary statistics for the observed data with…

In this study, we investigate whether speech symbols, learned through deep learning, follow Zipf's law, akin to natural language symbols. Zipf's law is an empirical law that delineates the frequency distribution of words, forming…

Computation and Language · Computer Science 2023-09-19 Shinnosuke Takamichi , Hiroki Maeda , Joonyong Park , Daisuke Saito , Hiroshi Saruwatari

Approximate Bayesian Computation (ABC) is a statistical learning technique to calibrate and select models by comparing observed data to simulated data. This technique bypasses the use of the likelihood and requires only the ability to…

Computation · Statistics 2021-05-04 Pierre-Olivier Goffard , Patrick J. Laub

Many scientifically well-motivated statistical models in natural, engineering and environmental sciences are specified through a generative process, but in some cases it may not be possible to write down a likelihood for these models…

Computation · Statistics 2018-10-10 Sanjay Chaudhuri , Subhro Ghosh , David J. Nott , Kim Cuc Pham

Performing exact posterior inference in complex generative models is often difficult or impossible due to an expensive to evaluate or intractable likelihood function. Approximate Bayesian computation (ABC) is an inference framework that…

Machine Learning · Statistics 2016-02-16 Jovana Mitrovic , Dino Sejdinovic , Yee Whye Teh

This chapter will appear in the forthcoming Handbook of Approximate Bayesian Computation (2018). The conceptual and methodological framework that underpins approximate Bayesian computation (ABC) is targetted primarily towards problems in…

Computation · Statistics 2018-03-20 Christopher C Drovandi , Clara Grazian , Kerrie Mengersen , Christian Robert

Approximate Bayesian Computation (ABC) has gained popularity as a method for conducting inference and forecasting in complex models, most notably those which are intractable in some sense. In this paper we use ABC to produce probabilistic…

Methodology · Statistics 2023-11-03 Chaya Weerasinghe , Ruben Loaiza-Maya , Gael M. Martin , David T. Frazier

Biosemiosis is a process of choice-making between simultaneously alternative options. It is well-known that, when sufficiently young children encounter a new word, they tend to interpret it as pointing to a meaning that does not have a word…

Computation and Language · Computer Science 2022-09-22 David Carrera-Casado , Ramon Ferrer-i-Cancho

By the nature of their construction, many statistical models for extremes result in likelihood functions that are computationally prohibitive to evaluate. This is consequently problematic for the purposes of likelihood-based inference. With…

Methodology · Statistics 2014-11-07 Robert Erhardt , Scott A. Sisson

Free-energy-based adaptive biasing methods, such as Metadynamics, the Adaptive Biasing Force (ABF) and their variants, are enhanced sampling algorithms widely used in molecular simulations. Although their efficiency has been empirically…

Probability · Mathematics 2026-01-29 Tony Lelièvre , Xuyang Lin , Pierre Monmarché

Statistical system models provide the basis for the examination of various sorts of distributions. Classification distributions are a very common and versatile form of statistics in e.g. real economic, social, and IT systems. The…

Computation · Statistics 2019-12-20 Uwe Petersohn , Thomas Dedek , Sandra Zimmer , Hans Biskupski

Zipf's law describes the empirical size distribution of the components of many systems in natural and social sciences and humanities. We show, by solving a statistical model, that Zipf's law co-occurs with the maximization of the diversity…

Statistical Mechanics · Physics 2021-10-05 Onofrio Mazzarisi , Amanda de Azevedo-Lopes , Jeferson J. Arenzon , Federico Corberi

Why does Zipf's law give a good description of data from seemingly completely unrelated phenomena? Here it is argued that the reason is that they can all be described as outcomes of a ubiquitous random group division: the elements can be…

Physics and Society · Physics 2015-03-19 Seung Ki Baek , Sebastian Bernhardsson , Petter Minnhagen

A new approach to inference in state space models is proposed, based on approximate Bayesian computation (ABC). ABC avoids evaluation of the likelihood function by matching observed summary statistics with statistics computed from data…

Statistics Theory · Mathematics 2014-10-01 Gael M. Martin , Brendan P. M. McCabe , Worapree Maneesoonthorn , Christian P. Robert

Approximate Bayesian computation (ABC) methods permit approximate inference for intractable likelihoods when it is possible to simulate from the model. However they perform poorly for high dimensional data, and in practice must usually be…

Computation · Statistics 2017-04-05 Dennis Prangle , Richard G. Everitt , Theodore Kypraios