English
Related papers

Related papers: Score Matched Neural Exponential Families for Like…

200 papers

Simulation models often lack tractable likelihood functions, making likelihood-free inference methods indispensable. Approximate Bayesian computation generates likelihood-free posterior samples by comparing simulated and observed data…

Methodology · Statistics 2023-02-02 Joel Dyer , Patrick Cannon , Sebastian M Schmon

In many applications involving spatial point patterns, we find evidence of inhibition or repulsion. The most commonly used class of models for such settings are the Gibbs point processes. A recent alternative, at least to the statistical…

Computation · Statistics 2016-08-29 Shinichiro Shirota , Alan. E. Gelfand

A common problem in Machine Learning and statistics consists in detecting whether the current sample in a stream of data belongs to the same distribution as previous ones, is an isolated outlier or inaugurates a new distribution of data. We…

Machine Learning · Statistics 2018-05-16 Vincent Moens

There has been much recent interest in modifying Bayesian inference for misspecified models so that it is useful for specific purposes. One popular modified Bayesian inference method is "cutting feedback" which can be used when the model…

We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The nonparametric exponentially tilted empirical likelihood function is constructed…

Statistics Theory · Mathematics 2021-10-27 Siddhartha Chib , Minchul Shin , Anna Simoni

We introduce a boosting algorithm to pre-process data for fairness. Starting from an initial fair but inaccurate distribution, our approach shifts towards better data fitting while still ensuring a minimal fairness guarantee. To do so, it…

Machine Learning · Statistics 2023-08-16 Alexander Soen , Hisham Husain , Richard Nock

The prevailing maximum likelihood estimators for inferring power law models from rank-frequency data are biased. The source of this bias is an inappropriate likelihood function. The correct likelihood function is derived and shown to be…

Applications · Statistics 2021-07-27 Charlie Pilgrim , Thomas T Hills

By the nature of their construction, many statistical models for extremes result in likelihood functions that are computationally prohibitive to evaluate. This is consequently problematic for the purposes of likelihood-based inference. With…

Methodology · Statistics 2014-11-07 Robert Erhardt , Scott A. Sisson

Posterior inference with an intractable likelihood is becoming an increasingly common task in scientific domains which rely on sophisticated computer simulations. Typically, these forward models do not admit tractable densities forcing…

Machine Learning · Statistics 2020-06-29 Joeri Hermans , Volodimir Begy , Gilles Louppe

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

We introduce a new method for learning Bayesian neural networks, treating them as a stack of multivariate Bayesian linear regression models. The main idea is to infer the layerwise posterior exactly if we know the target outputs of each…

Machine Learning · Computer Science 2024-11-20 Richard Kurle , Alexej Klushyn , Ralf Herbrich

Bayesian likelihood-free methods implement Bayesian inference using simulation of data from the model to substitute for intractable likelihood evaluations. Most likelihood-free inference methods replace the full data set with a summary…

Methodology · Statistics 2020-10-16 Yinan Mao , Xueou Wang , David J. Nott , Michael Evans

Multi-messenger observations of binary neutron star mergers offer a promising path towards resolution of the Hubble constant ($H_0$) tension, provided their constraints are shown to be free from systematics such as the Malmquist bias. In…

Cosmology and Nongalactic Astrophysics · Physics 2021-11-03 Francesca Gerardi , Stephen M. Feeney , Justin Alsing

Penalized B-splines are routinely used in additive models to describe smooth changes in a response with quantitative covariates. It is typically done through the conditional mean in the exponential family using generalized additive models…

Methodology · Statistics 2020-05-12 Philippe Lambert

An important problem for HCI researchers is to estimate the parameter values of a cognitive model from behavioral data. This is a difficult problem, because of the substantial complexity and variety in human behavioral strategies. We report…

Human-Computer Interaction · Computer Science 2017-01-16 Antti Kangasrääsiö , Kumaripaba Athukorala , Andrew Howes , Jukka Corander , Samuel Kaski , Antti Oulasvirta

We consider the question of learning the natural parameters of a $k$ parameter minimal exponential family from i.i.d. samples in a computationally and statistically efficient manner. We focus on the setting where the support as well as the…

Machine Learning · Computer Science 2021-11-01 Abhin Shah , Devavrat Shah , Gregory W. Wornell

The methods of statistical physics are widely used for modelling complex networks. Building on the recently proposed Equilibrium Expectation approach, we derive a simple and efficient algorithm for maximum likelihood estimation (MLE) of…

Computation · Statistics 2020-02-12 Alexander Borisenko , Maksym Byshkin , Alessandro Lomi

We propose a score-based generative algorithm for sampling from power-scaled priors and likelihoods within the Bayesian inference framework. Our algorithm enables flexible control over prior-likelihood influence without requiring retraining…

Machine Learning · Computer Science 2026-04-03 Huseyin Tuna Erdinc , Yunlin Zeng , Abhinav Prakash Gahlot , Felix J. Herrmann

Inferring parameter distributions of complex industrial systems from noisy time series data requires methods to deal with the uncertainty of the underlying data and the used simulation model. Bayesian inference is well suited for these…

Applications · Statistics 2021-06-18 David N. John , Livia Stohrer , Claudia Schillings , Michael Schick , Vincent Heuveline