English
Related papers

Related papers: Bayesian Inference of Minimally Complex Models wit…

200 papers

We investigate the complexity of logistic regression models which is defined by counting the number of indistinguishable distributions that the model can represent (Balasubramanian, 1997). We find that the complexity of logistic models with…

Machine Learning · Statistics 2019-03-04 Nicola Bulso , Matteo Marsili , Yasser Roudi

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

Learning a Bayesian network (BN) from data can be useful for decision-making or discovering causal relationships. However, traditional methods often fail in modern applications, which exhibit a larger number of observed variables than data…

Computation · Statistics 2018-06-26 Raj Agrawal , Tamara Broderick , Caroline Uhler

High-dimensional Bayesian inverse analysis (dim >> 100) is mostly unfeasible for computationally demanding, nonlinear physics-based high-fidelity (HF) models. Usually, the use of more efficient gradient-based inference schemes is impeded if…

Computational Engineering, Finance, and Science · Computer Science 2025-09-22 Jonas Nitzler , Bugrahan Z. Temür , Phaedon-Stelios Koutsourelakis , Wolfgang A. Wall

Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in…

Machine Learning · Statistics 2020-08-17 Steven Kleinegesse , Michael U. Gutmann

Bayesian inference for exponential family random graph models (ERGMs) is a doubly-intractable problem because of the intractability of both the likelihood and posterior normalizing factor. Auxiliary variable based Markov Chain Monte Carlo…

Computation · Statistics 2020-07-15 Fan Yin , Carter T. Butts

The past decades have seen enormous improvements in computational inference based on statistical models, with continual enhancement in a wide range of computational tools, in competition. In Bayesian inference, first and foremost, MCMC…

Computation · Statistics 2015-05-12 Peter J. Green , Krzysztof Łatuszyński , Marcelo Pereyra , Christian P. Robert

Modelling a complex system is almost invariably a challenging task. The incorporation of experimental observations can be used to improve the quality of a model, and thus to obtain better predictions about the behavior of the corresponding…

Computational Physics · Physics 2015-11-24 Massimiliano Bonomi , Carlo Camilloni , Andrea Cavalli , Michele Vendruscolo

A vital stage in the mathematical modelling of real-world systems is to calibrate a model's parameters to observed data. Likelihood-free parameter inference methods, such as Approximate Bayesian Computation, build Monte Carlo samples of the…

Computation · Statistics 2021-12-23 Thomas P Prescott , Ruth E Baker

Selective classification is a powerful tool for automated decision-making in high-risk scenarios, allowing classifiers to act only when confident and abstain when uncertainty is high. Given a target accuracy, our goal is to minimize…

Statistics Theory · Mathematics 2025-10-28 Mohamed Ndaoud , Peter Radchenko , Bradley Rava

In many inference problems, the evaluation of complex and costly models is often required. In this context, Bayesian methods have become very popular in several fields over the last years, in order to obtain parameter inversion, model…

Computational Engineering, Finance, and Science · Computer Science 2021-07-21 Luca Martino , Víctor Elvira , Javier López-Santiago , Gustau Camps-Valls

Latent Class Models (LCMs) are used to cluster multivariate categorical data (e.g. group participants based on survey responses). Traditional LCMs assume a property called conditional independence. This assumption can be restrictive,…

Machine Learning · Statistics 2024-06-19 Jesse Bowers , Steve Culpepper

Hierarchical models are versatile tools for joint modeling of data sets arising from different, but related, sources. Fully Bayesian inference may, however, become computationally prohibitive if the source-specific data models are complex,…

Computation · Statistics 2016-05-06 Ritabrata Dutta , Paul Blomstedt , Samuel Kaski

Motivated by examples from genetic association studies, this paper considers the model selection problem in a general complex linear model system and in a Bayesian framework. We discuss formulating model selection problems and incorporating…

Methodology · Statistics 2014-03-14 Xiaoquan Wen

Models can be simple for different reasons: because they yield a simple and computationally efficient interpretation of a generic dataset (e.g. in terms of pairwise dependences) - as in statistical learning - or because they capture the…

Disordered Systems and Neural Networks · Physics 2018-10-17 Alberto Beretta , Claudia Battistin , Clélia de Mulatier , Iacopo Mastromatteo , Matteo Marsili

Models defined by stochastic differential equations (SDEs) allow for the representation of random variability in dynamical systems. The relevance of this class of models is growing in many applied research areas and is already a standard…

Methodology · Statistics 2014-08-06 Umberto Picchini

Problems of probabilistic inference and decision making under uncertainty commonly involve continuous random variables. Often these are discretized to a few points, to simplify assessments and computations. An alternative approximation is…

Artificial Intelligence · Computer Science 2013-03-08 William B. Poland , Ross D. Shachter

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

Discovering novel materials with desired properties is essential for driving innovation. Industry 4.0 and smart manufacturing have promised transformative advances in this area through real-time data integration and automated production…

Machine Learning · Computer Science 2025-04-08 Avijit Saha Asru , Hamed Khosravi , Imtiaz Ahmed , Abdullahil Azeem

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello