English
Related papers

Related papers: Predictive Complexity Priors

200 papers

We develop simple methods for constructing likelihoods and parameter priors for learning about the parameters and structure of a Bayesian network. In particular, we introduce several assumptions that permit the construction of likelihoods…

Machine Learning · Computer Science 2021-07-01 David Heckerman , Dan Geiger

While Bayesian neural networks have many appealing characteristics, current priors do not easily allow users to specify basic properties such as expected lengthscale or amplitude variance. In this work, we introduce Poisson Process Radial…

Machine Learning · Computer Science 2019-12-13 Beau Coker , Melanie F. Pradier , Finale Doshi-Velez

There is currently a renewed interest in the Bayesian predictive approach to statistics. This paper offers a review on foundational concepts and focuses on predictive modeling, which by directly reasoning on prediction, bypasses inferential…

Statistics Theory · Mathematics 2024-11-22 Sandra Fortini , Sonia Petrone

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Neural networks appear to have mysterious generalization properties when using parameter counting as a proxy for complexity. Indeed, neural networks often have many more parameters than there are data points, yet still provide good…

Machine Learning · Computer Science 2020-05-26 Wesley J. Maddox , Gregory Benton , Andrew Gordon Wilson

Orthogonal polynomial approximations form the foundation to a set of well-established methods for uncertainty quantification known as polynomial chaos. These approximations deliver models for emulating physical systems in a variety of…

Computational Engineering, Finance, and Science · Computer Science 2022-03-23 Chun Yui Wong , Pranay Seshadri , Andrew B. Duncan , Ashley Scillitoe , Geoffrey Parks

Probabilistic predictions from neural networks which account for predictive uncertainty during classification is crucial in many real-world and high-impact decision making settings. However, in practice most datasets are trained on…

Machine Learning · Computer Science 2022-09-30 Satya Borgohain , Klaus Ackermann , Ruben Loaiza-Maya

Prior sensitivity examination plays an important role in applied Bayesian analyses. This is especially true for Bayesian hierarchical models, where interpretability of the parameters within deeper layers in the hierarchy becomes…

Methodology · Statistics 2013-12-18 Malgorzata Roos , Thiago G. Martins , Leonhard Held , Havard Rue

Sensitivity forecasts inform the design of experiments and the direction of theoretical efforts. To arrive at representative results, Bayesian forecasts should marginalize their conclusions over uncertain parameters and noise realizations…

Instrumentation and Methods for Astrophysics · Physics 2024-05-24 T. Gessey-Jones , W. J. Handley

Machine learning has developed a variety of tools for learning and representing high-dimensional distributions with structure. Recent years have also seen big advances in designing multi-item mechanisms. Akin to overfitting, however, these…

Computer Science and Game Theory · Computer Science 2022-04-01 Yang Cai , Constantinos Daskalakis

We consider priors for several nonparametric Bayesian models which use finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

Bayesian Networks may be appealing for clinical decision-making due to their inclusion of causal knowledge, but their practical adoption remains limited as a result of their inability to deal with unstructured data. While neural networks do…

Machine Learning · Computer Science 2022-11-16 Paloma Rabaey , Cedric De Boom , Thomas Demeester

We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite…

Methodology · Statistics 2024-11-19 Edgar C. Merkle , Oludare Ariyo , Sonja D. Winter , Mauricio Garnier-Villarreal

We introduce a computational efficient data-driven framework suitable for quantifying the uncertainty in physical parameters and model formulation of computer models, represented by differential equations. We construct physics-informed…

Machine Learning · Statistics 2023-02-01 Michail Spitieris , Ingelin Steinsland

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

We study posterior contraction behaviors for parameters of interest in the context of Bayesian mixture modeling, where the number of mixing components is unknown while the model itself may or may not be correctly specified. Two…

Statistics Theory · Mathematics 2019-01-17 Aritra Guha , Nhat Ho , XuanLong Nguyen

Many of the data, particularly in medicine and disease mapping are count. Indeed, the under or overdispersion problem in count data distrusts the performance of the classical Poisson model. For taking into account this problem, in this…

Methodology · Statistics 2021-05-19 Mahsa Nadifar , Hossein Baghishani , Thomas Kneib , Afshin Fallah

What happens to the optimal interpretation of noisy data when there exists more than one equally plausible interpretation of the data? In a Bayesian model-learning framework the answer depends on the prior expectations of the dynamics of…

Other Quantitative Biology · Quantitative Biology 2007-05-23 Gurinder Singh Atwal , William Bialek

With the current ongoing debate about fairness, explainability and transparency of machine learning models, their application in high-impact clinical decision-making systems must be scrutinized. We consider a real-life example of risk…

Machine Learning · Computer Science 2020-11-13 Sandhya Tripathi , Bradley A. Fritz , Mohamed Abdelhack , Michael S. Avidan , Yixin Chen , Christopher R. King