English
Related papers

Related papers: Model Inference with Reference Priors

200 papers

The rise of foundation models -- large, pretrained machine learning models that can be finetuned to a variety of tasks -- has revolutionized the fields of natural language processing and computer vision. In high-energy physics, the question…

High Energy Physics - Phenomenology · Physics 2026-01-12 Anna Hallin

A major limitation of machine learning (ML) prediction models is that they recover associational, rather than causal, predictive relationships between variables. In high-stakes automation applications of ML this is problematic, as the model…

Machine Learning · Computer Science 2025-11-04 Jianqiao Mao , Max A. Little

We classify two types of Hierarchical Bayesian Model found in the literature as Hierarchical Prior Model (HPM) and Hierarchical Stochastic Model (HSM). Then, we focus on studying the theoretical implications of the HSM. Using examples of…

Applications · Statistics 2016-11-10 Stephen Wu , Panagiotis Angelikopoulos , James L. Beck , Petros Koumoutsakos

We introduce a framework for estimating causal effects of binary and continuous treatments in high dimensions. We show how posterior distributions of treatment and outcome models can be used together with doubly robust estimators. We…

Methodology · Statistics 2020-10-06 Joseph Antonelli , Georgia Papadogeorgou , Francesca Dominici

We study nonparametric Bayesian models for reversible multi-dimensional diffusions with periodic drift. For continuous observation paths, reversibility is exploited to prove a general posterior contraction rate theorem for the drift…

Statistics Theory · Mathematics 2024-08-02 Matteo Giordano , Kolyan Ray

We present Causal Posterior Estimation (CPE), a novel method for Bayesian inference in simulator models, i.e., models where the evaluation of the likelihood function is intractable or too computationally expensive, but where one can…

Machine Learning · Computer Science 2025-05-28 Simon Dirmeier , Antonietta Mira

We review the result of SUSY parameter fits based on frequentist analyses of experimental constraints from electroweak precision data, (g-2)_mu, B-physics and cosmological data. We investigate the parameters of the constrained MSSM (CMSSM)…

High Energy Physics - Phenomenology · Physics 2010-12-13 S. Heinemeyer , G. Weiglein

Computational materials design often profits from the fact that some complicated contributions are not calculated for the real material, but replaced by results of models. We turn this approximation into a very general and in principle…

Other Condensed Matter · Physics 2021-03-15 Marco Vanzini , Ayoub Aouina , Martin Panholzer , Matteo Gatti , Lucia Reining

Cosmological measurements of structure are placing increasingly strong constraints on the sum of the neutrino masses, $\Sigma m_\nu$, through Bayesian inference. Because these constraints depend on the choice for the prior probability…

Cosmology and Nongalactic Astrophysics · Physics 2018-05-01 Andrew J. Long , Marco Raveri , Wayne Hu , Scott Dodelson

We update constraints on the Hubble function H(phi) during inflation, using the most recent cosmic microwave background (CMB) and large scale structure (LSS) data. Our main focus is on a comparison between various commonly used methods of…

Astrophysics · Physics 2009-06-23 Jan Hamann , Julien Lesgourgues , Wessel Valkenburg

In most (weakly interacting) extensions of the Standard Model the relation mapping the parameter values onto experimentally measurable quantities can be computed (with some uncertainties), but the inverse relation is usually not known. In…

High Energy Physics - Phenomenology · Physics 2013-10-30 Nicki Bornhauser , Manuel Drees

We advocate for a new paradigm of cosmological likelihood-based inference, leveraging recent developments in machine learning and its underlying technology, to accelerate Bayesian inference in high-dimensional settings. Specifically, we…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-06 Davide Piras , Alicja Polanska , Alessio Spurio Mancini , Matthew A. Price , Jason D. McEwen

Additive regression models with interactions are widely studied in the literature, using methods such as splines or Gaussian process regression. However, these methods can pose challenges for estimation and model selection, due to the…

Statistics Theory · Mathematics 2023-06-14 Wicher Bergsma , Haziq Jamil

We infer both microscopic and macroscopic behaviors of a three-dimensional chaotic fluid flow using reservoir computing. In our procedure of the inference, we assume no prior knowledge of a physical process of a fluid flow except that its…

Computational Physics · Physics 2018-09-12 Kengo Nakai , Yoshitaka Saiki

This paper develops an inferential theory for high-dimensional matrix-variate factor models with missing observations. We propose an easy-to-use all-purpose method that involves two straightforward steps. First, we perform principal…

Methodology · Statistics 2025-03-26 Yongxia Zhang , Jinwen Liang , Liwen Xu , Keming Yu , Maozai Tian

Conditional mean embeddings (CMEs) have proven themselves to be a powerful tool in many machine learning applications. They allow the efficient conditioning of probability distributions within the corresponding reproducing kernel Hilbert…

Statistics Theory · Mathematics 2020-07-16 Ilja Klebanov , Ingmar Schuster , T. J. Sullivan

It is common to hold prior beliefs that are not characterized by points in the parameter space but instead are relational in nature and can be described by a linear subspace. While some previous work has been done to account for such prior…

Methodology · Statistics 2024-01-17 Daniel K. Sewell

Reversibility is a key concept in Markov models and Master-equation models of molecular kinetics. The analysis and interpretation of the transition matrix encoding the kinetic properties of the model relies heavily on the reversibility…

Chemical Physics · Physics 2015-09-23 Benjamin Trendelkamp-Schroer , Hao Wu , Fabian Paul , Frank Noé

This article establishes general conditions for posterior consistency of Bayesian finite mixture models with a prior on the number of components. That is, we provide sufficient conditions under which the posterior concentrates on…

Statistics Theory · Mathematics 2022-05-09 Jeffrey W. Miller

Projection predictive inference is a decision theoretic Bayesian approach that decouples model estimation from decision making. Given a reference model previously built including all variables present in the data, projection predictive…

Methodology · Statistics 2020-10-15 Alejandro Catalina , Paul-Christian Bürkner , Aki Vehtari