English
Related papers

Related papers: The adaptive interpolation method: A simple scheme…

200 papers

In general, the best explanation for a given observation makes no promises on how good it is with respect to other alternative explanations. A major deficiency of message-passing schemes for belief revision in Bayesian networks is their…

Artificial Intelligence · Computer Science 2013-03-26 Eugene Santos

This paper considers inference for conditional moment inequality models using a multiscale statistic. We derive the asymptotic distribution of this test statistic and use the result to propose feasible critical values that have a simple…

Applications · Statistics 2015-12-10 Timothy B. Armstrong , Hock Peng Chan

In model development, model calibration and validation play complementary roles toward learning reliable models. In this article, we expand the Bayesian Validation Metric framework to a general calibration and validation framework by…

Methodology · Statistics 2020-08-04 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

A common problem in natural sciences is the comparison of competing models in the light of observed data. Bayesian model comparison provides a statistically sound framework for this comparison based on the evidence each model provides for…

Machine Learning · Statistics 2022-03-23 Jan Boelts

Many algorithms and applications involve repeatedly solving variations of the same inference problem; for example we may want to introduce new evidence to the model or perform updates to conditional dependencies. The goal of adaptive…

Data Structures and Algorithms · Computer Science 2012-06-18 Umut A. Acar , Alexander T. Ihler , Ramgopal Mettu , Ozgur Sumer

We present a new approach to the electromagnetic inverse problem that explicitly addresses the ambiguity associated with its ill-posed character. Rather than calculating a single ``best'' solution according to some criterion, our approach…

Neurons and Cognition · Quantitative Biology 2007-05-23 David M. Schmidt , John S. George , C. C. Wood

Extrapolation is a generic problem in physics and mathematics: how to use asymptotic data in one parametric regime to learn about the behavior of a function in another parametric regime. For example: extending weak coupling expansions to…

High Energy Physics - Theory · Physics 2019-10-25 Ovidiu Costin , Gerald V. Dunne

Models with intractable likelihood functions arise in areas including network analysis and spatial statistics, especially those involving Gibbs random fields. Posterior parameter es timation in these settings is termed a doubly-intractable…

Computation · Statistics 2018-10-16 Lampros Bouranis , Nial Friel , Florian Maire

Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent…

Instrumentation and Methods for Astrophysics · Physics 2022-04-12 J. Lopez-Santiago , L. Martino , J. Miguez , M. A. Vazquez

This paper studies a high-dimensional inference problem involving the matrix tensor product of random matrices. This problem generalizes a number of contemporary data science problems including the spiked matrix models used in sparse…

Information Theory · Computer Science 2020-12-18 Galen Reeves

We demonstrate how data fission, a method for creating synthetic replicates from single observations, can be applied to empirical Bayes estimation. This extends recent work on empirical Bayes with multiple replicates to the classical…

Methodology · Statistics 2024-10-17 Nikolaos Ignatiadis , Dennis L. Sun

We propose an efficient method for Bayesian network inference in models with functional dependence. We generalize the multiplicative factorization method originally designed by Takikawa and D Ambrosio(1999) FOR models WITH independence OF…

Artificial Intelligence · Computer Science 2013-01-07 Jirka Vomlel

The Bayesian approach has proved to be a coherent approach to handle ill posed Inverse problems. However, the Bayesian calculations need either an optimization or an integral calculation. The maximum a posteriori (MAP) estimation requires…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov…

Machine Learning · Computer Science 2025-11-11 Di Zhang

Total probability and Bayes formula are two basic tools for using prior information in the Bayesian statistics. In this paper we introduce an alternative tool for using prior information. This new toold enables us to improve some…

Mathematical Physics · Physics 2009-11-10 Adel Mohammadpour , Ali Mohammad-Djafari

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

In this paper, we explore adaptive inference based on variational Bayes. Although several studies have been conducted to analyze the contraction properties of variational posteriors, there is still a lack of a general and computationally…

Statistics Theory · Mathematics 2024-03-12 Ilsang Ohn , Lizhen Lin

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a…

Numerical Analysis · Mathematics 2023-06-21 Jonathan Wittmer , C. G. Krishnanunni , Hai V. Nguyen , Tan Bui-Thanh

Bayesian inference plays an important role in advancing machine learning, but faces computational challenges when applied to complex models such as deep neural networks. Variational inference circumvents these challenges by formulating…

Machine Learning · Statistics 2018-08-03 Mohammad Emtiyaz Khan , Didrik Nielsen