English
Related papers

Related papers: Asymptotic Behavior of Free Energy When Optimal Pr…

200 papers

General Probabilistic Theories provide the most general mathematical framework for the theory of probability in an operationally natural manner, and generalize classical and quantum theories. In this article, we study state-discrimination…

Quantum Physics · Physics 2010-09-15 Koji Nuida , Gen Kimura , Takayuki Miyadera

We study the properties of variational Bayes approximations for exponential family models with missing values. It is shown that the iterative algorithm for obtaining the variational Bayesian estimator converges locally to the true value…

Statistics Theory · Mathematics 2012-07-19 Bo Wang , D. Titterington

The Bayesian brain hypothesis postulates that the brain accurately operates on statistical distributions according to Bayes' theorem. The random failure of presynaptic vesicles to release neurotransmitters may allow the brain to sample from…

Neurons and Cognition · Quantitative Biology 2021-11-30 Kevin L. McKee , Ian C. Crandell , Rishidev Chaudhuri , Randall C. O'Reilly

In statistical inference, uncertainty is unknown and all models are wrong. That is to say, a person who makes a statistical model and a prior distribution is simultaneously aware that both are fictional candidates. To study such cases,…

Machine Learning · Computer Science 2023-02-13 Sumio Watanabe

In a meta-analysis, it is important to specify a model that adequately describes the effect-size distribution of the underlying population of studies. The conventional normal fixed-effect and normal random-effects models assume a normal…

Methodology · Statistics 2013-10-21 George Karabatsos , Elizabeth Talbott , Stephen G. Walker

Bayes statistics and statistical physics have the common mathematical structure, where the log likelihood function corresponds to the random Hamiltonian. Recently, it was discovered that the asymptotic learning curves in Bayes estimation…

Machine Learning · Computer Science 2015-05-18 Sumio Watanabe

When we use the normal mixture model, the optimal number of the components describing the data should be determined. Testing homogeneity is good for this purpose; however, to construct its theory is challenging, since the test statistic…

Statistics Theory · Mathematics 2019-12-24 Natsuki Kariya , Sumio Watanabe

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

We develop a systematic procedure to approximate generalized free energy in out of equilibrium stochastic systems. The procedure only requires knowledge of the averages of macroscopic observables and uses quasi-equilibrium distribution to…

Disordered Systems and Neural Networks · Physics 2013-09-05 Alexander Mozeika

This paper discusses the asymptotic behavior of regression models under general conditions. First, we give a general inequality for the difference of the sum of square errors (SSE) of the estimated regression model and the SSE of the…

Statistics Theory · Mathematics 2013-09-17 Joseph Rynkiewicz

The conventional approach to Bayesian decision-theoretic experiment design involves searching over possible experiments to select a design that maximizes the expected value of a specified utility function. The expectation is over the joint…

Methodology · Statistics 2023-04-18 Tommie A. Catanach , Niladri Das

In this paper, we consider Bayesian hypothesis testing for the balanced one-way random effects model. A special choice of the prior formulation for the ratio of variance components is shown to yield an explicit closed-form Bayes factor…

Methodology · Statistics 2013-02-27 Min Wang , Xiaoqian Sun

Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand…

Methodology · Statistics 2022-10-11 Katarzyna Reluga , Ting Ye , Qingyuan Zhao

While observational data are routinely used to estimate causal effects of biomedical treatments, doing so requires special methods to adjust for observed confounding. These methods invariably rely on untestable statistical and causal…

Methodology · Statistics 2026-03-02 Arman Oganisian

From the sampling of data to the initialisation of parameters, randomness is ubiquitous in modern Machine Learning practice. Understanding the statistical fluctuations engendered by the different sources of randomness in prediction is…

Machine Learning · Statistics 2022-10-03 Bruno Loureiro , Cédric Gerbelot , Maria Refinetti , Gabriele Sicuro , Florent Krzakala

We consider tests of hypotheses when the parameters are not identifiable under the null in semiparametric models, where regularity conditions for profile likelihood theory fail. Exponential average tests based on integrated profile…

Statistics Theory · Mathematics 2009-08-25 Rui Song , Michael R. Kosorok , Jason P. Fine

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

We present an extension of local sensitivity analysis, also referred to as the perturbation approach for uncertainty quantification, to Bayesian inverse problems. More precisely, we show how moments of random variables with respect to the…

Numerical Analysis · Mathematics 2026-04-06 Jürgen Dölz , David Ebert

Bayesian inferences in high energy physics often use uniform prior distributions for parameters about which little or no information is available before data are collected. The resulting posterior distributions are therefore sensitive to…

Applications · Statistics 2011-06-03 Luc Demortier , Supriya Jain , Harrison B. Prosper