中文
相关论文

相关论文: An invariant bayesian model selection principle fo…

200 篇论文

One of the pivotal tasks in scientific machine learning is to represent underlying dynamical systems from time series data. Many methods for such dynamics learning explicitly require the derivatives of state data, which are not directly…

机器学习 · 计算机科学 2024-04-17 Dongwei Ye , Mengwu Guo

Accurate tuning of hyperparameters is crucial to ensure that models can generalise effectively across different settings. In this paper, we present theoretical guarantees for hyperparameter selection using variational Bayes in the…

统计理论 · 数学 2025-04-07 Dennis Nieman , Botond Szabó

We propose a new \textit{quadratic programming-based} method of approximating a nonstandard density using a multivariate Gaussian density. Such nonstandard densities usually arise while developing posterior samplers for unobserved…

计量经济学 · 经济学 2023-02-14 Abhishek K. Umrawal , Joshua C. C. Chan

We investigate Bayesian predictive inference for finite population quantities when there are unequal probabilities of selection. Only limited information about the sample design is available; i.e., only the first-order selection…

统计方法学 · 统计学 2018-04-10 Junheng Ma , Joe Sedransk , Balgobin Nandram , Lu Chen

Variational methods are employed in situations where exact Bayesian inference becomes intractable due to the difficulty in performing certain integrals. Typically, variational methods postulate a tractable posterior and formulate a lower…

We consider multivariate centered Gaussian models for the random variable $Z=(Z_1,\ldots, Z_p)$, invariant under the action of a subgroup of the group of permutations on $\{1,\ldots, p\}$. Using the representation theory of the symmetric…

统计理论 · 数学 2022-05-17 Piotr Graczyk , Hideyuki Ishi , Bartosz Kołodziejek , Hélène Massam

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

统计方法学 · 统计学 2022-06-01 Mario Beraha , Jim E. Griffin

Bayesian statistical inference for Generalized Linear Models (GLMs) with parameters lying on a constrained space is of general interest (e.g., in monotonic or convex regression), but often constructing valid prior distributions supported on…

统计方法学 · 统计学 2021-09-02 Rahul Ghosal , Sujit K. Ghosh

We consider the problem of estimating the conditional mean of a real Gaussian variable $\nolinebreak Y=\sum_{i=1}^p\nolinebreak\theta_iX_i+\nolinebreak \epsilon$ where the vector of the covariates $(X_i)_{1\leq i\leq p}$ follows a joint…

统计理论 · 数学 2009-04-28 Nicolas Verzelen

Model selection aims to determine which theoretical models are most plausible given some data, without necessarily asking about the preferred values of the model parameters. A common model selection question is to ask when new data require…

天体物理学 · 物理学 2008-11-26 Andrew R. Liddle , Pia Mukherjee , David Parkinson

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually…

应用统计 · 统计学 2024-10-15 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

We develop a Bayesian variable selection method, called SVEN, based on a hierarchical Gaussian linear model with priors placed on the regression coefficients as well as on the model space. Sparsity is achieved by using degenerate spike…

统计方法学 · 统计学 2020-08-04 Dongjin Li , Somak Dutta , Vivekananda Roy

We propose a novel Riemannian geometric framework for variational inference in Bayesian models based on the nonparametric Fisher-Rao metric on the manifold of probability density functions. Under the square-root density representation, the…

统计方法学 · 统计学 2019-03-29 Abhijoy Saha , Karthik Bharath , Sebastian Kurtek

Bayesian model selection with improper priors is not well-defined because of the dependence of the marginal likelihood on the arbitrary scaling constants of the within-model prior densities. We show how this problem can be evaded by…

统计理论 · 数学 2020-04-28 A. Philip Dawid , Monica Musio

We consider Bayesian inference problems with computationally intensive likelihood functions. We propose a Gaussian process (GP) based method to approximate the joint distribution of the unknown parameters and the data. In particular, we…

统计计算 · 统计学 2018-03-15 Hongqiao Wang , Jinglai Li

We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This…

统计方法学 · 统计学 2023-09-28 Youngsoo Baek , Wilkins Aquino , Sayan Mukherjee

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

机器学习 · 统计学 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

While robust divergence such as density power divergence and $\gamma$-divergence is helpful for robust statistical inference in the presence of outliers, the tuning parameter that controls the degree of robustness is chosen in a…

统计方法学 · 统计学 2021-09-15 Shonosuke Sugasawa , Shouto Yonekura

We consider the problem of estimating complex statistical latent variable models using variational Bayes methods. These methods are used when exact posterior inference is either infeasible or computationally expensive, and they approximate…

统计方法学 · 统计学 2025-02-28 David Gunawan , David Nott , Robert Kohn

This paper shows that the normalized maximum likelihood~(NML) code-length calculated in [1] is an upper bound on the NML code-length strictly calculated for the Gaussian Mixture Model. When we use this upper bound on the NML code-length, we…

信息论 · 计算机科学 2018-11-20 So Hirai , Kenji Yamanishi