English
Related papers

Related papers: Constructing Priors that Penalize the Complexity o…

200 papers

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

A non-stationary spatial Gaussian random field (GRF) is described as the solution of an inhomogeneous stochastic partial differential equation (SPDE), where the covariance structure of the GRF is controlled by the coefficients in the SPDE.…

Methodology · Statistics 2016-08-11 Geir-Arne Fuglstad , Daniel Simpson , Finn Lindgren , Håvard Rue

Quantifying the uncertainty in the output of a neural network is essential for deployment in scientific or engineering applications where decisions must be made under limited or noisy data. Bayesian neural networks (BNNs) provide a…

Machine Learning · Statistics 2026-03-10 Alex Alberts , Ilias Bilionis

The time-dependent deformation of concrete, particularly creep, remains a key challenge for reliable and material-efficient design. Experimental results show that tailored preloading, short-term loads exceeding the subsequent sustained…

Computational Engineering, Finance, and Science · Computer Science 2026-04-29 Leonie Heller , Christopher Taube , Gledson Rodrigo Tondo , Guido Morgenthal

Gaussian processes (GPs) are a Bayesian machine learning approach widely used to construct surrogate models for the uncertainty quantification of computer simulation codes in industrial applications. It provides both a mean predictor and an…

This article introduces a novel framework for nonparametric priors on real-valued random vectors, which can be viewed as a multivariate generalization of neutral-to-the right priors. It is based on randomizing the exponent measure of a…

Methodology · Statistics 2026-05-13 Florian Brück

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

Methodology · Statistics 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

To include parameter uncertainty into probabilistic climate forecasts one must first specify a prior. We advocate the use of objective priors, and, in particular, the Jeffreys' Prior. In previous work we have derived expressions for the…

Atmospheric and Oceanic Physics · Physics 2010-05-14 Stephen Jewson , Dan Rowlands , Myles Allen

Neural Radiance Fields (NeRF) face significant challenges in extreme few-shot scenarios, primarily due to overfitting and long training times. Existing methods, such as FreeNeRF and SparseNeRF, use frequency regularization or pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Chin-Yang Lin , Chung-Ho Wu , Chang-Han Yeh , Shih-Han Yen , Cheng Sun , Yu-Lun Liu

Existing disentanglement methods for deep generative models rely on hand-picked priors and complex encoder-based architectures. In this paper, we propose the Hessian Penalty, a simple regularization term that encourages the Hessian of a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 William Peebles , John Peebles , Jun-Yan Zhu , Alexei Efros , Antonio Torralba

The application of Bayesian inference for the purpose of model selection is very popular nowadays. In this framework, models are compared through their marginal likelihoods, or their quotients, called Bayes factors. However, marginal…

Methodology · Statistics 2022-07-27 F. Llorente , L. Martino , E. Curbelo , J. Lopez-Santiago , D. Delgado

This paper is devoted to the estimation of a partial graphical model with a structural Bayesian penalization. Precisely, we are interested in the linear regression setting where the estimation is made through the direct links between…

Statistics Theory · Mathematics 2021-05-25 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

The hierarchical prior used in Latent Gaussian models (LGMs) induces a posterior geometry prone to frustrate inference algorithms. Marginalizing out the latent Gaussian variable using an integrated Laplace approximation removes the…

Computation · Statistics 2023-06-28 Charles C. Margossian

Bayesian field theory denotes a nonparametric Bayesian approach for learning functions from observational data. Based on the principles of Bayesian statistics, a particular Bayesian field theory is defined by combining two models: a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

We examine the theoretical properties of enforcing priors provided by generative deep neural networks via empirical risk minimization. In particular we consider two models, one in which the task is to invert a generative neural network…

Information Theory · Computer Science 2018-12-27 Paul Hand , Vladislav Voroninski

Gaussian processes (GPs) defined through intrinsic random fields provide a flexible framework for modeling spatial phenomena, and have been advocated in a variety of applications over the past several decades. Nevertheless, their adoption…

Numerical Analysis · Mathematics 2026-05-19 Christopher Beattie , David Higdon , Leanna House , Colby Stakun-Pickering , Jared Clark

We challenge the longstanding assumption that the mean-field approximation for variational inference in Bayesian neural networks is severely restrictive, and show this is not the case in deep networks. We prove several results indicating…

Machine Learning · Computer Science 2021-03-11 Sebastian Farquhar , Lewis Smith , Yarin Gal

Nonlinear Mixed effects models are hidden variables models that are widely used in many fields such as pharmacometrics. In such models, the distribution characteristics of hidden variables can be specified by including several parameters…

Methodology · Statistics 2021-10-19 Edouard Ollier

Many problems in the geophysical sciences demand the ability to calibrate the parameters and predict the time evolution of complex dynamical models using sequentially-collected data. Here we introduce a general methodology for the joint…

Computation · Statistics 2018-12-12 Sara Pérez-Vieites , Inés P. Mariño , Joaquín Míguez