English
Related papers

Related papers: Constructing Priors that Penalize the Complexity o…

200 papers

Effectively modeling non-stationary dynamics in probabilistic multivariate time series(MTS) forecasting requires balancing expressiveness with robustness. Existing parametric approaches benefit from strong inductive biases but lack…

Machine Learning · Computer Science 2026-05-25 Jinglin Li , Jun Tan , QI Fang , Ning Gui

In the literature surrounding Bayesian penalized regression, the two primary choices of prior distribution on the regression coefficients are zero-mean Gaussian and Laplace. While both have been compared numerically and theoretically, there…

Methodology · Statistics 2010-01-26 Luke Bornn , Raphael Gottardo , Arnaud Doucet

Bayesian parameter inference depends on a choice of prior probability distribution for the parameters in question. The prior which makes the posterior distribution maximally sensitive to data is called the Jeffreys prior, and it is…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-25 Steen Hannestad , Thomas Tram

Deep generative modeling has led to new and state of the art approaches for enforcing structural priors in a variety of inverse problems. In contrast to priors given by sparsity, deep models can provide direct low-dimensional…

Optimization and Control · Mathematics 2018-12-12 Wen Huang , Paul Hand , Reinhard Heckel , Vladislav Voroninski

In this paper we propose a prior distribution for the clique set and dependence structure of binary Markov random fields (MRFs). In the formulation we allow both pairwise and higher order interactions. We construct the prior by first…

Methodology · Statistics 2015-01-27 Petter Arnesen , Håkon Tjelmeland

Machine learning methods on graphs have proven useful in many applications due to their ability to handle generally structured data. The framework of Gaussian Markov Random Fields (GMRFs) provides a principled way to define Gaussian models…

Machine Learning · Statistics 2022-06-13 Joel Oskarsson , Per Sidén , Fredrik Lindsten

Many inverse problems arising in applications come from continuum models where the unknown parameter is a field. In practice the unknown field is discretized resulting in a problem in $\mathbb{R}^N$, with an understanding that refining the…

Statistics Theory · Mathematics 2014-07-16 Sergios Agapiou , Johnathan M. Bardsley , Omiros Papaspiliopoulos , Andrew M. Stuart

Many problems in robotics involve both continuous and discrete components, and modeling them together for estimation tasks has been a long standing and difficult problem. Hybrid Factor Graphs give us a mathematical framework to model these…

Robotics · Computer Science 2026-05-04 Varun Agrawal , Frank Dellaert

In this paper a new approach for constructing \emph{multivariate} Gaussian random fields (GRFs) using systems of stochastic partial differential equations (SPDEs) has been introduced and applied to simulated data and real data. By solving a…

Methodology · Statistics 2013-07-08 Xiangping Hu , Daniel Simpson , Finn Lindgren , Håvard Rue

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Learning in Gaussian Process models occurs through the adaptation of hyperparameters of the mean and the covariance function. The classical approach entails maximizing the marginal likelihood yielding fixed point estimates (an approach…

Machine Learning · Statistics 2020-04-07 Vidhi Lalchand , Carl Edward Rasmussen

Sparse variational Gaussian processes (GPs) construct tractable posterior approximations to GP models. At the core of these methods is the assumption that the true posterior distribution over training function values ${\bf f}$ and inducing…

Machine Learning · Computer Science 2025-06-27 Michalis K. Titsias

Although recent provable methods have been developed to compute preimage bounds for neural networks, their scalability is fundamentally limited by the #P-hardness of the problem. In this work, we adopt a novel probabilistic perspective,…

Machine Learning · Computer Science 2025-11-18 Luca Marzari , Manuele Bicego , Ferdinando Cicalese , Alessandro Farinelli

In this paper, we present a comprehensive analysis of the posterior covariance field in Gaussian processes, with applications to the posterior covariance matrix. The analysis is based on the Gaussian prior covariance but the approach also…

Machine Learning · Statistics 2025-04-03 Difeng Cai , Edmond Chow , Yuanzhe Xi

We introduce the concept of conjugate prior models for a given likelihood function in Bayesian spatial inversion. The conjugate class of prior models can be selection extended and still remain conjugate. We demonstrate the generality of…

Methodology · Statistics 2018-12-06 Henning Omre , Kjartan Rimstad

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

Mixture regression models are powerful tools for capturing heterogeneous covariate-response relationships, yet classical finite mixtures and Bayesian nonparametric alternatives often suffer from instability or overestimation of clusters…

Methodology · Statistics 2025-12-19 Yuta Hayashida , Shonosuke Sugasawa

Generative Bayesian Filtering (GBF) provides a powerful and flexible framework for performing posterior inference in complex nonlinear and non-Gaussian state-space models. Our approach extends Generative Bayesian Computation (GBC) to…

Methodology · Statistics 2025-11-07 Edoardo Marcelli , Sean O'Hagan , Veronika Rockova

While frame-independent predictions with deep neural networks have become the prominent solutions to many computer vision tasks, the potential benefits of utilizing correlations between frames have received less attention. Even though…

Machine Learning · Statistics 2021-03-05 Yuxin Hou , Ari Heljakka , Arno Solin

We present an iterative framework to improve the amortized approximations of posterior distributions in the context of Bayesian inverse problems, which is inspired by loop-unrolled gradient descent methods and is theoretically grounded in…

Machine Learning · Computer Science 2023-05-16 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann
‹ Prev 1 3 4 5 6 7 10 Next ›