English
Related papers

Related papers: Hyperparameter Selection via Early Stopping for Ba…

200 papers

Modern regression analyses are often undermined by covariate measurement error, misspecification of the regression model, and misspecification of the measurement error distribution. We present, to the best of our knowledge, the first…

Methodology · Statistics 2026-03-25 Mengqi Chen , Charita Dellaporta , Thomas B. Berrett , Theodoros Damoulas

Recently, Deep Image Prior (DIP) has demonstrated strong capabilities for solving inverse imaging problems (IIPs) by optimizing a randomly initialized convolutional neural network in a training-data-free regime. However, DIP suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Chaoyan Huang , Cheng-Han Huang , Ismail R. Alkhouri , Rongrong Wang

When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the…

Methodology · Statistics 2020-05-13 Ilja Klebanov , Alexander Sikorski , Christof Schütte , Susanna Röblitz

Marginalization techniques are presented for the Bayesian filtering problem under the assumption of Gaussian priors and posteriors and a set of sequentially more constraining state space model assumptions. The techniques provide the…

Statistics Theory · Mathematics 2016-07-12 John-Olof Nilsson

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Bayesian inference offers a robust framework for updating prior beliefs based on new data using Bayes' theorem, but exact inference is often computationally infeasible, necessitating approximate methods. Though widely used, these methods…

Machine Learning · Statistics 2024-10-23 Xu-Hui Zhou , Zhuo-Ran Liu , Heng Xiao

We introduce a derivative-free computational framework for approximating solutions to nonlinear PDE-constrained inverse problems. The aim is to merge ideas from iterative regularization with ensemble Kalman methods from Bayesian inference…

Optimization and Control · Mathematics 2016-01-20 Marco A. Iglesias

Methods for solving scientific computing and inference problems, such as kernel- and neural network-based approaches for partial differential equations (PDEs), inverse problems, and supervised learning tasks, depend crucially on the choice…

Machine Learning · Statistics 2025-10-08 Nicholas H. Nelsen , Houman Owhadi , Andrew M. Stuart , Xianjin Yang , Zongren Zou

In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Dominik Narnhofer , Andreas Habring , Martin Holler , Thomas Pock

Inverse problems can be described as limited-data problems in which the signal of interest cannot be observed directly. A physics-based forward model that relates the signal with the observations is typically needed. Unfortunately, unknown…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Alexandra Koulouri , Ville Rimpilainen

Empirical Bayes inference is based on estimation of the parameters of an a priori distribution from the observed data. The estimation technique of the parameters of the prior, called hyperparameters, is based on the marginal distribution…

Systems and Control · Electrical Eng. & Systems 2025-11-06 Timofei Leahu , Giorgio Picci

Particle filtering is a Bayesian inference method and a fundamental tool in state estimation for dynamic systems, but its effectiveness is often limited by the constraints of the initial prior distribution, a phenomenon we define as the…

Machine Learning · Statistics 2025-01-31 Yiwei Shi , Jingyu Hu , Yu Zhang , Mengyue Yang , Weinan Zhang , Cunjia Liu , Weiru Liu

High dimensional vector autoregressive (VAR) models require a large number of parameters to be estimated and may suffer of inferential problems. We propose a new Bayesian nonparametric (BNP) Lasso prior (BNP-Lasso) for high-dimensional VAR…

Economics · Quantitative Finance 2018-10-30 Monica Billio , Roberto Casarin , Luca Rossini

The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace…

Numerical Analysis · Mathematics 2024-09-05 Zhiwei Gao , Liang Yan , Tao Zhou

We investigate the convergence rates of variational posterior distributions for statistical inverse problems involving nonlinear partial differential equations (PDEs). Departing from exact Bayesian inference, variational inference…

Statistics Theory · Mathematics 2026-02-10 Shaokang Zu , Junxiong Jia , Deyu Meng

We consider a system of semilinear partial differential equations (PDEs) with a nonlinearity depending on both the solution and its gradient. The Neumann boundary condition depends on the solution in a nonlinear manner. The uniform…

Probability · Mathematics 2022-01-14 Khaled Bahlali , Brahim Boufoussi , Soufiane Mouchtabih

This paper investigates an inverse source problem for general semilinear stochastic hyperbolic equations. Motivated by the challenges arising from both randomness and nonlinearity, we develop a globally convergent iterative regularization…

Analysis of PDEs · Mathematics 2025-04-25 Qi Lü , Yu Wang

Partial differential equations (PDEs) are important tools to model physical systems and including them into machine learning models is an important way of incorporating physical knowledge. Given any system of linear PDEs with constant…

Machine Learning · Statistics 2023-11-03 Marc Härkönen , Markus Lange-Hegermann , Bogdan Raiţă

We propose a new Bayesian strategy for adaptation to smoothness in nonparametric models based on heavy tailed series priors. We illustrate it in a variety of settings, showing in particular that the corresponding Bayesian posterior…

Statistics Theory · Mathematics 2024-05-30 Sergios Agapiou , Ismaël Castillo

In this article, we study the binary classification problem with supervised data, in the case where the covariate-to-probability-of-success map is possibly spatially inhomogeneous. We devise nonparametric Bayesian procedures with…

Statistics Theory · Mathematics 2025-09-10 Matteo Giordano