English
Related papers

Related papers: Prequential posteriors

200 papers

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

This paper proposes a new framework to regularize the highly ill-posed and non-linear phase retrieval problem through deep generative priors using simple gradient descent algorithm. We experimentally show effectiveness of proposed algorithm…

Machine Learning · Computer Science 2018-08-20 Fahad Shamshad , Ali Ahmed

Robust Bayesian inference using density power divergence (DPD) has emerged as a promising approach for handling outliers in statistical estimation. Although the DPD-based posterior offers theoretical guarantees of robustness, its practical…

Methodology · Statistics 2025-12-11 Naruki Sonobe , Tomotaka Momozaki , Tomoyuki Nakagawa

We develop deep Poisson-gamma dynamical systems (DPGDS) to model sequentially observed multivariate count data, improving previously proposed models by not only mining deep hierarchical latent structure from the data, but also capturing…

Machine Learning · Statistics 2019-01-03 Dandan Guo , Bo Chen , Hao Zhang , Mingyuan Zhou

Climate change is intensifying rainfall extremes, making high-resolution precipitation projections crucial for society to better prepare for impacts such as flooding. However, current Global Climate Models (GCMs) operate at spatial…

Machine Learning · Computer Science 2024-12-20 Ran Lyu , Linhan Wang , Yanshen Sun , Hedanqiu Bai , Chang-Tien Lu

Shallow water equations are extensively considered in the domains of oceans, atmospheric modelling, and engineering research (Franca et al., 2022), which play significant roles in floods and tsunami governance. Nonetheless, the accurate…

Fluid Dynamics · Physics 2023-09-22 Ruijia Yu

Modern generative models can produce realistic samples, however, balancing memorisation and generalisation remains an open problem. We approach this challenge from a Bayesian perspective by focusing on the parameter space of flow matching…

Estimating the predictive uncertainty of a Bayesian learning model is critical in various decision-making problems, e.g., reinforcement learning, detecting adversarial attack, self-driving car. As the model posterior is almost always…

Machine Learning · Computer Science 2021-02-16 Yufei Cui , Wuguannan Yao , Qiao Li , Antoni B. Chan , Chun Jason Xue

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston

Modern applications routinely collect high-dimensional data, leading to statistical models having more parameters than there are samples available. A common solution is to impose sparsity in parameter estimation, often using penalized…

Methodology · Statistics 2025-07-08 Paolo Onorati , David B. Dunson , Antonio Canale

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

Data assimilation addresses the general problem of how to combine model-based predictions with partial and noisy observations of the process in an optimal manner. This survey focuses on sequential data assimilation techniques using…

Numerical Analysis · Mathematics 2019-08-15 Sebastian Reich

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

Machine Learning · Statistics 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite depths. However, existing DiffGP approaches often overlook the…

Machine Learning · Computer Science 2025-12-16 Jian Xu , Zhiqi Lin , Min Chen , Junmei Yang , Delu Zeng , John Paisley

Some machine learning applications require continual learning - where data comes in a sequence of datasets, each is used for training and then permanently discarded. From a Bayesian perspective, continual learning seems straightforward:…

Machine Learning · Statistics 2019-02-19 Sebastian Farquhar , Yarin Gal

We consider the accuracy of an approximate posterior distribution in nonparametric regression problems by combining posterior distributions computed on subsets of the data defined by the locations of the independent variables. We show that…

Statistics Theory · Mathematics 2025-04-29 Botond Szabo , Amine Hadji , Aad van der Vaart

Time series forecasting is crucial for many fields, such as disaster warning, weather prediction, and energy consumption. The Transformer-based models are considered to have revolutionized the field of sequence modeling. However, the…

Machine Learning · Computer Science 2022-11-01 Junlong Tong , Liping Xie , Wankou Yang , Kanjian Zhang

The random dot product graph is a popular model for network data with extensions that accommodate dynamic (time-varying) networks. However, two significant deficiencies exist in the dynamic random dot product graph literature: (1) no…

Methodology · Statistics 2025-09-25 Joshua Daniel Loyal

Data assimilation is a technique for increasing the accuracy of simulations of solutions to partial differential equations by incorporating observable data into the solution as time evolves. Recently, a promising new algorithm for data…

Analysis of PDEs · Mathematics 2018-12-06 Adam Larios , Collin Victor

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam