English
Related papers

Related papers: Batch learning equals online learning in Bayesian …

200 papers

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the…

Machine Learning · Computer Science 2014-11-06 Diederik P. Kingma , Danilo J. Rezende , Shakir Mohamed , Max Welling

The paper presents a Bayesian framework for the calibration of financial models using neural stochastic differential equations (neural SDEs), for which we also formulate a global universal approximation theorem based on Barron-type…

Computational Finance · Quantitative Finance 2026-05-12 Christa Cuchiero , Eva Flonner , Kevin Kurt

The goal of this paper is to show how different machine learning tools on the Riemannian manifold $\mathcal{P}_d$ of Symmetric Positive Definite (SPD) matrices can be united under a probabilistic framework. For this, we will need several…

Machine Learning · Computer Science 2025-11-04 Thibault de Surrel , Florian Yger , Fabien Lotte , Sylvain Chevallier

Prompt learning has emerged as an effective technique for fine-tuning large-scale foundation models for downstream tasks. However, conventional prompt learning methods are prone to overfitting and can struggle with out-of-distribution…

Score-based diffusion models have recently been extended to infinite-dimensional function spaces, with uses such as inverse problems arising from partial differential equations. In the Bayesian formulation of inverse problems, the aim is to…

Machine Learning · Computer Science 2026-05-12 Elizabeth L. Baker , Alexander Denker , Jes Frellsen

Bayesian inversion generates a posterior distribution of model parameters from an observation equation and prior information both weighted by hyperparameters. The prior is also introduced for the hyperparameters in fully Bayesian inversions…

Geophysics · Physics 2022-07-20 Dye SK Sato , Yukitoshi Fukahata , Yohei Nozue

Bayesian network structure learning is often performed in a Bayesian setting, by evaluating candidate structures using their posterior probabilities for a given data set. Score-based algorithms then use those posterior probabilities as an…

Machine Learning · Statistics 2017-03-14 Marco Scutari

This paper investigates the supervised learning problem with observations drawn from certain general stationary stochastic processes. Here by \emph{general}, we mean that many stationary stochastic processes can be included. We show that…

Machine Learning · Statistics 2016-05-11 Hanyuan Hang , Yunlong Feng , Ingo Steinwart , Johan A. K. Suykens

Inverse problems arise anywhere we have indirect measurement. As, in general they are ill-posed, to obtain satisfactory solutions for them needs prior knowledge. Classically, different regularization methods and Bayesian inference based…

Machine Learning · Statistics 2023-08-31 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

The posterior over Bayesian neural network (BNN) parameters is extremely high-dimensional and non-convex. For computational reasons, researchers approximate this posterior using inexpensive mini-batch methods such as mean-field variational…

Machine Learning · Computer Science 2021-04-30 Pavel Izmailov , Sharad Vikram , Matthew D. Hoffman , Andrew Gordon Wilson

A fully Bayesian treatment of complicated predictive models (such as deep neural networks) would enable rigorous uncertainty quantification and the automation of higher-level tasks including model selection. However, the intractability of…

Machine Learning often involves various imprecise labels, leading to diverse weakly supervised settings. While recent methods aim for universal handling, they usually suffer from complex manual pre-work, ignore the relationships between…

Machine Learning · Computer Science 2026-03-03 Ziquan Wang , Haobo Wang , Ke Chen , Lei Feng , Gang Chen

Bayesian inference provides a principled probabilistic framework for quantifying uncertainty by updating beliefs based on prior knowledge and observed data through Bayes' theorem. In Bayesian deep learning, neural network weights are…

Machine Learning · Computer Science 2024-10-22 Yijie Zhang

The methodology developed in this article is motivated by a wide range of prediction and uncertainty quantification problems that arise in Statistics, Machine Learning and Applied Mathematics, such as non-parametric regression, multi-class…

Methodology · Statistics 2019-03-26 Victor Chen , Matthew M. Dunlop , Omiros Papaspiliopoulos , Andrew M. Stuart

One of the main research areas in Bayesian Nonparametrics is the proposal and study of priors which generalize the Dirichlet process. Here we exploit theoretical properties of Poisson random measures in order to provide a comprehensive…

Statistics Theory · Mathematics 2007-06-13 Lancelot F. James , Antonio Lijoi , Igor Pruenster

This work proposes a Bayesian inference method for the reduced-order modeling of time-dependent systems. Informed by the structure of the governing equations, the task of learning a reduced-order model from data is posed as a Bayesian…

Numerical Analysis · Mathematics 2023-01-18 Mengwu Guo , Shane A. McQuarrie , Karen E. Willcox

Domain generalization is challenging due to the domain shift and the uncertainty caused by the inaccessibility of target domain data. In this paper, we address both challenges with a probabilistic framework based on variational Bayesian…

Machine Learning · Computer Science 2021-07-16 Zehao Xiao , Jiayi Shen , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

Machine Learning · Statistics 2025-12-03 Ali Alvandi , Mina Rezaei

Contrastive learning has become a key component of self-supervised learning approaches for graph-structured data. Despite their success, existing graph contrastive learning methods are incapable of uncertainty quantification for node…