中文
相关论文

相关论文: Loss function based second-order Jensen inequality…

200 篇论文

A reward-guided, gradient-free ParVI method, \textit{R-ParVI}, is proposed for sampling partially known densities (e.g. up to a constant). R-ParVI formulates the sampling problem as particle flow driven by rewards: particles are drawn from…

人工智能 · 计算机科学 2025-03-03 Yongchao Huang

Selecting powerful predictors for an outcome is a cornerstone task for machine learning. However, some types of questions can only be answered by identifying the predictors that causally affect the outcome. A recent approach to this causal…

机器学习 · 计算机科学 2022-03-01 Guillaume Martinet , Alexander Strzalkowski , Barbara E. Engelhardt

Variational inference is an umbrella term for algorithms which cast Bayesian inference as optimization. Classically, variational inference uses the Kullback-Leibler divergence to define the optimization. Though this divergence has been…

机器学习 · 统计学 2018-03-16 Rajesh Ranganath , Jaan Altosaar , Dustin Tran , David M. Blei

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

机器学习 · 计算机科学 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

Predictive Bayesian inference (PBI) represents a model-and prior-agnostic approach to standard Bayesian inference which allows users to quantify uncertainty for a functional of interest only by specifying a forward predictive model for…

统计方法学 · 统计学 2026-05-04 David T. Frazier , Hui Wang

Bayesian inference provides a principled probabilistic framework for quantifying uncertainty by updating beliefs based on prior knowledge and observed data through Bayes' theorem. In Bayesian deep learning, neural network weights are…

机器学习 · 计算机科学 2024-10-22 Yijie Zhang

In the Bayesian approach, the a priori knowledge about the input of a mathematical model is described via a probability measure. The joint distribution of the unknown input and the data is then conditioned, using Bayes' formula, giving rise…

统计理论 · 数学 2015-06-15 Sebastian J. Vollmer

We propose an approach based on function evaluations and Bayesian inference to extract higher-order differential information of objective functions {from a given ensemble of particles}. Pointwise evaluation $\{V(x^i)\}_i$ of some potential…

机器学习 · 统计学 2023-03-02 Claudia Schillings , Claudia Totzeck , Philipp Wacker

We provide two main contributions in PAC-Bayesian theory for domain adaptation where the objective is to learn, from a source distribution, a well-performing majority vote on a different, but related, target distribution. Firstly, we…

机器学习 · 统计学 2019-11-19 Pascal Germain , Amaury Habrard , François Laviolette , Emilie Morvant

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

统计方法学 · 统计学 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

A new class of general exponential ranking models is introduced which we label angle-based models for ranking data. A consensus score vector is assumed, which assigns scores to a set of items, where the scores reflect a consensus view of…

统计方法学 · 统计学 2017-12-27 Hang Xu , Mayer Alvo , Philip L. H. Yu

We introduce a new method for learning Bayesian neural networks, treating them as a stack of multivariate Bayesian linear regression models. The main idea is to infer the layerwise posterior exactly if we know the target outputs of each…

机器学习 · 计算机科学 2024-11-20 Richard Kurle , Alexej Klushyn , Ralf Herbrich

Particle-based variational inference methods (ParVIs) have gained attention in the Bayesian inference literature, for their capacity to yield flexible and accurate approximations. We explore ParVIs from the perspective of Wasserstein…

机器学习 · 统计学 2019-07-17 Chang Liu , Jingwei Zhuo , Pengyu Cheng , Ruiyi Zhang , Jun Zhu , Lawrence Carin

Ordinary differential equations (ODEs) are used to model dynamic systems appearing in engineering, physics, biomedical sciences and many other fields. These equations contain unknown parameters, say $\theta$ of physical significance which…

统计理论 · 数学 2014-03-05 Prithwish Bhaumik , Subhashis Ghosal

Variational inference (VI) is a method to approximate the computationally intractable posterior distributions that arise in Bayesian statistics. Typically, VI fits a simple parametric distribution to the target posterior by minimizing an…

机器学习 · 统计学 2023-07-18 Chirag Modi , Charles Margossian , Yuling Yao , Robert Gower , David Blei , Lawrence Saul

We present a novel Bayesian framework for inverse problems in which the pos terior distribution is interpreted as the intensity measure of a Poisson point process (PPP). The posterior density is approximated using kernel density estimation,…

数值分析 · 数学 2025-10-08 Zhiliang Deng , Zhiyuan Wang , Xiaomei Yang , Xiaofei Guan

In order to increase the effectiveness of model training, data reduction is essential to data-centric Artificial Intelligence (AI). It achieves this by locating the most instructive examples in massive datasets. To increase data quality and…

机器学习 · 计算机科学 2025-08-11 Fei Chen , Wenchi Zhou

We propose a Bayesian approach for recursively estimating the classifier weights in online learning of a classifier ensemble. In contrast with past methods, such as stochastic gradient descent or online boosting, our approach estimates the…

机器学习 · 计算机科学 2015-07-09 Qinxun Bai , Henry Lam , Stan Sclaroff

We propose a novel adaptive importance sampling scheme for Bayesian inversion problems where the inference of the variables of interest and the power of the data noise is split. More specifically, we consider a Bayesian analysis for the…

统计计算 · 统计学 2021-07-27 L. Martino , F. Llorente , E. Curbelo , J. Lopez-Santiago , J. Miguez

Given observed data and a probabilistic generative model, Bayesian inference searches for the distribution of the model's parameters that could have yielded the data. Inference is challenging for large population studies where millions of…

机器学习 · 统计学 2023-08-31 Louis Rouillard , Alexandre Le Bris , Thomas Moreau , Demian Wassermann