English
Related papers

Related papers: Rethinking Approximate Gaussian Inference in Class…

200 papers

In this letter, we present a novel Gaussian Process Learning-based Probabilistic Optimal Power Flow (GP-POPF) for solving POPF under renewable and load uncertainties of arbitrary distribution. The proposed method relies on a non-parametric…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Parikshit Pareek , Hung D. Nguyen

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Conformal prediction is a distribution-free framework for uncertainty quantification that replaces point predictions with sets, offering marginal coverage guarantees (i.e., ensuring that the prediction sets contain the true label with a…

Machine Learning · Computer Science 2025-02-25 Margarida M. Campos , João Calém , Sophia Sklaviadis , Mário A. T. Figueiredo , André F. T. Martins

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Due to their flexibility, Gaussian processes (GPs) have been widely used in nonparametric function estimation. A prior information about the underlying function is often available. For instance, the physical system (computer model output)…

Methodology · Statistics 2017-11-21 Hassan Maatouk

Bayesian inference on non-Gaussian data is often non-analytic and requires computationally expensive approximations such as sampling or variational inference. We propose an approximate inference framework primarily designed to be…

Machine Learning · Computer Science 2022-10-12 Marius Hobbhahn , Philipp Hennig

Fitting a theoretical model to experimental data in a Bayesian manner using Markov chain Monte Carlo typically requires one to evaluate the model thousands (or millions) of times. When the model is a slow-to-compute physics simulation,…

Machine Learning · Statistics 2022-08-25 Steven Stetzler , Michael Grosskopf , Earl Lawrence

This article presents an approach to Bayesian semiparametric inference for Gaussian multivariate response regression. We are motivated by various small and medium dimensional problems from the physical and social sciences. The statistical…

Methodology · Statistics 2020-06-18 Georgios Papageorgiou , Benjamin C. Marshall

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an…

Data Analysis, Statistics and Probability · Physics 2008-02-03 Radford M. Neal

The Gumbel-Softmax is a continuous distribution over the simplex that is often used as a relaxation of discrete distributions. Because it can be readily interpreted and easily reparameterized, it enjoys widespread use. We propose a modular…

Machine Learning · Statistics 2022-08-30 Andres Potapczynski , Gabriel Loaiza-Ganem , John P. Cunningham

The softmax function is widely used in artificial neural networks for the multiclass classification problems, where the softmax transformation enforces the output to be positive and sum to one, and the corresponding loss function allows to…

Machine Learning · Computer Science 2021-12-24 Shaoshi Sun , Zhenyuan Zhang , BoCheng Huang , Pengbin Lei , Jianlin Su , Shengfeng Pan , Jiarun Cao

The problem of efficient approximation of a linear operator induced by the Gaussian or softmax kernel is often addressed using random features (RFs) which yield an unbiased approximation of the operator's result. Such operators emerge in…

Machine Learning · Computer Science 2023-02-03 Valerii Likhosherstov , Krzysztof Choromanski , Avinava Dubey , Frederick Liu , Tamas Sarlos , Adrian Weller

Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that…

Machine Learning · Statistics 2018-11-13 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

Learning with noisy labels can significantly hinder the generalization performance of deep neural networks (DNNs). Existing approaches address this issue through loss correction or example selection methods. However, these methods often…

Machine Learning · Computer Science 2024-06-05 Chen-Chen Zong , Ye-Wen Wang , Ming-Kun Xie , Sheng-Jun Huang

We propose a method for finding a cumulative distribution function (cdf) that minimizes the distance to a given cdf, while belonging to an ambiguity set constructed relative to another cdf and, possibly, incorporating soft information. Our…

Optimization and Control · Mathematics 2024-08-23 Julio Deride , Johannes O. Royset , Fernanda Urrea

This paper introduces a new method for performing computational inference on log-Gaussian Cox processes. The likelihood is approximated directly by making novel use of a continuously specified Gaussian random field. We show that for…

Computation · Statistics 2015-11-02 Daniel Simpson , Janine Illian , Finn Lindgren , Sigrunn Sørbye , Håvard Rue

We consider the problem of active learning for global sensitivity analysis of expensive black-box functions. Our aim is to efficiently learn the importance of different input variables, e.g., in vehicle safety experimentation, we study the…

Machine Learning · Computer Science 2024-10-22 Syrine Belakaria , Benjamin Letham , Janardhan Rao Doppa , Barbara Engelhardt , Stefano Ermon , Eytan Bakshy

Approximate inference in probabilistic graphical models (PGMs) can be grouped into deterministic methods and Monte-Carlo-based methods. The former can often provide accurate and rapid inferences, but are typically associated with biases…

Machine Learning · Statistics 2019-01-09 Fredrik Lindsten , Jouni Helske , Matti Vihola

In this paper we develop non-asymptotic Gaussian approximation results for the sampling distribution of suprema of empirical processes when the indexing function class $\mathcal{F}_n$ varies with the sample size $n$ and may not be Donsker.…

Statistics Theory · Mathematics 2023-09-06 Alexander Giessing

Diffusion probabilistic models have generated high quality image synthesis recently. However, one pain point is the notorious inference to gradually obtain clear images with thousands of steps, which is time consuming compared to other…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Gang Chen