中文
相关论文

相关论文: Deep Variational Implicit Processes

200 篇论文

Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables…

机器学习 · 统计学 2019-05-15 Hugh Salimbeni , Vincent Dutordoir , James Hensman , Marc Peter Deisenroth

Motivated by deep neural networks, the deep Gaussian process (DGP) generalizes the standard GP by stacking multiple layers of GPs. Despite the enhanced expressiveness, GP, as an $L_2$ regularization prior, tends to be over-smooth and…

机器学习 · 统计学 2024-10-30 Zhi Chang , Chukwudi Obite , Shuang Zhou , Shiwei Lan

Pursuing training-free open-vocabulary semantic segmentation in an efficient and generalizable manner remains challenging due to the deep-seated spatial bias in CLIP. To overcome the limitations of existing solutions, this work moves beyond…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Hao Zhu , Shuo Jin , Wenbin Liao , Jiayu Xiao , Yan Zhu , Siyue Yu , Feng Dai

Modern deep learning models have achieved great success in predictive accuracy for many data modalities. However, their application to many real-world tasks is restricted by poor uncertainty estimates, such as overconfidence on…

机器学习 · 统计学 2020-10-16 Ben Adlam , Jaehoon Lee , Lechao Xiao , Jeffrey Pennington , Jasper Snoek

Implicit probabilistic models are a flexible class of models defined by a simulation process for data. They form the basis for theories which encompass our understanding of the physical world. Despite this fundamental nature, the use of…

机器学习 · 统计学 2017-11-07 Dustin Tran , Rajesh Ranganath , David M. Blei

Gaussian process regression is widely used because of its ability to provide well-calibrated uncertainty estimates and handle small or sparse datasets. However, it struggles with high-dimensional data. One possible way to scale this…

机器学习 · 统计学 2024-02-02 Bernardo Fichera , Viacheslav Borovitskiy , Andreas Krause , Aude Billard

Model selection in machine learning (ML) is a crucial part of the Bayesian learning procedure. Model choice may impose strong biases on the resulting predictions, which can hinder the performance of methods such as Bayesian neural networks…

Deep Gaussian processes (DGPs) enable expressive hierarchical Bayesian modeling but pose substantial challenges for posterior inference, especially over inducing variables. Denoising diffusion variational inference (DDVI) addresses this by…

机器学习 · 计算机科学 2026-02-13 Jian Xu , Qibin Zhao , John Paisley , Delu Zeng

Missing values are common in many real-life datasets. However, most of the current machine learning methods can not handle missing values. This means that they should be imputed beforehand. Gaussian Processes (GPs) are non-parametric models…

Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at $n$ points in $d$…

机器学习 · 计算机科学 2018-10-30 David Eriksson , Kun Dong , Eric Hans Lee , David Bindel , Andrew Gordon Wilson

Gaussian process (GP) models provide a powerful tool for prediction but are computationally prohibitive using large data sets. In such scenarios, one has to resort to approximate methods. We derive an approximation based on a composite…

机器学习 · 统计学 2018-02-02 Xiuming Liu , Dave Zachariah , Edith C. H. Ngai

Neural networks have become a prominent approach to solve inverse problems in recent years. Amongst the different existing methods, the Deep Image/Inverse Priors (DIPs) technique is an unsupervised approach that optimizes a highly…

机器学习 · 计算机科学 2023-03-21 Nathan Buskulic , Yvain Quéau , Jalal Fadili

Gaussian processes (GPs) are popular nonparametric statistical models for learning unknown functions and quantifying the spatiotemporal uncertainty in data. Recent works have extended GPs to model scalar and vector quantities distributed…

Modeling sequential data has become more and more important in practice. Some applications are autonomous driving, virtual sensors and weather forecasting. To model such systems so called recurrent models are used. In this article we…

机器学习 · 统计学 2017-11-21 Roman Föll , Bernard Haasdonk , Markus Hanselmann , Holger Ulmer

Gaussian processes (GPs) are typically criticised for their unfavourable scaling in both computational and memory requirements. For large datasets, sparse GPs reduce these demands by conditioning on a small set of inducing variables…

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

机器学习 · 计算机科学 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

机器学习 · 计算机科学 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

Out-of-distribution (OOD) generalization has long been a challenging problem that remains largely unsolved. Gaussian processes (GP), as popular probabilistic model classes, especially in the small data regime, presume strong OOD…

机器学习 · 计算机科学 2023-12-19 Xilong Zhao , Siyuan Bian , Yaoyun Zhang , Yuliang Zhang , Qinying Gu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

Deep Gaussian processes (DGP) have appealing Bayesian properties, can handle variable-sized data, and learn deep features. Their limitation is that they do not scale well with the size of the data. Existing approaches address this using a…

机器学习 · 计算机科学 2019-05-20 Issam H. Laradji , Mark Schmidt , Vladimir Pavlovic , Minyoung Kim

Variable selection in Gaussian processes (GPs) is typically undertaken by thresholding the inverse lengthscales of automatic relevance determination kernels, but in high-dimensional datasets this approach can be unreliable. A more…

机器学习 · 统计学 2022-02-25 Hugh Dance , Brooks Paige