中文
相关论文

相关论文: Informed Spectral Normalized Gaussian Processes fo…

200 篇论文

A common theoretical approach to understanding neural networks is to take an infinite-width limit, at which point the outputs become Gaussian process (GP) distributed. This is known as a neural network Gaussian process (NNGP). However, the…

机器学习 · 统计学 2025-06-26 Ben Anson , Edward Milsom , Laurence Aitchison

Established techniques for simulation and prediction with Gaussian process (GP) dynamics often implicitly make use of an independence assumption on successive function evaluations of the dynamics model. This can result in significant error…

机器学习 · 计算机科学 2020-05-05 Lukas Hewing , Elena Arcari , Lukas P. Fröhlich , Melanie N. Zeilinger

Deep Gaussian processes (DGPs), a hierarchical composition of GP models, have successfully boosted the expressive power of their single-layer counterpart. However, it is impossible to perform exact inference in DGPs, which has motivated the…

机器学习 · 计算机科学 2021-05-27 Haibin Yu , Dapeng Liu , Yizhou Chen , Bryan Kian Hsiang Low , Patrick Jaillet

We develop a new method for regularising neural networks. We learn a probability distribution over the activations of all layers of the model and then insert imputed values into the network during training. We obtain a posterior for an…

机器学习 · 计算机科学 2019-10-14 Matthew Willetts , Alexander Camuto , Stephen Roberts , Chris Holmes

Deep Gaussian Processes (DGP) are hierarchical generalizations of Gaussian Processes (GP) that have proven to work effectively on a multiple supervised regression tasks. They combine the well calibrated uncertainty estimates of GPs with the…

Knowledge graph completion (KGC) can be framed as a 3-order binary tensor completion task. Tensor decomposition-based (TDB) models have demonstrated strong performance in KGC. In this paper, we provide a summary of existing TDB models and…

机器学习 · 计算机科学 2025-06-04 Changyi Xiao , Yixin Cao

Instrumental variable (IV) and proximal causal learning (Proxy) methods are central frameworks for causal inference in the presence of unobserved confounding. Despite substantial methodological advances, existing approaches rarely provide…

机器学习 · 统计学 2026-03-03 Yuqi Zhang , Krikamol Muandet , Dino Sejdinovic , Edwin Fong , Siu Lun Chau

Gaussian process (GP) priors are non-parametric generative models with appealing modelling properties for Bayesian inference: they can model non-linear relationships through noisy observations, have closed-form expressions for training and…

机器学习 · 统计学 2020-01-31 Gonzalo Rios

The successes of modern deep machine learning methods are founded on their ability to transform inputs across multiple layers to build good high-level representations. It is therefore critical to understand this process of representation…

机器学习 · 统计学 2023-05-26 Adam X. Yang , Maxime Robeyns , Edward Milsom , Ben Anson , Nandi Schoots , Laurence Aitchison

Terrain elevation modeling for off-road navigation aims to accurately estimate changes in terrain geometry in real-time and quantify the corresponding uncertainties. Having precise estimations and uncertainties plays a crucial role in…

机器人学 · 计算机科学 2025-08-11 Sanghun Jung , Daehoon Gwak , Byron Boots , James Hays

In the past years, predictive process monitoring (PPM) techniques based on artificial neural networks have evolved as a method to monitor the future behavior of business processes. Existing approaches mostly focus on interpreting the…

机器学习 · 计算机科学 2025-03-06 Attila Lischka , Simon Rauch , Oliver Stritzel

This paper presents a probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs). Our main contribution is a practical and principled combination of DNNs with sparse…

机器人学 · 计算机科学 2021-09-22 Jongseok Lee , Jianxiang Feng , Matthias Humt , Marcus G. Müller , Rudolph Triebel

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

机器学习 · 计算机科学 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Learning probability distributions on the weights of neural networks (NNs) has recently proven beneficial in many applications. Bayesian methods, such as Stein variational gradient descent (SVGD), offer an elegant framework to reason about…

机器学习 · 统计学 2018-04-03 Ruiyi Zhang , Chunyuan Li , Changyou Chen , Lawrence Carin

Recently, there has been an increasing interest in performing post-hoc uncertainty estimation about the predictions of pre-trained deep neural networks (DNNs). Given a pre-trained DNN via back-propagation, these methods enhance the original…

机器学习 · 计算机科学 2024-12-06 Luis A. Ortega , Simón Rodríguez-Santana , Daniel Hernández-Lobato

Gaussian Processes (GPs) are Bayesian models that provide uncertainty estimates associated to the predictions made. They are also very flexible due to their non-parametric nature. Nevertheless, GPs suffer from poor scalability as the number…

机器学习 · 计算机科学 2021-07-16 Bahram Jafrasteh , Carlos Villacampa-Calvo , Daniel Hernández-Lobato

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

机器学习 · 计算机科学 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Gaussian state space models have been used for decades as generative models of sequential data. They admit an intuitive probabilistic interpretation, have a simple functional form, and enjoy widespread adoption. We introduce a unified…

机器学习 · 统计学 2016-12-06 Rahul G. Krishnan , Uri Shalit , David Sontag

Skew-Gaussian processes (SkewGPs) extend the multivariate Unified Skew-Normal distributions over finite dimensional vectors to distribution over functions. SkewGPs are more general and flexible than Gaussian processes, as SkewGPs may also…

机器学习 · 统计学 2021-01-28 Alessio Benavoli , Dario Azzimonti , Dario Piga

The recently developed semi-parametric generalized linear model (SPGLM) offers more flexibility as compared to the classical GLM by including the baseline or reference distribution of the response as an additional parameter in the model.…

统计方法学 · 统计学 2024-04-09 Entejar Alam , Peter Müller , Paul J. Rathouz