English
Related papers

Related papers: Deep learning with differential Gaussian process f…

200 papers

Direct quantile regression involves estimating a given quantile of a response variable as a function of input variables. We present a new framework for direct quantile regression where a Gaussian process model is learned, minimising the…

Methodology · Statistics 2012-07-03 Alexis Boukouvalas , Remi Barillec , Dan Cornford

Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior,…

Machine Learning · Computer Science 2023-06-07 Paul E. Chang , Prakhar Verma , S. T. John , Arno Solin , Mohammad Emtiyaz Khan

Despite significant recent advances in probabilistic meta-learning, it is common for practitioners to avoid using deep learning models due to a comparative lack of interpretability. Instead, many practitioners simply use non-meta-models…

Machine Learning · Statistics 2025-04-25 Tommy Rochussen , Vincent Fortuin

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

Machine Learning · Statistics 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

Recent years have witnessed an increasing interest in the correspondence between infinitely wide networks and Gaussian processes. Despite the effectiveness and elegance of the current neural network Gaussian process theory, to the best of…

Machine Learning · Computer Science 2022-07-06 Shao-Qun Zhang , Fei Wang , Feng-Lei Fan

We build on the dynamical systems approach to deep learning, where deep residual networks are idealized as continuous-time dynamical systems, from the approximation perspective. In particular, we establish general sufficient conditions for…

Machine Learning · Computer Science 2020-06-09 Qianxiao Li , Ting Lin , Zuowei Shen

In this work, we employ the Bayesian inference framework to solve the problem of estimating the solution and particularly, its derivatives, which satisfy a known differential equation, from the given noisy and scarce observations of the…

Computation · Statistics 2020-10-09 Hongqiao Wang , Xiang Zhou

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen

We propose a learning paradigm for the numerical approximation of differential invariants of planar curves. Deep neural-networks' (DNNs) universal approximation properties are utilized to estimate geometric measures. The proposed framework…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Roy Velich , Ron Kimmel

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

This paper introduces Gauge Flow Models, a novel class of Generative Flow Models. These models incorporate a learnable Gauge Field within the Flow Ordinary Differential Equation (ODE). A comprehensive mathematical framework for these…

Machine Learning · Computer Science 2026-03-04 Alexander Strunk , Roland Assam

We undertake Bayesian learning of the high-dimensional functional relationship between a system parameter vector and an observable, that is in general tensor-valued. The ultimate aim is Bayesian inverse prediction of the system parameters,…

Methodology · Statistics 2018-04-17 Kangrui Wang , Dalia Chakrabarty

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

Machine Learning · Computer Science 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

We introduce fully scalable Gaussian processes, an implementation scheme that tackles the problem of treating a high number of training instances together with high dimensional input data. Our key idea is a representation trick over the…

Machine Learning · Statistics 2018-07-16 Aristeidis Panos , Petros Dellaportas , Michalis K. Titsias

Computing accurate estimates of the Fourier transform of analog signals from discrete data points is important in many fields of science and engineering. The conventional approach of performing the discrete Fourier transform of the data…

Machine Learning · Statistics 2017-12-08 Luca Ambrogioni , Eric Maris

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

Parameter identification and comparison of dynamical systems is a challenging task in many fields. Bayesian approaches based on Gaussian process regression over time-series data have been successfully applied to infer the parameters of a…

Machine Learning · Statistics 2019-03-04 Philippe Wenk , Alkis Gotovos , Stefan Bauer , Nico Gorbach , Andreas Krause , Joachim M. Buhmann

Learning mappings between functional spaces, also known as function-on-function regression, is a fundamental problem in functional data analysis with broad applications, including spatiotemporal forecasting, curve prediction, and climate…

Machine Learning · Computer Science 2026-04-07 Matthew Lowery , Zhitong Xu , Da Long , Keyan Chen , Daniel S. Johnson , Yang Bai , Varun Shankar , Shandian Zhe

Accuracy and generalization capabilities are key objectives when learning dynamical system models. To obtain such models from limited data, current works exploit prior knowledge and assumptions about the system. However, the fusion of…

Machine Learning · Statistics 2025-08-22 Björn Volkmann , Jan-Hendrik Ewering , Michael Meindl , Simon F. G. Ehlers , Thomas Seel