English
Related papers

Related papers: Fast Kernel Approximations for Latent Force Models…

200 papers

Physically-inspired latent force models offer an interpretable alternative to purely data driven tools for inference in dynamical systems. They carry the structure of differential equations and the flexibility of Gaussian processes,…

Machine Learning · Computer Science 2022-01-25 Jacob D. Moss , Felix L. Opolka , Bianca Dumitrascu , Pietro Lió

Purely data driven approaches for machine learning present difficulties when data is scarce relative to the complexity of the model or when the model is forced to extrapolate. On the other hand, purely mechanistic approaches need to…

Machine Learning · Statistics 2020-03-16 Mauricio A. Álvarez , David Luengo , Neil D. Lawrence

Modelling the behaviour of highly nonlinear dynamical systems with robust uncertainty quantification is a challenging task which typically requires approaches specifically designed to address the problem at hand. We introduce a…

Machine Learning · Statistics 2024-01-25 Thomas Baldwin-McDonald , Mauricio A. Álvarez

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

Computation · Statistics 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

This work considers estimation and forecasting in a multivariate, possibly high-dimensional count time series model constructed from a transformation of a latent Gaussian dynamic factor series. The estimation of the latent model parameters…

Methodology · Statistics 2025-04-07 Younghoon Kim , Marie-Christine Düker , Zachary F. Fisher , Vladas Pipiras

Variational autoencoders often assume isotropic Gaussian priors and mean-field posteriors, hence do not exploit structure in scenarios where we may expect similarity or consistency across latent variables. Gaussian process variational…

Machine Learning · Statistics 2020-11-17 Metod Jazbec , Michael Pearce , Vincent Fortuin

We introduce a Fourier-based fast algorithm for Gaussian process regression in low dimensions. It approximates a translationally-invariant covariance kernel by complex exponentials on an equispaced Cartesian frequency grid of $M$ nodes.…

Computation · Statistics 2023-05-19 Philip Greengard , Manas Rachh , Alex Barnett

Latent force models are a class of hybrid models for dynamic systems, combining simple mechanistic models with flexible Gaussian process (GP) perturbations. An extension of this framework to include multiplicative interactions between the…

Machine Learning · Statistics 2019-01-01 Daniel J. Tait , Bruce J. Worton

Interest in multioutput kernel methods is increasing, whether under the guise of multitask learning, multisensor networks or structured output data. From the Gaussian process perspective a multioutput Mercer kernel is a covariance function…

Machine Learning · Statistics 2009-12-18 Mauricio A. Álvarez , David Luengo , Michalis K. Titsias , Neil D. Lawrence

Multi-output Gaussian processes have received increasing attention during the last few years as a natural mechanism to extend the powerful flexibility of Gaussian processes to the setup of multiple output variables. The key point here is…

Machine Learning · Statistics 2015-03-24 Cristian Guarnizo , Mauricio A. Álvarez

It is common in functional data analysis to look at a set of related functions: a set of learning curves, a set of brain signals, a set of spatial maps, etc. One way to express relatedness is through an additive model, whereby each…

Computation · Statistics 2014-02-21 Simon Barthelme

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

Linear systems occur throughout engineering and the sciences, most notably as differential equations. In many cases the forcing function for the system is unknown, and interest lies in using noisy observations of the system to infer the…

The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order…

Machine Learning · Statistics 2017-11-16 Jean-Francois Ton , Seth Flaxman , Dino Sejdinovic , Samir Bhatt

This work brings together two powerful concepts in Gaussian processes: the variational approach to sparse approximation and the spectral representation of Gaussian processes. This gives rise to an approximation that inherits the benefits of…

Machine Learning · Statistics 2017-11-09 James Hensman , Nicolas Durrande , Arno Solin

Gaussian processes are rich distributions over functions, which provide a Bayesian nonparametric approach to smoothing and interpolation. We introduce simple closed form kernels that can be used with Gaussian processes to discover patterns…

Machine Learning · Statistics 2014-01-03 Andrew Gordon Wilson , Ryan Prescott Adams

Latent force models are systems whereby there is a mechanistic model describing the dynamics of the system state, with some unknown forcing term that is approximated with a Gaussian process. If such dynamics are non-linear, it can be…

Machine Learning · Statistics 2019-11-05 Wil O. C. Ward , Tom Ryder , Dennis Prangle , Mauricio A. Álvarez

Slow kinetic processes of molecular systems can be analyzed by computing dominant eigenpairs of the Koopman operator or its generator. In this context, the Variational Approach to Markov Processes (VAMP) provides a rigorous way of…

Computational Physics · Physics 2024-02-15 Feliks Nüske , Stefan Klus

We analyze the dynamics of an algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we assume random covariance matrices…

Machine Learning · Computer Science 2020-08-26 Burak Çakmak , Manfred Opper
‹ Prev 1 2 3 10 Next ›