English
Related papers

Related papers: Variational Inference of Joint Models using Multiv…

200 papers

This paper introduces a new latent variable generative model able to handle high dimensional longitudinal data and relying on variational inference. The time dependency between the observations of an input sequence is modelled using…

Machine Learning · Statistics 2023-03-28 Clément Chadebec , Stéphanie Allassonnière

Non-conjugate Gaussian processes (NCGPs) define a flexible probabilistic framework to model categorical, ordinal and continuous data, and are widely used in practice. However, exact inference in NCGPs is prohibitively expensive for large…

Machine Learning · Computer Science 2025-04-18 Lukas Tatzel , Jonathan Wenger , Frank Schneider , Philipp Hennig

We develop a robust data fusion algorithm for field reconstruction of multiple physical phenomena. The contribution of this paper is twofold: First, we demonstrate how multi-spatial fields which can have any marginal distributions and…

Methodology · Statistics 2019-06-11 Pengfei Zhang , Gareth W. Peters , Ido Nevat , Keng Boon Teo , Yixin Wang

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

We introduce a Bayesian framework for inference with a supervised version of the Gaussian process latent variable model. The framework overcomes the high correlations between latent variables and hyperparameters by using an unbiased pseudo…

Machine Learning · Statistics 2018-03-29 Charles Gadd , Sara Wade , Akeel Shah , Dimitris Grammatopoulos

Aggregate data often appear in various fields such as socio-economics and public security. The aggregate data are associated not with points but with supports (e.g., spatial regions in a city). Since the supports may have various…

Gaussian process (GP) models are widely used to analyze spatially referenced data and to predict values at locations without observations. In contrast to many algorithmic procedures, GP models are based on a statistical framework, which…

Computation · Statistics 2020-01-01 Florian Gerber , Douglas W. Nychka

Existing spatio-temporal Hawkes process models typically rely on either parametric or semiparametric assumptions, limiting the model's ability to capture complex endogenous and exogenous event dynamics. We propose a fully Bayesian…

Methodology · Statistics 2026-03-31 Wenqing Liu , Xenia Miscouridou , Déborah Sulem

Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with…

Computation · Statistics 2010-03-22 Iain Murray , Ryan Prescott Adams , David J. C. MacKay

We propose a Bayesian nonparametric approach to the problem of jointly modeling multiple related time series. Our model discovers a latent set of dynamical behaviors shared among the sequences, and segments each time series into regions…

Methodology · Statistics 2014-11-14 Emily B. Fox , Michael C. Hughes , Erik B. Sudderth , Michael I. Jordan

Longitudinal study designs are indispensable for studying disease progression. Inferring covariate effects from longitudinal data, however, requires interpretable methods that can model complicated covariance structures and detect nonlinear…

Machine Learning · Statistics 2022-10-27 Juho Timonen , Henrik Mannerström , Aki Vehtari , Harri Lähdesmäki

In this tutorial we explain the inference procedures developed for the sparse Gaussian process (GP) regression and Gaussian process latent variable model (GPLVM). Due to page limit the derivation given in Titsias (2009) and Titsias &…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk

We present a model that can automatically learn alignments between high-dimensional data in an unsupervised manner. Our proposed method casts alignment learning in a framework where both alignment and data are modelled simultaneously.…

Machine Learning · Statistics 2019-03-04 Ieva Kazlauskaite , Carl Henrik Ek , Neill D. F. Campbell

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

Machine Learning · Statistics 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

With the advent of artificial intelligence and machine learning, various domains of science and engineering communities have leveraged data-driven surrogates to model complex systems through fusing numerous sources of information (data)…

In this paper, we introduce a novel theoretical framework for Gaussian process regression error analysis, leveraging a function-space decomposition. Based on this framework, we develop a weighted Jacobi iterative method that utilizes…

Numerical Analysis · Mathematics 2026-02-27 Tiantian Sun , Juan Zhang

Deep Gaussian Processes learn probabilistic data representations for supervised learning by cascading multiple Gaussian Processes. While this model family promises flexible predictive distributions, exact inference is not tractable.…

Machine Learning · Statistics 2020-10-23 Jakob Lindinger , David Reeb , Christoph Lippert , Barbara Rakitsch

Finite element model updating utilizing frequency response functions as inputs is an important procedure in structural analysis, design and control. This paper presents a highly efficient framework that is built upon Gaussian process…

Computational Engineering, Finance, and Science · Computer Science 2020-08-26 Kai Zhou , Jiong Tang

Estimating an individual's counterfactual outcomes under interventions is a challenging task for traditional causal inference and supervised learning approaches when the outcome is high-dimensional (e.g. gene expressions, facial images) and…

Machine Learning · Computer Science 2025-03-19 Yulun Wu , Louie McConnell , Claudia Iriondo

We revisit the replica method for analyzing inference and learning in parametric models, considering situations where the data-generating distribution is unknown or analytically intractable. Instead of assuming idealized distributions to…

Disordered Systems and Neural Networks · Physics 2025-11-17 Takashi Takahashi