English
Related papers

Related papers: Gaussian Process-based learning with new MCMC-base…

200 papers

Accurate time series forecasting is crucial for optimizing resource allocation, industrial production, and urban management, particularly with the growth of cyber-physical and IoT systems. However, limited training sample availability in…

Machine Learning · Computer Science 2025-06-24 Yunyao Cheng , Chenjuan Guo , Kaixuan Chen , Kai Zhao , Bin Yang , Jiandong Xie , Christian S. Jensen , Feiteng Huang , Kai Zheng

In this paper, we first consider the parameter estimation of a multivariate random process distribution using multivariate Gaussian mixture law. The labels of the mixture are allowed to have a general probability law which gives the…

Data Analysis, Statistics and Probability · Physics 2009-11-07 Hichem Snoussi , Ali Mohammad-Djafari

Predicated on the increasing abundance of electronic health records, we investi- gate the problem of inferring individualized treatment effects using observational data. Stemming from the potential outcomes model, we propose a novel multi-…

Machine Learning · Computer Science 2017-05-30 Ahmed M. Alaa , Mihaela van der Schaar

Inference in Gaussian process (GP) models is computationally challenging for large data, and often difficult to approximate with a small number of inducing points. We explore an alternative approximation that employs stochastic inference…

Machine Learning · Statistics 2019-05-28 Jiaxin Shi , Mohammad Emtiyaz Khan , Jun Zhu

We propose a principled way to define Gaussian process priors on various sets of unweighted graphs: directed or undirected, with or without loops. We endow each of these sets with a geometric structure, inducing the notions of closeness and…

Machine Learning · Statistics 2023-02-28 Viacheslav Borovitskiy , Mohammad Reza Karimi , Vignesh Ram Somnath , Andreas Krause

Variational Gaussian process (GP) approximations have become a standard tool in fast GP inference. This technique requires a user to select variational features to increase efficiency. So far the common choices in the literature are…

Machine Learning · Statistics 2021-10-26 Veit Wild , George Wynne

This paper presents an approach for constrained Gaussian Process (GP) regression where we assume that a set of linear transformations of the process are bounded. It is motivated by machine learning applications for high-consequence…

Machine Learning · Statistics 2019-09-12 Christian Agrell

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

Statistics Theory · Mathematics 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick

In this paper, we propose a Gaussian Process (GP) emulator for the calculation of a) tomographic weak lensing band-power spectra, and b) coefficients of summary data massively compressed with the MOPED algorithm. In the former case…

Cosmology and Nongalactic Astrophysics · Physics 2020-07-29 Arrykrishna Mootoovaloo , Alan F. Heavens , Andrew H. Jaffe , Florent Leclercq

Gaussian Processes (GPs) provide a convenient framework for specifying function-space priors, making them a natural choice for modeling uncertainty. In contrast, Bayesian Neural Networks (BNNs) offer greater scalability and extendability…

Machine Learning · Computer Science 2025-06-12 Marcin Sendera , Amin Sorkhei , Tomasz Kuśmierczyk

Machine learning algorithms frequently require careful tuning of model hyperparameters, regularization terms, and optimization parameters. Unfortunately, this tuning is often a "black art" that requires expert experience, unwritten rules of…

Machine Learning · Statistics 2012-08-30 Jasper Snoek , Hugo Larochelle , Ryan P. Adams

The behavior of many Bayesian models used in machine learning critically depends on the choice of prior distributions, controlled by some hyperparameters that are typically selected by Bayesian optimization or cross-validation. This…

Machine Learning · Statistics 2023-10-09 Eliezer de Souza da Silva , Tomasz Kuśmierczyk , Marcelo Hartmann , Arto Klami

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an…

Data Analysis, Statistics and Probability · Physics 2008-02-03 Radford M. Neal

Gaussian processes are widely employed as versatile modelling and predictive tools in spatial statistics, functional data analysis, computer modelling and diverse applications of machine learning. They have been widely studied over…

Statistics Theory · Mathematics 2023-03-28 Didong Li , Wenpin Tang , Sudipto Banerjee

The Gaussian process (GP) model, which has been extensively applied as priors of functions, has demonstrated excellent performance. The specification of a large number of parameters affects the computational efficiency and the feasibility…

Machine Learning · Statistics 2020-02-13 Shisheng Cui , Chia-Jung Chang

The Wishart distribution is the standard conjugate prior for the precision of the multivariate Gaussian likelihood, when the mean is known -- while the normal-Wishart can be used when the mean is also unknown. It is however not so obvious…

Machine Learning · Statistics 2021-09-17 Niko Brümmer

We present a hierarchical Bayesian learning approach to infer jointly sparse parameter vectors from multiple measurement vectors. Our model uses separate conditionally Gaussian priors for each parameter vector and common gamma-distributed…

Machine Learning · Statistics 2024-05-27 Jan Glaubitz , Anne Gelb

Gaussian process (GP) is a powerful modeling method with applications in machine learning for various engineering and non-engineering fields. Despite numerous benefits of modeling using GPs, the computational complexity associated with GPs…

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's…

Machine Learning · Computer Science 2021-09-09 Sarem Seitz

The hyperparameters in Gaussian process regression (GPR) model with a specified kernel are often estimated from the data via the maximum marginal likelihood. Due to the non-convexity of marginal likelihood with respect to the…

Machine Learning · Statistics 2018-01-15 Zexun Chen , Bo Wang