English
Related papers

Related papers: Structural Kernel Search via Bayesian Optimization…

200 papers

Tensor networks provide a powerful framework for compressing multi-dimensional data. The optimal tensor network structure for a given data tensor depends on both data characteristics and specific optimality criteria, making tensor network…

Computational Engineering, Finance, and Science · Computer Science 2026-03-23 Zheng Guo , Aditya Deshpande , Brian Kiedrowski , Xinyu Wang , Alex Gorodetsky

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

Machine Learning · Computer Science 2025-08-14 Wouter M. Kouw

Recent implementations of local approximate Gaussian process models have pushed computational boundaries for non-linear, non-parametric prediction problems, particularly when deployed as emulators for computer experiments. Their flavor of…

Computation · Statistics 2015-01-06 Robert B. Gramacy , Benjamin Haaland

Improvement of statistical learning models in order to increase efficiency in solving classification or regression problems is still a goal pursued by the scientific community. In this way, the support vector machine model is one of the…

Machine Learning · Statistics 2019-11-22 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

Gaussian process regression is a widely-applied method for function approximation and uncertainty quantification. The technique has gained popularity recently in the machine learning community due to its robustness and interpretability. The…

Machine Learning · Statistics 2022-10-12 Marcus M. Noack , James A. Sethian

We develop an automated variational inference method for Bayesian structured prediction problems with Gaussian process (GP) priors and linear-chain likelihoods. Our approach does not need to know the details of the structured likelihood…

Machine Learning · Statistics 2016-09-15 Pietro Galliani , Amir Dezfouli , Edwin V. Bonilla , Novi Quadrianto

In this article we construct a maximal set of kernels for a multi-parameter linear scale-space that allow us to construct trees for classification and recognition of one-dimensional continuous signals similar the Gaussian linear scale-space…

Statistics Theory · Mathematics 2023-05-24 Leon A. Luxemburg , Steven B. Damelin

The Gaussian kernel is a very popular kernel function used in many machine learning algorithms, especially in support vector machines (SVMs). It is more often used than polynomial kernels when learning from nonlinear datasets, and is…

Machine Learning · Computer Science 2020-05-27 Arit Kumar Bishwas , Ashish Mani , Vasile Palade

Substantial research on structured sparsity has contributed to analysis of many different applications. However, there have been few Bayesian procedures among this work. Here, we develop a Bayesian model for structured sparsity that uses a…

Methodology · Statistics 2014-07-09 Barbara E. Engelhardt , Ryan P. Adams

Bayesian Optimisation (BO) refers to a class of methods for global optimisation of a function $f$ which is only accessible via point evaluations. It is typically used in settings where $f$ is expensive to evaluate. A common use case for BO…

Machine Learning · Computer Science 2019-03-19 Kirthevasan Kandasamy , Willie Neiswanger , Jeff Schneider , Barnabas Poczos , Eric Xing

In this work, we introduce a spatio-temporal kernel for Gaussian process (GP) regression-based sound field estimation. Notably, GPs have the attractive property that the sound field is a linear function of the measurements, allowing the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 David Sundström , Shoichi Koyama , Andreas Jakobsson

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the criterion minimised…

Machine Learning · Computer Science 2016-07-15 Ferenc Huszar , David Duvenaud

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the criterion minimised…

Machine Learning · Statistics 2016-07-18 Ferenc Huszár , David Duvenaud

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation…

Machine Learning · Computer Science 2025-02-25 Lulu Kang , Minshen Xu

Bayesian methods in machine learning, such as Gaussian processes, have great advantages com-pared to other techniques. In particular, they provide estimates of the uncertainty associated with a prediction. Extending the Bayesian approach to…

Quantum Physics · Physics 2019-05-20 Zhikuan Zhao , Alejandro Pozas-Kerstjens , Patrick Rebentrost , Peter Wittek

Convolutional Neural Network is known as ConvNet have been extensively used in many complex machine learning tasks. However, hyperparameters optimization is one of a crucial step in developing ConvNet architectures, since the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Pushparaja Murugan

Network structure optimization is a fundamental task in complex network analysis. However, almost all the research on Bayesian optimization is aimed at optimizing the objective functions with vectorial inputs. In this work, we first present…

Machine Learning · Statistics 2018-11-07 Jiaxu Cui , Bo Yang

We develop a flexible Gaussian Process (GP) framework for learning the covariance structure of Age- and Year-specific mortality surfaces. Utilizing the additive and multiplicative structure of GP kernels, we design a genetic programming…

Machine Learning · Statistics 2024-11-20 Mike Ludkovski , Jimmy Risk

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

Gaussian Process regression is a kernel method successfully adopted in many real-life applications. Recently, there is a growing interest on extending this method to non-Euclidean input spaces, like the one considered in this paper,…

Machine Learning · Computer Science 2022-12-05 Antonio Candelieri , Andrea Ponti , Francesco Archetti