English
Related papers

Related papers: Hierarchical-Hyperplane Kernels for Actively Learn…

200 papers

Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points through their kernel function. However traditional GP kernels…

Machine Learning · Computer Science 2021-11-16 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

We introduce a novel framework for constructing scalable and flexible covariance kernels for Gaussian processes (GPs) by directly learning the covariance structure under a regression-type parameterization induced by Vecchia approximations,…

Machine Learning · Statistics 2026-05-08 Jian Cao , Nian Liu , Ying Lin

Computer models are used as a way to explore complex physical systems. Stationary Gaussian process emulators, with their accompanying uncertainty quantification, are popular surrogates for computer models. However, many computer models are…

Methodology · Statistics 2024-11-25 Faezeh Yazdi , Derek Bingham , Daniel Williamson

This paper introduces a method for the nonparametric Bayesian learning of nonlinear operators, through the use of the Volterra series with kernels represented using Gaussian processes (GPs), which we term the nonparametric Volterra kernels…

Machine Learning · Statistics 2021-06-11 Magnus Ross , Michael T. Smith , Mauricio A. Álvarez

This article proposes an active learning method for high dimensional data, based on intrinsic data geometries learned through diffusion processes on graphs. Diffusion distances are used to parametrize low-dimensional structures on the…

Machine Learning · Computer Science 2019-05-31 Mauro Maggioni , James M. Murphy

The problem of learning the structure of a high dimensional graphical model from data has received considerable attention in recent years. In many applications such as sensor networks and proteomics it is often expensive to obtain samples…

Machine Learning · Statistics 2016-04-08 Gautam Dasarathy , Aarti Singh , Maria-Florina Balcan , Jong Hyuk Park

Gaussian processes (GPs) are flexible models that can capture complex structure in large-scale dataset due to their non-parametric nature. However, the usage of GPs in real-world application is limited due to their high computational cost…

Machine Learning · Statistics 2018-11-06 Congzheng Song , Yiming Sun

Autonomous materials science, where active learning is used to navigate large compositional phase space, has emerged as a powerful vehicle to rapidly explore new materials. A crucial aspect of autonomous materials science is exploring new…

Materials Science · Physics 2026-01-21 Felix Adams , Daiwei Zhu , David W. Steuerman , A. Gilad Kusne , Ichiro Takeuchi

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

Modeling the complex interactions of systems of particles or agents is a fundamental scientific and mathematical problem that is studied in diverse fields, ranging from physics and biology, to economics and machine learning. In this work,…

Machine Learning · Statistics 2020-10-09 Jason Miller , Sui Tang , Ming Zhong , Mauro Maggioni

Neural network approaches to approximate the ground state of quantum hamiltonians require the numerical solution of a highly nonlinear optimization problem. We introduce a statistical learning approach that makes the optimization trivial by…

Quantum Physics · Physics 2023-08-30 Clemens Giuliani , Filippo Vicentini , Riccardo Rossi , Giuseppe Carleo

Probabilistic neural networks are typically modeled with independent weight priors, which do not capture weight correlations in the prior and do not provide a parsimonious interface to express properties in function space. A desirable class…

Machine Learning · Statistics 2020-02-12 Theofanis Karaletsos , Thang D. Bui

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution…

Machine Learning · Computer Science 2021-11-23 Chi-Ken Lu , Patrick Shafto

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

We undertake Bayesian learning of the high-dimensional functional relationship between a system parameter vector and an observable, that is in general tensor-valued. The ultimate aim is Bayesian inverse prediction of the system parameters,…

Methodology · Statistics 2018-04-17 Kangrui Wang , Dalia Chakrabarty

Bayesian optimization has become a fundamental global optimization algorithm in many problems where sample efficiency is of paramount importance. Recently, there has been proposed a large number of new applications in fields such as…

Artificial Intelligence · Computer Science 2019-02-06 Ruben Martinez-Cantin

Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage…

Machine Learning · Computer Science 2020-12-08 Mona Buisson-Fenet , Friedrich Solowjow , Sebastian Trimpe

We investigate active learning in Gaussian Process state-space models (GPSSM). Our problem is to actively steer the system through latent states by determining its inputs such that the underlying dynamics can be optimally learned by a…

Machine Learning · Computer Science 2021-08-03 Hon Sum Alec Yu , Dingling Yao , Christoph Zimmer , Marc Toussaint , Duy Nguyen-Tuong

Differential equations are important mechanistic models that are integral to many scientific and engineering applications. With the abundance of available data there has been a growing interest in data-driven physics-informed models.…

Machine Learning · Computer Science 2025-02-04 Oliver Hamelijnck , Arno Solin , Theodoros Damoulas

Natural language processing often involves computations with semantic or syntactic graphs to facilitate sophisticated reasoning based on structural relationships. While convolution kernels provide a powerful tool for comparing graph…

Computation and Language · Computer Science 2018-02-13 Sahil Garg , Greg Ver Steeg , Aram Galstyan