English
Related papers

Related papers: Gradient domain machine learning with composite ke…

200 papers

We investigate uncertainties in the estimation of the Hubble constant ($H_0$) arising from Gaussian Process (GP) reconstruction, demonstrating that the choice of kernel introduces systematic variations comparable to those arising from…

Cosmology and Nongalactic Astrophysics · Physics 2025-10-07 Ruchika , Purba Mukherjee , Arianna Favale

We investigate the impact of choosing regressors and molecular representations for the construction of fast machine learning (ML) models of thirteen electronic ground-state properties of organic molecules. The performance of each…

Artificial neural network (ANN) potentials enable highly accurate atomistic simulations of complex materials at unprecedented scales. Despite their promise, training ANN potentials to represent intricate potential energy surfaces (PES) with…

Disordered Systems and Neural Networks · Physics 2025-11-11 In Won Yeu , Annika Stuke , Jon L. pez-Zorrilla , James M. Stevenson , David R. Reichman , Richard A. Friesner , Alexander Urban , Nongnuch Artrith

We study the gradient Expectation-Maximization (EM) algorithm for Gaussian Mixture Models (GMM) in the over-parameterized setting, where a general GMM with $n>1$ components learns from data that are generated by a single ground truth…

Machine Learning · Computer Science 2025-06-03 Weihang Xu , Maryam Fazel , Simon S. Du

The ability to understand and engineer molecular structures relies on having accurate descriptions of the energy as a function of atomic coordinates. Here we outline a new paradigm for deriving energy functions of hyperdimensional molecular…

Machine learning (ML) enables the development of interatomic potentials that promise the accuracy of first principles methods while retaining the low cost and parallel efficiency of empirical potentials. While ML potentials traditionally…

We introduce a priori Sobolev-space error estimates for the solution of nonlinear, and possibly parametric, PDEs using Gaussian process and kernel based methods. The primary assumptions are: (1) a continuous embedding of the reproducing…

Numerical Analysis · Mathematics 2023-05-10 Pau Batlle , Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

Deep Gaussian processes (DGPs) provide a Bayesian non-parametric alternative to standard parametric deep learning models. A DGP is formed by stacking multiple GPs resulting in a well-regularized composition of functions. The Bayesian…

Machine Learning · Statistics 2018-06-06 Vinayak Kumar , Vaibhav Singh , P. K. Srijith , Andreas Damianou

The training of molecular models of quantum mechanical properties based on statistical machine learning requires large datasets which exemplify the map from chemical structure to molecular property. Intelligent a priori selection of…

Gaussian process regression (GPR) has been a well-known machine learning method for various applications such as uncertainty quantifications (UQ). However, GPR is inherently a data-driven method, which requires sufficiently large dataset.…

Machine Learning · Computer Science 2023-05-03 Cheng Chang , Tieyong Zeng

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

Acquiring a substantial number of data points for training accurate machine learning (ML) models is a big challenge in scientific fields where data collection is resource-intensive. Here, we propose a novel approach for constructing a…

Machine Learning · Computer Science 2025-05-07 M. R. Mahani , Igor A. Nechepurenko , Yasmin Rahimof , Andreas Wicht

Neural kernels have drastically increased performance on diverse and nonstandard data modalities but require significantly more compute, which previously limited their application to smaller datasets. In this work, we address this by…

Machine Learning · Statistics 2023-03-10 Ben Adlam , Jaehoon Lee , Shreyas Padhy , Zachary Nado , Jasper Snoek

Belonging to the family of Bayesian nonparametrics, Gaussian process (GP) based approaches have well-documented merits not only in learning over a rich class of nonlinear functions, but also in quantifying the associated uncertainty.…

Machine Learning · Statistics 2021-10-14 Qin Lu , Georgios V. Karanikolas , Georgios B. Giannakis

A data-driven model augmentation framework, referred to as Weakly-coupled Integrated Inference and Machine Learning (IIML), is presented to improve the predictive accuracy of physical models. In contrast to parameter calibration, this work…

Computational Engineering, Finance, and Science · Computer Science 2022-07-25 Vishal Srivastava , Valentin Sulzer , Peyman Mohtat , Jason B. Siegel , Karthik Duraisamy

Modeling geophysical processes as low-dimensional dynamical systems and regressing their vector field from data is a promising approach for learning emulators of such systems. We show that when the kernel of these emulators is also learned…

Atmospheric and Oceanic Physics · Physics 2021-08-11 Boumediene Hamzi , Romit Maulik , Houman Owhadi

Learning Gaussian Mixture Models (GMMs) is a fundamental problem in machine learning, with the Expectation-Maximization (EM) algorithm and its popular variant gradient EM being arguably the most widely used algorithms in practice. In the…

Machine Learning · Computer Science 2025-06-10 Mo Zhou , Weihang Xu , Maryam Fazel , Simon S. Du

In order to fully utilize "big data", it is often required to use "big models". Such models tend to grow with the complexity and size of the training data, and do not make strong parametric assumptions upfront on the nature of the…

Machine Learning · Statistics 2015-04-17 Vikas Sindhwani , Haim Avron

Low-dose positron emission tomography (PET) image reconstruction methods have potential to significantly improve PET as an imaging modality. Deep learning provides a promising means of incorporating prior information into the image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Cameron Dennis Pain , Yasmeen George , Alex Fornito , Gary Egan , Zhaolin Chen

While machine learning (ML) has found multiple applications in photonics, traditional "black box" ML models typically require prohibitively large training data sets. Generation of such data, as well as the training processes themselves,…