English
Related papers

Related papers: Data-Driven Integration Kernels for Interpretable …

200 papers

Modern Bayesian optimization and adaptive sampling methods increasingly rely on nonlinear parametric models, yet theoretical guarantees for such models under adaptive data collection remain limited. Existing analyses largely focus on…

Machine Learning · Statistics 2026-05-14 Rafael Oliveira

The use of covariance kernels is ubiquitous in the field of spatial statistics. Kernels allow data to be mapped into high-dimensional feature spaces and can thus extend simple linear additive methods to nonlinear methods with higher order…

Machine Learning · Statistics 2017-11-16 Jean-Francois Ton , Seth Flaxman , Dino Sejdinovic , Samir Bhatt

Partial Differential Equations are infinite dimensional encoded representations of physical processes. However, imbibing multiple observation data towards a coupled representation presents significant challenges. We present a fully…

Machine Learning · Computer Science 2020-03-09 Gurpreet Singh , Soumyajit Gupta , Matt Lease , Clint N. Dawson

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

One central theme in machine learning is function estimation from sparse and noisy data. An example is supervised learning where the elements of the training set are couples, each containing an input location and an output response. In the…

Machine Learning · Computer Science 2023-10-05 Alberto Giaretta , Mauro Bisiacco , Gianluigi Pillonetto

Kernels are efficient in representing nonlocal dependence and they are widely used to design operators between function spaces. Thus, learning kernels in operators from data is an inverse problem of general interest. Due to the nonlocal…

Machine Learning · Statistics 2024-10-21 Neil K. Chada , Quanjun Lang , Fei Lu , Xiong Wang

Kernel methods are powerful machine learning techniques which implement generic non-linear functions to solve complex tasks in a simple way. They Have a solid mathematical background and exhibit excellent performance in practice. However,…

Machine Learning · Computer Science 2021-01-27 J. Emmanuel Johnson , Valero Laparra , Adrián Pérez-Suay , Miguel D. Mahecha , Gustau Camps-Valls

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

As the role played by statistical and computational sciences in climate and environmental modelling and prediction becomes more important, Machine Learning researchers are becoming more aware of the relevance of their work to help tackle…

Machine Learning · Statistics 2020-12-23 Federico Amato , Fabian Guignard , Sylvain Robert , Mikhail Kanevski

We introduce a novel kernel-based framework for learning differential equations and their solution maps that is efficient in data requirements, in terms of solution examples and amount of measurements from each example, and computational…

Machine Learning · Statistics 2025-04-07 Yasamin Jalalian , Juan Felipe Osorio Ramirez , Alexander Hsu , Bamdad Hosseini , Houman Owhadi

Context plays an important role in visual pattern recognition as it provides complementary clues for different learning tasks including image classification and annotation. In the particular scenario of kernel learning, the general recipe…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Mingyuan Jiu , Hichem Sahbi

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

The compositionality and sparsity of high-throughput sequencing data poses a challenge for regression and classification. However, in microbiome research in particular, conditional modeling is an essential tool to investigate relationships…

Machine Learning · Statistics 2023-07-19 Shimeng Huang , Elisabeth Ailer , Niki Kilbertus , Niklas Pfister

We present a data-driven framework for the modeling of nonlocal heat transport in plasmas using a nonlocal theory informed neural network trained on kinetic Particle-in-Cell simulations that span both local and nonlocal regimes. The model…

We propose a kernel-spectral embedding algorithm for learning low-dimensional nonlinear structures from high-dimensional and noisy observations, where the datasets are assumed to be sampled from an intrinsically low-dimensional manifold and…

Machine Learning · Statistics 2023-07-07 Xiucai Ding , Rong Ma

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

We introduce a data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

Inverse problems and, in particular, inferring unknown or latent parameters from data are ubiquitous in engineering simulations. A predominant viewpoint in identifying unknown parameters is Bayesian inference where both prior information…

Computation · Statistics 2022-08-31 Vahid Keshavarzzadeh , Robert M. Kirby , Akil Narayan

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland