English
Related papers

Related papers: Online structural kernel selection for mobile heal…

200 papers

Length-biased data are a particular case of weighted data, which arise in many situations: biomedicine, quality control or epidemiology among others. In this paper we study the theoretical properties of kernel density estimation in the…

Kernels are powerful and versatile tools in machine learning and statistics. Although the notion of universal kernels and characteristic kernels has been studied, kernel selection still greatly influences the empirical performance. While…

Machine Learning · Statistics 2019-02-28 Chun-Liang Li , Wei-Cheng Chang , Youssef Mroueh , Yiming Yang , Barnabás Póczos

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

The use of kernel functions is a common technique to extract important features from data sets. A quantum computer can be used to estimate kernel entries as transition amplitudes of unitary circuits. Quantum kernels exist that, subject to…

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

Kernel methods have been extensively utilized in machine learning for classification and prediction tasks due to their ability to capture complex non-linear data patterns. However, single kernel approaches are inherently limited, as they…

Machine Learning · Computer Science 2026-02-12 Qiyuan Shi , Jian Kang , Yi Li

Online learning with multiple kernels has gained increasing interests in recent years and found many applications. For classification tasks, Online Multiple Kernel Classification (OMKC), which learns a kernel based classifier by seeking the…

Machine Learning · Computer Science 2015-11-19 Jing Lu , Steven C. H. Hoi , Doyen Sahoo , Peilin Zhao

We consider multi-agent stochastic optimization problems over reproducing kernel Hilbert spaces (RKHS). In this setting, a network of interconnected agents aims to learn decision functions, i.e., nonlinear statistical models, that are…

Optimization and Control · Mathematics 2018-07-04 Alec Koppel , Santiago Paternain , Cedric Richard , Alejandro Ribeiro

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

Machine Learning · Computer Science 2025-08-14 Wouter M. Kouw

Gaussian process regression (GPR) is a fundamental model used in machine learning. Owing to its accurate prediction with uncertainty and versatility in handling various data structures via kernels, GPR has been successfully used in various…

Machine Learning · Computer Science 2021-12-16 Yuya Yoshikawa , Tomoharu Iwata

Motivation: Networks underlie the generation and interpretation of many biological datasets: gene networks shed light on the regulatory structure of the genome, and cell networks can capture structure of the tumor micro-environment.…

Machine Learning · Statistics 2026-03-18 Bailey Andrew , Erica L. Harris , James A. Poulter , David R. Westhead , Luisa Cutillo

We propose non-stationary spectral kernels for Gaussian process regression. We propose to model the spectral density of a non-stationary kernel function as a mixture of input-dependent Gaussian process frequency density surfaces. We solve…

Machine Learning · Statistics 2019-09-25 Sami Remes , Markus Heinonen , Samuel Kaski

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

The presence of irrelevant features in the input dataset tends to reduce the interpretability and predictive quality of machine learning models. Therefore, the development of feature selection methods to recognize irrelevant features is a…

Machine Learning · Statistics 2020-10-13 Federico Amato , Fabian Guignard , Philippe Jacquet , Mikhail Kanevski

Motivated by applications, we introduce a general and new framework for operator valued positive definite kernels. We further give applications both to operator theory and to stochastic processes. The first one yields several dilation…

Functional Analysis · Mathematics 2024-07-31 Palle E. T. Jorgensen , James Tian

We develop a multi-kernel based regression method for graph signal processing where the target signal is assumed to be smooth over a graph. In multi-kernel regression, an effective kernel function is expressed as a linear combination of…

Machine Learning · Statistics 2018-03-14 Arun Venkitaraman , Saikat Chatterjee , Peter Händel

Functional covariates arise in many scientific and engineering applications when model inputs take the form of time-dependent or spatially distributed profiles, such as varying boundary conditions or changing material behaviours. In…

Statistics Theory · Mathematics 2026-03-10 Razak Christophe Sabi Gninkou , Andrés F. López-Lopera , Franck Massa , Rodolphe Le Riche

A structure-preserving kernel ridge regression method is presented that allows the recovery of nonlinear Hamiltonian functions out of datasets made of noisy observations of Hamiltonian vector fields. The method proposes a closed-form…

Machine Learning · Statistics 2025-04-07 Jianyu Hu , Juan-Pablo Ortega , Daiying Yin

This work presents a family of parsimonious Gaussian process models which allow to build, from a finite sample, a model-based classifier in an infinite dimensional space. The proposed parsimonious models are obtained by constraining the…

Methodology · Statistics 2012-06-18 Charles Bouveyron , Stéphane Girard , Mathieu Fauvel

Multi-output Gaussian processes (MOGPs) are an extension of Gaussian Processes (GPs) for predicting multiple output variables (also called channels, tasks) simultaneously. In this paper we use the convolution theorem to design a new kernel…

Machine Learning · Computer Science 2021-10-11 Kai Chen , Twan van Laarhoven , Perry Groot , Jinsong Chen , Elena Marchiori