English
Related papers

Related papers: On RKHS Choices for Assessing Graph Generators via…

200 papers

Distributional approximation is a fundamental problem in machine learning with numerous applications across all fields of science and engineering and beyond. The key challenge in most approximation methods is the need to tackle the…

Statistics Theory · Mathematics 2024-09-19 Xiaoda Qu , Xiran Fan , Baba C. Vemuri

Many algorithms for ranked data become computationally intractable as the number of objects grows due to the complex geometric structure induced by rankings. An additional challenge is posed by partial rankings, i.e. rankings in which the…

Machine Learning · Computer Science 2022-07-19 Michelangelo Conserva , Marc Peter Deisenroth , K S Sesh Kumar

We propose a novel approach for pixel classification in hyperspectral images, leveraging on both the spatial and spectral information in the data. The introduced method relies on a recently proposed framework for learning on distributions…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Gianni Franchi , Jesus Angulo , Dino Sejdinovic

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are advantages of this…

Numerical Analysis · Mathematics 2022-07-18 Kazuma Tsuji , Ken'ichiro Tanaka

Quantifying the degree of spatial dependence for linguistic variables is a key task for analyzing dialectal variation. However, existing approaches have important drawbacks. First, they are based on parametric models of dependence, which…

Computation and Language · Computer Science 2016-08-30 Dong Nguyen , Jacob Eisenstein

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang

In the kernel density estimation (KDE) problem, we are given a set $X$ of data points in $\mathbb{R}^d$, a kernel function $k: \mathbb{R}^d \times \mathbb{R}^d \rightarrow \mathbb{R}$, and a query point $\mathbf{q} \in \mathbb{R}^d$, and…

Data Structures and Algorithms · Computer Science 2025-07-03 Steinar Laenen , Peter Macgregor , He Sun

Obtaining reliable, adaptive confidence sets for prediction functions (hypotheses) is a central challenge in sequential decision-making tasks, such as bandits and model-based reinforcement learning. These confidence sets typically rely on…

Machine Learning · Statistics 2022-06-20 Parnian Kassraie , Jonas Rothfuss , Andreas Krause

We study the effect of structural variation in graph data on the predictive performance of graph kernels. To this end, we introduce a novel, noise-robust adaptation of the GraphHopper kernel and validate it on benchmark data, obtaining…

Machine Learning · Computer Science 2018-07-02 Rune Kok Nielsen , Andreas Nugaard Holm , Aasa Feragen

Embedding probability distributions into reproducing kernel Hilbert spaces (RKHS) has enabled powerful nonparametric methods such as the maximum mean discrepancy (MMD), a statistical distance with strong theoretical and computational…

Machine Learning · Statistics 2025-05-28 Masha Naslidnyk , Siu Lun Chau , François-Xavier Briol , Krikamol Muandet

Accurate energy demand forecasting is crucial for sustainable and resilient energy development. To meet the Net Zero Representative Concentration Pathways (RCP) $4.5$ scenario in the DACH countries, increased renewable energy production,…

Machine Learning · Computer Science 2024-09-17 Luca Pernigo , Rohan Sen , Davide Baroli

We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix…

Machine Learning · Statistics 2026-05-12 Anthony Stephenson

We present a new method for multiclass thresholding of a histogram which is based on the nonparametric Kernel Density (KD) estimation, where the unknown parameters of the KD estimate are defined using the Expectation-Maximization (EM)…

Image and Video Processing · Electrical Eng. & Systems 2022-02-11 S. Korneev , J. Gilles , I. Battiato

Improvement of statistical learning models in order to increase efficiency in solving classification or regression problems is still a goal pursued by the scientific community. In this way, the support vector machine model is one of the…

Machine Learning · Statistics 2019-11-22 Anderson Ara , Mateus Maia , Samuel Macêdo , Francisco Louzada

We study spectral algorithms in the setting where kernels are learned from data. We introduce the effective span dimension (ESD), an alignment-sensitive complexity measure that depends jointly on the signal, spectrum, and noise level…

Machine Learning · Computer Science 2026-05-12 Dongming Huang , Zhifan Li , Yicheng Li , Qian Lin

A framework for estimation and hypothesis testing of functional restrictions against general alternatives is proposed. The parameter space is a reproducing kernel Hilbert space (RKHS). The null hypothesis does not necessarily define a…

Methodology · Statistics 2018-08-21 Alessio Sancetta

Kernel density estimation (KDE) has become a popular method for visual analysis in various fields, such as financial risk forecasting, crime clustering, and traffic monitoring. KDE can identify high-density areas from discrete datasets.…

Databases · Computer Science 2025-01-14 Yu Shao , Peng Cheng , Xiang Lian , Lei Chen , Wangze Ni , Xuemin Lin , Chen Zhang , Liping Wang

Variable selection is essential in high-dimensional data analysis. Although various variable selection methods have been developed, most rely on the linear model assumption. This article proposes a nonparametric variable selection method…

Machine Learning · Statistics 2021-09-30 Jongkyeong Kang , Seung Jun Shin

We present a novel variation of online kernel machines in which we exploit a consensus based optimization mechanism to guide the evolution of decision functions drawn from a reproducing kernel Hilbert space, which efficiently models the…

Machine Learning · Statistics 2019-12-18 Raghu G. Raj

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès