English
Related papers

Related papers: Adaptive Hyperbolic Kernels: Modulated Embedding i…

200 papers

This work provides theoretical foundations for kernel methods in the hyperspherical context. Specifically, we characterise the native spaces (reproducing kernel Hilbert spaces) and the Sobolev spaces associated with kernels defined over…

Machine Learning · Statistics 2022-11-18 Simon Hubbert , Emilio Porcu , Chris. J. Oates , Mark Girolami

Learning in the reproducing kernel Hilbert space (RKHS) such as the support vector machine has been recognized as a promising technique. It continues to be highly effective and competitive in numerous prediction tasks, particularly in…

Machine Learning · Computer Science 2025-01-15 Gakuto Obi , Ayato Saito , Yuto Sasaki , Tsuyoshi Kato

Hyperbolic deep learning has become a growing research direction in computer vision due to the unique properties afforded by the alternate embedding space. The negative curvature and exponentially growing distance metric provide a natural…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Ahmad Bdeir , Johannes Burchert , Lars Schmidt-Thieme , Niels Landwehr

Reproducing kernel Hilbert spaces provide a foundational framework for kernel-based learning, where regularization and interpolation problems admit finite-dimensional solutions through classical representer theorems. Many modern learning…

Machine Learning · Computer Science 2026-02-10 Isabel de la Higuera , Francisco Herrera , M. Victoria Velasco

In large-scale recommender systems, the user-item networks are generally scale-free or expand exponentially. The latent features (also known as embeddings) used to describe the user and item are determined by how well the embedding space…

Information Retrieval · Computer Science 2022-05-31 Menglin Yang , Min Zhou , Jiahong Liu , Defu Lian , Irwin King

Any applied mathematical model contains parameters. The paper proposes to use kernel learning for the parametric analysis of the model. The approach consists in setting a distribution on the parameter space, obtaining a finite training…

Optimization and Control · Mathematics 2025-01-27 Vladimir Norkin , Alois Pichler

Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite…

Machine Learning · Computer Science 2024-07-31 Nathael Da Costa , Cyrus Mostajeran , Juan-Pablo Ortega , Salem Said

Kernel methods have been among the most popular techniques in machine learning, where learning tasks are solved using the property of reproducing kernel Hilbert space (RKHS). In this paper, we propose a novel data analysis framework with…

Machine Learning · Statistics 2020-03-03 Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda , Fuyuta Komura , Takeshi Katsura , Yoshinobu Kawahara

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

Learning the representation of data with hierarchical structures in the hyperbolic space attracts increasing attention in recent years. Due to the constant negative curvature, the hyperbolic space resembles tree metrics and captures the…

Machine Learning · Computer Science 2022-02-21 Huiru Xiao , Caigao Jiang , Yangqiu Song , James Zhang , Junwu Xiong

The reproducing kernel Hilbert space (RKHS) embedding method is a recently introduced estimation approach that seeks to identify the unknown or uncertain function in the governing equations of a nonlinear set of ordinary differential…

Optimization and Control · Mathematics 2020-07-14 Jia Guo , Sai Tej Paruchuri , Andrew J. Kurdila

Knowledge graph embeddings (KGE) have been validated as powerful methods for inferring missing links in knowledge graphs (KGs) that they typically map entities into Euclidean space and treat relations as transformations of entities.…

Machine Learning · Computer Science 2024-02-26 Wenjie Zheng , Wenxue Wang , Shu Zhao , Fulan Qian

Typical R-convolution graph kernels invoke the kernel functions that decompose graphs into non-isomorphic substructures and compare them. However, overlooking implicit similarities and topological position information between those…

Machine Learning · Computer Science 2024-05-10 Shuhao Tang , Hao Tian , Xiaofeng Cao , Wei Ye

Hyperbolic spaces, which have the capacity to embed tree structures without distortion owing to their exponential volume growth, have recently been applied to machine learning to better capture the hierarchical nature of data. In this…

Machine Learning · Computer Science 2021-03-18 Ryohei Shimizu , Yusuke Mukuta , Tatsuya Harada

Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression…

Machine Learning · Computer Science 2024-06-04 Fan He , Mingzhen He , Lei Shi , Xiaolin Huang , Johan A. K. Suykens

Recent advances in machine learning have led to increased interest in reproducing kernel Banach spaces (RKBS) as a more general framework that extends beyond reproducing kernel Hilbert spaces (RKHS). These works have resulted in the…

Machine Learning · Computer Science 2024-11-19 Akash Kumar , Mikhail Belkin , Parthe Pandit

Hyperbolic geometry have shown significant potential in modeling complex structured data, particularly those with underlying tree-like and hierarchical structures. Despite the impressive performance of various hyperbolic neural networks…

Machine Learning · Computer Science 2025-08-26 Menglin Yang , Harshit Verma , Delvin Ce Zhang , Jiahong Liu , Irwin King , Rex Ying

We focus on kernel methods for set-valued inputs and their application to Bayesian set optimization, notably combinatorial optimization. We investigate two classes of set kernels that both rely on Reproducing Kernel Hilbert Space…

Machine Learning · Statistics 2020-03-11 Poompol Buathong , David Ginsbourger , Tipaluck Krityakierne

Many high-dimensional and large-volume data sets of practical relevance have hierarchical structures induced by trees, graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional…

Machine Learning · Computer Science 2021-09-16 Eli Chien , Chao Pan , Puoya Tabaghi , Olgica Milenkovic

We consider multi-agent stochastic optimization problems over reproducing kernel Hilbert spaces (RKHS). In this setting, a network of interconnected agents aims to learn decision functions, i.e., nonlinear statistical models, that are…

Optimization and Control · Mathematics 2018-07-04 Alec Koppel , Santiago Paternain , Cedric Richard , Alejandro Ribeiro