English
Related papers

Related papers: Kernel functions based on triplet comparisons

200 papers

We introduce a similarity function on formulae of signal temporal logic (STL). It comes in the form of a kernel function, well known in machine learning as a conceptually and computationally efficient tool. The corresponding kernel trick…

Logic in Computer Science · Computer Science 2022-01-26 Luca Bortolussi , Giuseppe Maria Gallo , Jan Křetínský , Laura Nenzi

The general perception is that kernel methods are not scalable, and neural nets are the methods of choice for nonlinear learning problems. Or have we simply not tried hard enough for kernel methods? Here we propose an approach that scales…

Machine Learning · Computer Science 2015-09-11 Bo Dai , Bo Xie , Niao He , Yingyu Liang , Anant Raj , Maria-Florina Balcan , Le Song

We introduce the loss kernel, an interpretability method for measuring similarity between data points according to a trained neural network. The kernel is the covariance matrix of per-sample losses computed under a distribution of…

Machine Learning · Computer Science 2025-10-01 Maxwell Adam , Zach Furman , Jesse Hoogland

This paper investigates the use of nonparametric kernel-regression to obtain a tasksimilarity aware meta-learning algorithm. Our hypothesis is that the use of tasksimilarity helps meta-learning when the available tasks are limited and may…

Machine Learning · Computer Science 2020-10-13 Arun Venkitaraman , Anders Hansson , Bo Wahlberg

The kernel method is an essential tool for the study of generating series of walks in the quarter plane. This method involves equating to zero a certain polynomial, the kernel polynomial, and using properties of the curve, the kernel curve,…

Combinatorics · Mathematics 2024-10-22 Thomas Dreyfus , Charlotte Hardouin , Julien Roques , Michael F. Singer

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

The use of kernels for nonlinear prediction is widespread in machine learning. They have been popularized in support vector machines and used in kernel ridge regression, amongst others. Kernel methods share three aspects. First, instead of…

Machine Learning · Statistics 2025-08-25 Patrick J. F. Groenen , Michael Greenacre

Graph kernels have been successfully applied to many graph classification problems. Typically, a kernel is first designed, and then an SVM classifier is trained based on the features defined implicitly by this kernel. This two-stage…

In this paper we present the application of a novel methodology to scientific citation and collaboration networks. This methodology is designed for understanding the governing dynamics of evolving networks and relies on an attachment…

Disordered Systems and Neural Networks · Physics 2009-09-29 Gabor Csardi , Katherine Strandburg , Laszlo Zalanyi , Jan Tobochnik , Peter Erdi

Multiple datasets containing different types of features may be available for a given task. For instance, users' profiles can be used to group users for recommendation systems. In addition, a model can also use users' historical behaviors…

Machine Learning · Computer Science 2016-05-10 Weixiang Shao , Xiaoxiao Shi , Philip S. Yu

We propose a deep learning approach for discovering kernels tailored to identifying clusters over sample data. Our neural network produces sample embeddings that are motivated by--and are at least as expressive as--spectral clustering. Our…

Machine Learning · Computer Science 2020-01-03 Chieh Wu , Zulqarnain Khan , Yale Chang , Stratis Ioannidis , Jennifer Dy

For many machine learning problem settings, particularly with structured inputs such as sequences or sets of objects, a distance measure between inputs can be specified more naturally than a feature representation. However, most standard…

Machine Learning · Statistics 2018-05-28 Lingfei Wu , Ian En-Hsu Yen , Fangli Xu , Pradeep Ravikumar , Michael Witbrock

Suppose H is a space of functions on X. If H is a Hilbert space with reproducing kernel then that structure of H can be used to build distance functions on X. We describe some of those and their interpretations and interrelations. We also…

Complex Variables · Mathematics 2012-05-01 Nicola Arcozzi , Richard Rochberg , Eric T. Sawyer , Brett D. Wick

Kernel mean embedding is a useful tool to represent and compare probability measures. Despite its usefulness, kernel mean embedding considers infinite-dimensional features, which are challenging to handle in the context of differentially…

Machine Learning · Computer Science 2022-06-24 Margarita Vinaroz , Mohammad-Amin Charusaie , Frederik Harder , Kamil Adamczewski , Mijung Park

This paper presents a kernelized version of the t-SNE algorithm, capable of mapping high-dimensional data to a low-dimensional space while preserving the pairwise distances between the data points in a non-Euclidean metric. This can be…

Machine Learning · Computer Science 2023-11-22 Denis C. Ilie-Ablachim , Bogdan Dumitrescu , Cristian Rusu

A well-recognized limitation of kernel learning is the requirement to handle a kernel matrix, whose size is quadratic in the number of training examples. Many methods have been proposed to reduce this computational cost, mostly by using a…

Machine Learning · Computer Science 2014-11-06 Nicolò Cesa-Bianchi , Yishay Mansour , Ohad Shamir

This work concerns the construction and characterization of product kernels for multivariate approximation from a finite set of discrete samples. To this end, we consider composing different component kernels, each acting on a…

Numerical Analysis · Mathematics 2024-11-27 Kristof Albrecht , Juliane Entzian , Armin Iske

In modern data analysis, nonparametric measures of discrepancies between random variables are particularly important. The subject is well-studied in the frequentist literature, while the development in the Bayesian setting is limited where…

Methodology · Statistics 2022-01-25 Qinyi Zhang , Veit Wild , Sarah Filippi , Seth Flaxman , Dino Sejdinovic

Neural methods for embedding entities are typically extrinsically evaluated on downstream tasks and, more recently, intrinsically using probing tasks. Downstream task-based comparisons are often difficult to interpret due to differences in…

Computation and Language · Computer Science 2020-11-19 Andrew Runge , Eduard Hovy

With the advent of kernel methods, automating the task of specifying a suitable kernel has become increasingly important. In this context, the Multiple Kernel Learning (MKL) problem of finding a combination of pre-specified base kernels…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Alexandru Niculescu-Mizil , Koray Kavukcuoglu , Hal Daume