English
Related papers

Related papers: Exploring Kernel Functions in the Softmax Layer fo…

200 papers

Machine learning and deep learning have been used extensively to classify physical surfaces through images and time-series contact data. However, these methods rely on human expertise and entail the time-consuming processes of data and…

Machine Learning · Computer Science 2023-08-10 Behnam Khojasteh , Friedrich Solowjow , Sebastian Trimpe , Katherine J. Kuchenbecker

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy between conditional distributions by drawing support from nonlinear kernel functions, thus it has been successfully used for pattern classification. However, CMMD does…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Chuan-Xian Ren , Pengfei Ge , Dao-Qing Dai , Hong Yan

Radial basis function (RBF) networks are expanded to incorporate quantum kernel functions enabling a new type of hybrid quantum-classical machine learning algorithm. Using this approach, synthetic examples are introduced which allow for…

Quantum Physics · Physics 2025-12-24 Emily Micklethwaite , Adam Lowe

Driven by a large number of potential applications in areas like bioinformatics, information retrieval and social network analysis, the problem setting of inferring relations between pairs of data objects has recently been investigated…

Machine Learning · Statistics 2024-10-30 Willem Waegeman , Tapio Pahikkala , Antti Airola , Tapio Salakoski , Michiel Stock , Bernard De Baets

Kernel methods in machine learning use a kernel function that takes two data points as input and returns their inner product after mapping them to a Hilbert space, implicitly and without actually computing the mapping. For many kernel…

Machine Learning · Computer Science 2024-10-17 Kamaledin Ghiasi-Shirazi , Mohammadreza Qaraei

We discuss how to define a kernel for Signal Temporal Logic (STL) formulae. Such a kernel allows us to embed the space of formulae into a Hilbert space, and opens up the use of kernel-based machine learning algorithms in the context of STL.…

Machine Learning · Computer Science 2020-09-14 Luca Bortolussi , Giuseppe Maria Gallo , Laura Nenzi

This paper introduces the kernel mixture network, a new method for nonparametric estimation of conditional probability densities using neural networks. We model arbitrarily complex conditional densities as linear combinations of a family of…

Machine Learning · Statistics 2017-05-22 Luca Ambrogioni , Umut Güçlü , Marcel A. J. van Gerven , Eric Maris

This paper proposes K-NRM, a kernel based neural model for document ranking. Given a query and a set of documents, K-NRM uses a translation matrix that models word-level similarities via word embeddings, a new kernel-pooling technique that…

Information Retrieval · Computer Science 2017-06-22 Chenyan Xiong , Zhuyun Dai , Jamie Callan , Zhiyuan Liu , Russell Power

Kernels are powerful and versatile tools in machine learning and statistics. Although the notion of universal kernels and characteristic kernels has been studied, kernel selection still greatly influences the empirical performance. While…

Machine Learning · Statistics 2019-02-28 Chun-Liang Li , Wei-Cheng Chang , Youssef Mroueh , Yiming Yang , Barnabás Póczos

Dictionary learning algorithms have been successfully used in both reconstructive and discriminative tasks, where the input signal is represented by a linear combination of a few dictionary atoms. While these methods are usually developed…

Machine Learning · Statistics 2015-02-12 Soheil Bahrampour , Nasser M. Nasrabadi , Asok Ray , Kenneth W. Jenkins

We revisit the classical kernel method of approximation/interpolation theory in a very specific context motivated by the desire to obtain a robust procedure to approximate discrete data sets by (super)level sets of functions that are merely…

Machine Learning · Computer Science 2022-09-14 Patrick Guidotti

Text classification is a fundamental task in natural language processing (NLP). Several recent studies show the success of deep learning on text processing. Convolutional neural network (CNN), as a popular deep learning model, has shown…

Computation and Language · Computer Science 2023-01-30 Ali Jarrahi , Ramin Mousa , Leila Safari

Kernel-based machine learning algorithms are based on mapping data from the original input feature space to a kernel feature space of higher dimensionality to solve a linear problem in that space. Over the last decade, kernel based…

Computer Vision and Pattern Recognition · Computer Science 2011-01-18 Mahesh Pal

Sentence compression is the task of creating a shorter version of an input sentence while keeping important information. In this paper, we extend the task of compression by deletion with the use of contextual embeddings. Different from…

Information Retrieval · Computer Science 2020-06-08 Minh-Tien Nguyen , Bui Cong Minh , Dung Tien Le , Le Thai Linh

Deep Neural Networks (DNNs) have performed admirably in classification tasks. However, the characterization of their classification uncertainties, required for certain applications, has been lacking. In this work, we investigate the issue…

Machine Learning · Computer Science 2023-11-28 Yu Pan , Kwo-Sen Kuo , Michael L. Rilee , Hongfeng Yu

Convolutional Neural Networks (CNNs) have recently achieved remarkably strong performance on the practically important task of sentence classification (kim 2014, kalchbrenner 2014, johnson 2014). However, these models require practitioners…

Computation and Language · Computer Science 2016-04-08 Ye Zhang , Byron Wallace

In this article we investigate the effects of conformal transformations on kernel functions used in Support Vector Machines. Our focus lies in the task of text document categorization, which involves assigning each document to a particular…

Machine Learning · Computer Science 2024-06-04 Ioana Rădulescu , Alexandra Băicoianu , Adela Mihai

TextCNN, the convolutional neural network for text, is a useful deep learning algorithm for sentence classification tasks such as sentiment analysis and question classification. However, neural networks have long been known as black boxes…

Machine Learning · Statistics 2018-01-22 Linyuan Gong , Ruyi Ji

The paper studies machine learning problems where each example is described using a set of Boolean features and where hypotheses are represented by linear threshold elements. One method of increasing the expressiveness of learned hypotheses…

Machine Learning · Computer Science 2011-09-13 R. Khardon , D. Roth , R. A. Servedio

This paper have two parts. In the first part we discuss word embeddings. We discuss the need for them, some of the methods to create them, and some of their interesting properties. We also compare them to image embeddings and see how word…

Machine Learning · Computer Science 2016-10-27 Amit Mandelbaum , Adi Shalev