English
Related papers

Related papers: SpicyMKL

200 papers

Kernel methods play an important role in machine learning applications due to their conceptual simplicity and superior performance on numerous machine learning tasks. Expressivity of a machine learning model, referring to the ability of the…

Despite the recent progress towards efficient multiple kernel learning (MKL), the structured output case remains an open research front. Current approaches involve repeatedly solving a batch learning problem, which makes them inadequate for…

Machine Learning · Statistics 2010-10-15 Andre F. T. Martins , Mario A. T. Figueiredo , Pedro M. Q. Aguiar , Noah A. Smith , Eric P. Xing

The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in…

Machine Learning · Computer Science 2023-11-07 Emilio Ruiz-Moreno , Baltasar Beferull-Lozano

Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with…

Machine Learning · Computer Science 2017-08-29 R. C. de Lamare , André Flores

Kernel machines often yield superior predictive performance on various tasks; however, they suffer from severe computational challenges. In this paper, we show how to overcome the important challenge of speeding up kernel machines. In…

Machine Learning · Computer Science 2016-08-09 Cho-Jui Hsieh , Si Si , Inderjit S. Dhillon

In this paper, we propose an efficient algorithm for the network slicing problem which attempts to map multiple customized virtual network requests (also called services) to a common shared network infrastructure and allocate network…

Information Theory · Computer Science 2023-02-14 Wei-Kun Chen , Ya-Feng Liu , Fan Liu , Yu-Hong Dai , Zhi-Quan Luo

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

Machine Learning · Computer Science 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis

Kernel fusion is a popular and effective approach for combining multiple features that characterize different aspects of data. Traditional approaches for Multiple Kernel Learning (MKL) attempt to learn the parameters for combining the…

Multiple kernel learning (MKL) aims to find an optimal, consistent kernel function. In the hierarchical multiple kernel clustering (HMKC) algorithm, sample features are extracted layer by layer from a high-dimensional space to maximize the…

Machine Learning · Computer Science 2024-10-29 Lei Wang , Liang Du , Peng Zhou

We consider the problem of simultaneously learning to linearly combine a very large number of kernels and learn a good predictor based on the learnt kernel. When the number of kernels $d$ to be combined is very large, multiple kernel…

Machine Learning · Computer Science 2015-03-20 Arash Afkanpour , András György , Csaba Szepesvári , Michael Bowling

This paper presents a low-overhead optimizer for the ubiquitous sparse matrix-vector multiplication (SpMV) kernel. Architectural diversity among different processors together with structural diversity among different sparse matrices lead to…

Performance · Computer Science 2017-11-16 Athena Elafrou , Georgios Goumas , Nektarios Koziris

Most metric learning algorithms, as well as Fisher's Discriminant Analysis (FDA), optimize some cost function of different measures of within-and between-class distances. On the other hand, Support Vector Machines(SVMs) and several Multiple…

Machine Learning · Computer Science 2013-09-17 Huyen Do , Alexandros Kalousis

We present a probabilistic viewpoint to multiple kernel learning unifying well-known regularised risk approaches and recent advances in approximate Bayesian inference relaxations. The framework proposes a general objective function suitable…

Machine Learning · Statistics 2012-06-08 Hannes Nickisch , Matthias Seeger

This paper presents an algorithm, Voted Kernel Regularization , that provides the flexibility of using potentially very complex kernel functions such as predictors based on much higher-degree polynomial kernels, while benefitting from…

Machine Learning · Computer Science 2015-09-16 Corinna Cortes , Prasoon Goyal , Vitaly Kuznetsov , Mehryar Mohri

Combining information from different sources is a common way to improve classification accuracy in Brain-Computer Interfacing (BCI). For instance, in small sample settings it is useful to integrate data from other subjects or sessions in…

Machine Learning · Statistics 2013-10-24 Wojciech Samek , Alexander Binder , Klaus-Robert Müller

Multiple kernel methods less consider the intrinsic manifold structure of multiple kernel data and estimate the consensus kernel matrix with quadratic number of variables, which makes it vulnerable to the noise and outliers within multiple…

Machine Learning · Computer Science 2024-10-22 Liang Du , Xin Ren , Haiying Zhang , Peng Zhou

We develop regularization methods to find flat minima while training deep neural networks. These minima generalize better than sharp minima, yielding models outperforming baselines on real-world test data (which may be distributed…

Machine Learning · Computer Science 2025-07-04 Adam Sandler , Diego Klabjan , Yuan Luo

In this paper, we propose a general class of algorithms for optimizing an extensive variety of nonsmoothly penalized objective functions that satisfy certain regularity conditions. The proposed framework utilizes the…

Computation · Statistics 2011-01-24 Elizabeth D. Schifano , Robert L. Strawderman , Martin T. Wells

We investigate the learning rate of multiple kernel learning (MKL) with $\ell_1$ and elastic-net regularizations. The elastic-net regularization is a composition of an $\ell_1$-regularizer for inducing the sparsity and an…

Machine Learning · Statistics 2013-08-27 Taiji Suzuki , Masashi Sugiyama

As quantum computers become increasingly practical, so does the prospect of using quantum computation to improve upon traditional algorithms. Kernel methods in machine learning is one area where such improvements could be realized in the…

Quantum Physics · Physics 2023-05-30 Ara Ghukasyan , Jack S. Baker , Oktay Goktas , Juan Carrasquilla , Santosh Kumar Radha