English
Related papers

Related papers: MKL-RT: Multiple Kernel Learning for Ratio-trace P…

200 papers

We propose a new optimization algorithm for Multiple Kernel Learning (MKL) called SpicyMKL, which is applicable to general convex loss functions and general types of regularization. The proposed SpicyMKL iteratively solves smooth…

Machine Learning · Statistics 2011-05-10 Taiji Suzuki , Ryota Tomioka

Simultaneously solving multiple related learning tasks is beneficial under a variety of circumstances, but the prior knowledge necessary to correctly model task relationships is rarely available in practice. In this paper, we develop a…

Machine Learning · Computer Science 2013-07-02 Francesco Dinuzzo

Kernel methods play an important role in machine learning applications due to their conceptual simplicity and superior performance on numerous machine learning tasks. Expressivity of a machine learning model, referring to the ability of the…

Multiple Kernel Learning(MKL) on Support Vector Machines(SVMs) has been a popular front of research in recent times due to its success in application problems like Object Categorization. This success is due to the fact that MKL has the…

Machine Learning · Computer Science 2014-01-03 Dinesh Govindaraj , Raman Sankaran , Sreedal Menon , Chiranjib Bhattacharyya

We propose a strategy for land use classification which exploits Multiple Kernel Learning (MKL) to automatically determine a suitable combination of a set of features without requiring any heuristic knowledge about the classification task.…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Claudio Cusano , Paolo Napoletano , Raimondo Schettini

As quantum computers become increasingly practical, so does the prospect of using quantum computation to improve upon traditional algorithms. Kernel methods in machine learning is one area where such improvements could be realized in the…

Quantum Physics · Physics 2023-05-30 Ara Ghukasyan , Jack S. Baker , Oktay Goktas , Juan Carrasquilla , Santosh Kumar Radha

We consider the problem of metric learning for multi-view data and present a novel method for learning within-view as well as between-view metrics in vector-valued kernel spaces, as a way to capture multi-modal structure of the data. We…

Machine Learning · Computer Science 2018-03-22 Riikka Huusari , Hachem Kadri , Cécile Capponi

Multiple kernel learning (MKL), structured sparsity, and multi-task learning have recently received considerable attention. In this paper, we show how different MKL algorithms can be understood as applications of either regularization on…

Machine Learning · Statistics 2011-03-03 Ryota Tomioka , Taiji Suzuki

Over the past few years, Multi-Kernel Learning (MKL) has received significant attention among data-driven feature selection techniques in the context of kernel-based learning. MKL formulations have been devised and solved for a broad…

Machine Learning · Computer Science 2014-01-22 Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

In this paper we propose a new non-linear classifier based on a combination of locally linear classifiers. A well known optimization formulation is given as we cast the problem in a $\ell_1$ Multiple Kernel Learning (MKL) problem using many…

Machine Learning · Computer Science 2024-01-19 David Picard

Multi-task learning is a natural approach for computer vision applications that require the simultaneous solution of several distinct but related problems, e.g. object detection, classification, tracking of multiple agents, or denoising, to…

Machine Learning · Computer Science 2015-04-14 Carlo Ciliberto , Lorenzo Rosasco , Silvia Villa

The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Statistics 2024-10-30 Aleksandr Talitckii , Brendon K. Colbert , Matthew M. Peet

When faced with learning a set of inter-related tasks from a limited amount of usable data, learning each task independently may lead to poor generalization performance. Multi-Task Learning (MTL) exploits the latent relations between tasks…

Machine Learning · Computer Science 2015-08-14 Niloofar Yousefi , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and…

Machine Learning · Computer Science 2010-10-28 Marius Kloft , Ulf Brefeld , Soeren Sonnenburg , Alexander Zien

This paper presents a Multiple Kernel Learning (abbreviated as MKL) framework for the Support Vector Machine (SVM) with the $(0, 1)$ loss function. Some KKT-like first-order optimality conditions are provided and then exploited to develop a…

Machine Learning · Statistics 2023-09-06 Bin Zhu , Yijie Shi

We theoretically investigate the convergence rate and support consistency (i.e., correctly identifying the subset of non-zero coefficients in the large sample limit) of multiple kernel learning (MKL). We focus on MKL with block-l1…

Machine Learning · Statistics 2011-07-29 Taiji Suzuki , Ryota Tomioka , Masashi Sugiyama

Kernel methods serve as powerful tools to capture nonlinear patterns behind data in machine learning. The quantum kernel, integrating kernel theory with quantum computing, has attracted widespread attention. However, existing studies…

Quantum Physics · Physics 2025-05-23 Jing Li , Yanqi Song , Sujuan Qin , Fei Gao

Multi-view learning (MVL) is an emerging field in machine learning that focuses on improving generalization performance by leveraging complementary information from multiple perspectives or views. Various multi-view support vector machine…

Machine Learning · Computer Science 2025-12-19 A. Quadir , M. Sajid , Mushir Akhtar , M. Tanveer

Multiple Kernel Learning is a conventional way to learn the kernel function in kernel-based methods. MKL algorithms enhance the performance of kernel methods. However, these methods have a lower complexity compared to deep learning models…

Machine Learning · Computer Science 2023-05-05 Ahmad Navid Ghanizadeh , Kamaledin Ghiasi-Shirazi , Reza Monsefi , Mohammadreza Qaraei

Kernel based Deep Learning using multi-layer kernel machines(MKMs) was proposed by Y.Cho and L.K. Saul in \cite{saul}. In MKMs they used only one kernel(arc-cosine kernel) at a layer for the kernel PCA-based feature extraction. We propose…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Akhil Meethal , Asharaf S , Sumitra S