English
Related papers

Related papers: Multi-task and Lifelong Learning of Kernels

200 papers

Multi-task learning (MTL) enables simultaneous training across related tasks, leveraging shared information to improve generalization, efficiency, and robustness, especially in data-scarce or high-dimensional scenarios. While deep learning…

Machine Learning · Computer Science 2025-10-31 Fatemeh Bazikar , Hossein Moosaei , Atefeh Hemmati , Panos M. Pardalos

We present a geometric formulation of the Multiple Kernel Learning (MKL) problem. To do so, we reinterpret the problem of learning kernel weights as searching for a kernel that maximizes the minimum (kernel) distance between two convex…

Machine Learning · Computer Science 2014-03-18 John Moeller , Parasaran Raman , Avishek Saha , Suresh Venkatasubramanian

Automated tuning of compute kernels is a popular area of research, mainly focused on finding optimal kernel parameters for a problem with fixed input sizes. This approach is good for deploying machine learning models, where the network…

Machine Learning · Computer Science 2020-03-17 John Lawson

Quantum computing, with its potential to enhance various machine learning tasks, allows significant advancements in kernel calculation and model precision. Utilizing the one-class Support Vector Machine alongside a quantum kernel, known for…

Multi-task learning is to improve the performance of the model by transferring and exploiting common knowledge among tasks. Existing MTL works mainly focus on the scenario where label sets among multiple tasks (MTs) are usually the same,…

Machine Learning · Computer Science 2022-01-10 Quan Feng , Songcan Chen

In lifelong learning, tasks (or classes) to be learned arrive sequentially over time in arbitrary order. During training, knowledge from previous tasks can be captured and transferred to subsequent ones to improve sample efficiency. We…

Machine Learning · Computer Science 2022-03-02 Xinyuan Cao , Weiyang Liu , Santosh S. Vempala

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

Machine Learning · Computer Science 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

An important long-term goal in machine learning systems is to build learning agents that, like humans, can learn many tasks over their lifetime, and moreover use information from these tasks to improve their ability to do so efficiently. In…

Machine Learning · Computer Science 2017-07-03 Maria-Florina Balcan , Avrim Blum , Vaishnavh Nagarajan

Advances in high-throughput technologies have originated an ever-increasing availability of omics datasets. The integration of multiple heterogeneous data sources is currently an issue for biology and bioinformatics. Multiple kernel…

Machine Learning · Statistics 2024-12-04 Mitja Briscik , Gabriele Tazza , Marie-Agnes Dillies , László Vidács , Sébastien Dejean

Multiple Kernel Learning is a conventional way to learn the kernel function in kernel-based methods. MKL algorithms enhance the performance of kernel methods. However, these methods have a lower complexity compared to deep learning models…

Machine Learning · Computer Science 2023-05-05 Ahmad Navid Ghanizadeh , Kamaledin Ghiasi-Shirazi , Reza Monsefi , Mohammadreza Qaraei

Many similarity-based clustering methods work in two separate steps including similarity matrix computation and subsequent spectral clustering. However, similarity measurement is challenging because it is usually impacted by many factors,…

Machine Learning · Computer Science 2017-05-04 Zhao Kang , Chong Peng , Qiang Cheng

In multi-task learning several related tasks are considered simultaneously, with the hope that by an appropriate sharing of information across tasks, each task may benefit from the others. In the context of learning linear functions for…

Machine Learning · Computer Science 2008-09-12 Laurent Jacob , Francis Bach , Jean-Philippe Vert

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Simon Vandenhende

The performance of reproducing kernel Hilbert space-based methods is known to be sensitive to the choice of the reproducing kernel. Choosing an adequate reproducing kernel can be challenging and computationally demanding, especially in…

Machine Learning · Computer Science 2023-11-07 Emilio Ruiz-Moreno , Baltasar Beferull-Lozano

Combining information from various image features has become a standard technique in concept recognition tasks. However, the optimal way of fusing the resulting kernel functions is usually unknown in practical applications. Multiple kernel…

Computer Vision and Pattern Recognition · Computer Science 2012-11-26 Alexander Binder , Shinichi Nakajima , Marius Kloft , Christina Müller , Wojciech Samek , Ulf Brefeld , Klaus-Robert Müller , Motoaki Kawanabe

Deep convolution networks have proved very successful with big datasets such as the 1000-classes ImageNet. Results show that the error rate increases slowly as the size of the dataset increases. Experiments presented here may explain why…

Computer Vision and Pattern Recognition · Computer Science 2018-02-22 Mohamed Hajaj , Duncan Gillies

Quantum machine learning is considered one of the current research fields with immense potential. In recent years, Havl\'i\v{c}ek et al. [Nature 567, 209-212 (2019)] have proposed a quantum machine learning algorithm with quantum-enhanced…

Quantum Physics · Physics 2025-06-09 Chao Ding , Shi Wang , Yaonan Wang , Weibo Gao

Kernels for structured data are commonly obtained by decomposing objects into their parts and adding up the similarities between all pairs of parts measured by a base kernel. Assignment kernels are based on an optimal bijection between the…

Machine Learning · Computer Science 2019-08-20 Nils M. Kriege

Kernel methods have great promise for learning rich statistical representations of large modern datasets. However, compared to neural networks, kernel methods have been perceived as lacking in scalability and flexibility. We introduce a…

Machine Learning · Computer Science 2014-12-22 Zichao Yang , Alexander J. Smola , Le Song , Andrew Gordon Wilson

Quantum kernel methods, i.e., kernel methods with quantum kernels, offer distinct advantages as a hybrid quantum-classical approach to quantum machine learning (QML), including applicability to Noisy Intermediate-Scale Quantum (NISQ)…

Quantum Physics · Physics 2022-11-29 Daniel T. Chang