中文
相关论文

相关论文: Sparsity-accuracy trade-off in MKL

200 篇论文

We investigate the learning rate of multiple kernel learning (MKL) with $\ell_1$ and elastic-net regularizations. The elastic-net regularization is a composition of an $\ell_1$-regularizer for inducing the sparsity and an…

机器学习 · 统计学 2013-08-27 Taiji Suzuki , Masashi Sugiyama

Multiple kernel learning (MKL), structured sparsity, and multi-task learning have recently received considerable attention. In this paper, we show how different MKL algorithms can be understood as applications of either regularization on…

机器学习 · 统计学 2011-03-03 Ryota Tomioka , Taiji Suzuki

We theoretically investigate the convergence rate and support consistency (i.e., correctly identifying the subset of non-zero coefficients in the large sample limit) of multiple kernel learning (MKL). We focus on MKL with block-l1…

机器学习 · 统计学 2011-07-29 Taiji Suzuki , Ryota Tomioka , Masashi Sugiyama

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and…

机器学习 · 计算机科学 2010-10-28 Marius Kloft , Ulf Brefeld , Soeren Sonnenburg , Alexander Zien

We investigate the learning rate of multiple kernel leaning (MKL) with elastic-net regularization, which consists of an $\ell_1$-regularizer for inducing the sparsity and an $\ell_2$-regularizer for controlling the smoothness. We focus on a…

机器学习 · 统计学 2011-07-14 Taiji Suzuki , Ryota Tomioka , Masashi Sugiyama

Multiple Kernel Learning (MKL) models combine several kernels in supervised and unsupervised settings to integrate multiple data representations or sources, each represented by a different kernel. MKL seeks an optimal linear combination of…

The problem of multiple kernel learning based on penalized empirical risk minimization is discussed. The complexity penalty is determined jointly by the empirical $L_2$ norms and the reproducing kernel Hilbert space (RKHS) norms induced by…

统计理论 · 数学 2012-11-14 Vladimir Koltchinskii , Ming Yuan

This papers introduces an algorithm for the solution of multiple kernel learning (MKL) problems with elastic-net constraints on the kernel weights. The algorithm compares very favourably in terms of time and space complexity to existing…

机器学习 · 统计学 2019-04-08 Luca Citi

In this paper, we give a new generalization error bound of Multiple Kernel Learning (MKL) for a general class of regularizations, and discuss what kind of regularization gives a favorable predictive accuracy. Our main target in this paper…

机器学习 · 统计学 2011-11-17 Taiji Suzuki

In this paper, we study the problem of sparse multiple kernel learning (MKL), where the goal is to efficiently learn a combination of a fixed small number of kernels from a large pool that could lead to a kernel classifier with a small…

机器学习 · 计算机科学 2013-02-05 Rong Jin , Tianbao Yang , Mehrdad Mahdavi

We study Sparse Multiple Kernel Learning (SMKL), which is the problem of selecting a sparse convex combination of prespecified kernels for support vector binary classification. Unlike prevailing l1 regularized approaches that approximate a…

机器学习 · 统计学 2025-12-03 Dimitris Bertsimas , Caio de Prospero Iglesias , Nicholas A. G. Johnson

Multiple kernel learning (MKL) method is generally believed to perform better than single kernel method. However, some empirical studies show that this is not always true: the combination of multiple kernels may even yield an even worse…

机器学习 · 统计学 2018-06-21 Zhao Kang , Xiao Lu , Jinfeng Yi , Zenglin Xu

Multiple Kernel Learning(MKL) on Support Vector Machines(SVMs) has been a popular front of research in recent times due to its success in application problems like Object Categorization. This success is due to the fact that MKL has the…

机器学习 · 计算机科学 2014-01-03 Dinesh Govindaraj , Raman Sankaran , Sreedal Menon , Chiranjib Bhattacharyya

Multiple kernel learning (MKL) algorithms combine different base kernels to obtain a more efficient representation in the feature space. Focusing on discriminative tasks, MKL has been used successfully for feature selection and finding the…

机器学习 · 计算机科学 2019-03-14 Babak Hosseini , Barbara Hammer

We provide a general framework for characterizing the trade-off between accuracy and robustness in supervised learning. We propose a method and define quantities to characterize the trade-off between accuracy and robustness for a given…

机器学习 · 计算机科学 2025-05-26 Zhun Deng , Cynthia Dwork , Jialiang Wang , Yao Zhao

Sparse neural networks are highly desirable in deep learning in reducing its complexity. The goal of this paper is to study how choices of regularization parameters influence the sparsity level of learned neural networks. We first derive…

机器学习 · 计算机科学 2024-08-07 Lixin Shen , Rui Wang , Yuesheng Xu , Mingsong Yan

In this paper we propose a new non-linear classifier based on a combination of locally linear classifiers. A well known optimization formulation is given as we cast the problem in a $\ell_1$ Multiple Kernel Learning (MKL) problem using many…

机器学习 · 计算机科学 2024-01-19 David Picard

We present a geometric formulation of the Multiple Kernel Learning (MKL) problem. To do so, we reinterpret the problem of learning kernel weights as searching for a kernel that maximizes the minimum (kernel) distance between two convex…

机器学习 · 计算机科学 2014-03-18 John Moeller , Parasaran Raman , Avishek Saha , Suresh Venkatasubramanian

Many applications of representation learning, such as privacy preservation, algorithmic fairness, and domain adaptation, desire explicit control over semantic information being discarded. This goal is formulated as satisfying two…

机器学习 · 计算机科学 2022-12-26 Bashir Sadeghi , Sepehr Dehdashtian , Vishnu Boddeti

Combining information from different sources is a common way to improve classification accuracy in Brain-Computer Interfacing (BCI). For instance, in small sample settings it is useful to integrate data from other subjects or sessions in…

机器学习 · 统计学 2013-10-24 Wojciech Samek , Alexander Binder , Klaus-Robert Müller
‹ 上一页 1 2 3 10 下一页 ›