English
Related papers

Related papers: $\ell_p$-Norm Multiple Kernel One-Class Fisher Nul…

200 papers

In this paper we propose a novel metric learning framework called Nullspace Kernel Maximum Margin Metric Learning (NK3ML) which efficiently addresses the small sample size (SSS) problem inherent in person re-identification and offers a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 T M Feroz Ali , Subhasis Chaudhuri

Financial services is a prospect industry where unlocked near-term quantum utility could yield profitable potential, and, in particular, quantum machine learning algorithms could potentially benefit businesses by improving the quality of…

Reinforcement Learning (RL) has shown great empirical success in various application domains. The theoretical aspects of the problem have been extensively studied over past decades, particularly under tabular and linear Markov Decision…

Machine Learning · Computer Science 2024-06-24 Sattar Vakili

Face Recognition (FR) has been the interest to several researchers over the past few decades due to its passive nature of biometric authentication. Despite high accuracy achieved by face recognition algorithms under controlled conditions,…

Computer Vision and Pattern Recognition · Computer Science 2016-10-05 Samik Banerjee , Sukhendu Das

The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Statistics 2024-10-30 Aleksandr Talitckii , Brendon K. Colbert , Matthew M. Peet

Learning representations of nodes in a low dimensional space is a crucial task with numerous interesting applications in network analysis, including link prediction, node classification, and visualization. Two popular approaches for this…

Social and Information Networks · Computer Science 2022-08-10 Abdulkadir Celikkanat , Yanning Shen , Fragkiskos D. Malliaros

We introduce a new neural network-based continual learning algorithm, dubbed as Uncertainty-regularized Continual Learning (UCL), which builds on traditional Bayesian online learning framework with variational inference. We focus on two…

Machine Learning · Computer Science 2019-11-15 Hongjoon Ahn , Sungmin Cha , Donggyu Lee , Taesup Moon

In this paper, we extend the methodology developed for Support Vector Machines (SVM) using $\ell_2$-norm ($\ell_2$-SVM) to the more general case of $\ell_p$-norms with $p\ge 1$ ($\ell_p$-SVM). The resulting primal and dual problems are…

Optimization and Control · Mathematics 2021-01-12 Víctor Blanco , Justo Puerto , Antonio M. Rodríguez-Chía

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural network (NN)…

Machine Learning · Computer Science 2020-12-09 Jinseok Nam , Jungi Kim , Eneldo Loza Mencía , Iryna Gurevych , Johannes Fürnkranz

Continual learning (CL) learns a sequence of tasks incrementally. This paper studies the challenging CL setting of class-incremental learning (CIL). CIL has two key challenges: catastrophic forgetting (CF) and inter-task class separation…

Machine Learning · Computer Science 2024-12-23 Saleh Momeni , Sahisnu Mazumder , Bing Liu

In this paper we study the kernel multiple ridge regression framework, which we refer to as multi-task regression, using penalization techniques. The theoretical analysis of this problem shows that the key element appearing for an optimal…

Statistics Theory · Mathematics 2012-10-25 Matthieu Solnon , Sylvain Arlot , Francis Bach

This paper addresses distributed learning of a complex object for multiple networked robots based on distributed optimization and kernel-based support vector machine. In order to overcome a fundamental limitation of polynomial kernels…

Robotics · Computer Science 2024-12-17 Toshiyuki Oshima , Junya Yamauchi , Tatsuya Ibuki , Michio Seto , Takeshi Hatanaka

Multi-task learning is a natural approach for computer vision applications that require the simultaneous solution of several distinct but related problems, e.g. object detection, classification, tracking of multiple agents, or denoising, to…

Machine Learning · Computer Science 2015-04-14 Carlo Ciliberto , Lorenzo Rosasco , Silvia Villa

Non-negative Matrix Factorization(NMF) algorithm can only be used to find low rank approximation of original non-negative data while Concept Factorization(CF) algorithm extends matrix factorization to single non-linear kernel space,…

Machine Learning · Computer Science 2024-10-29 Fei Li , Liang Du , Chaohong Ren

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

Machine Learning · Statistics 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

In this paper, a novel framework of sparse kernel learning for Support Vector Data Description (SVDD) based anomaly detection is presented. In this work, optimal sparse feature selection for anomaly detection is first modeled as a Mixed…

Machine Learning · Computer Science 2015-06-09 Zhimin Peng , Prudhvi Gurram , Heesung Kwon , Wotao Yin

We provide new general kernel selection rules thanks to penalized least-squares criteria. We derive optimal oracle inequalities using adequate concentration tools. We also investigate the problem of minimal penalty as described in [BM07].

Statistics Theory · Mathematics 2015-11-09 M Lerasle , N Magalhães , P Reynaud-Bouret

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy…

Machine Learning · Computer Science 2024-03-07 Rina Su , Yu Guo , Caiying Wu , Qiyu Jin , Tieyong Zeng

In statistical machine learning, kernel methods allow to consider infinite dimensional feature spaces with a computational cost that only depends on the number of observations. This is usually done by solving an optimization problem…

Optimization and Control · Mathematics 2019-01-17 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa