English
Related papers

Related papers: A Geometric Algorithm for Scalable Multiple Kernel…

200 papers

Kernels are powerful and versatile tools in machine learning and statistics. Although the notion of universal kernels and characteristic kernels has been studied, kernel selection still greatly influences the empirical performance. While…

Machine Learning · Statistics 2019-02-28 Chun-Liang Li , Wei-Cheng Chang , Youssef Mroueh , Yiming Yang , Barnabás Póczos

Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Mingyuan Jiu , Hichem Sahbi

Kernels are a fundamental technical primitive in machine learning. In recent years, kernel-based methods such as Gaussian processes are becoming increasingly important in applications where quantifying uncertainty is of key interest. In…

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy…

Machine Learning · Computer Science 2024-03-07 Rina Su , Yu Guo , Caiying Wu , Qiyu Jin , Tieyong Zeng

The kernel-based multi-scale method has been proven to be a powerful approximation method for scattered data approximation problems which is computationally superior to conventional kernel-based interpolation techniques. The multi-scale…

Numerical Analysis · Mathematics 2025-03-10 Federico Lot , Christian Rieger

We investigate a series of learning kernel problems with polynomial combinations of base kernels, which will help us solve regression and classification problems. We also perform some numerical experiments of polynomial kernels with…

Machine Learning · Computer Science 2017-12-27 Chen Li , Luca Venturi , Ruitu Xu

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

In this paper, we show two new variants of multi-view k-means (MVKM) algorithms to address multi-view data. The general idea is to outline the distance between $h$-th view data points $x_i^h$ and $h$-th view cluster centers $a_k^h$ in a…

Machine Learning · Computer Science 2024-05-17 Kristina P. Sinaga

In this paper, we present a novel method for solving multiobjective linear programming problems (MOLPP) that overcomes the need to calculate the optimal value of each objective function. This method is a follow-up to our previous work on…

Optimization and Control · Mathematics 2024-07-02 Mustapha Kaci , Sonia Radjef

This paper proposes new algorithms for the metric learning problem. We start by noticing that several classical metric learning formulations from the literature can be viewed as modified covariance matrix estimation problems. Leveraging…

Machine Learning · Statistics 2022-11-23 Antoine Collas , Arnaud Breloy , Guillaume Ginolhac , Chengfang Ren , Jean-Philippe Ovarlez

We consider the problem of metric learning subject to a set of constraints on relative-distance comparisons between the data items. Such constraints are meant to reflect side-information that is not expressed directly in the feature vectors…

Machine Learning · Computer Science 2016-12-06 Ehsan Amid , Aristides Gionis , Antti Ukkonen

Multiple kernel clustering (MKC) is committed to achieving optimal information fusion from a set of base kernels. Constructing precise and local kernel matrices is proved to be of vital significance in applications since the unreliable…

Machine Learning · Computer Science 2022-07-08 Liang Li , Siwei Wang , Xinwang Liu , En Zhu , Li Shen , Kenli Li , Keqin Li

Computing a consensus object from a set of given objects is a core problem in machine learning and pattern recognition. One popular approach is to formulate it as an optimization problem using the generalized median. Previous methods like…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Andreas Nienkötter , Xiaoyi Jiang

Financial services is a prospect industry where unlocked near-term quantum utility could yield profitable potential, and, in particular, quantum machine learning algorithms could potentially benefit businesses by improving the quality of…

We analytically derive the geometrical structure of the weight space in multilayer neural networks (MLN), in terms of the volumes of couplings associated to the internal representations of the training set. Focusing on the parity and…

Condensed Matter · Physics 2016-08-31 R. Monasson , R. Zecchina

Modal linear regression (MLR) is a method for obtaining a conditional mode predictor as a linear model. We study kernel selection for MLR from two perspectives: "which kernel achieves smaller error?" and "which kernel is computationally…

Machine Learning · Statistics 2020-01-31 Ryoya Yamasaki , Toshiyuki Tanaka

Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite…

Machine Learning · Computer Science 2024-07-31 Nathael Da Costa , Cyrus Mostajeran , Juan-Pablo Ortega , Salem Said

The rate of convergence of weighted kernel herding (WKH) and sequential Bayesian quadrature (SBQ), two kernel-based sampling algorithms for estimating integrals with respect to some target probability measure, is investigated. Under…

Machine Learning · Statistics 2021-11-02 Rajiv Khanna , Liam Hodgkinson , Michael W. Mahoney

The use of geometric and symmetry techniques in quantum and classical information processing has a long tradition across the physical sciences as a means of theoretical discovery and applied problem solving. In the modern era, the emergent…

Quantum Physics · Physics 2024-09-10 Elija Perrier

Conventional vision algorithms adopt a single type of feature or a simple concatenation of multiple features, which is always represented in a high-dimensional space. In this paper, we propose a novel unsupervised spectral embedding…

Computer Vision and Pattern Recognition · Computer Science 2015-08-05 Mengyang Yu , Li Liu , Ling Shao