English
Related papers

Related papers: Distance Metric Learning for Kernel Machines

200 papers

Support Vector Machines (SVMs) are powerful learners that have led to state-of-the-art results in various computer vision problems. SVMs suffer from various drawbacks in terms of selecting the right kernel, which depends on the image…

Computer Vision and Pattern Recognition · Computer Science 2014-03-31 Gemma Roig , Xavier Boix , Luc Van Gool

The distance metric plays an important role in nearest neighbor (NN) classification. Usually the Euclidean distance metric is assumed or a Mahalanobis distance metric is optimized to improve the NN performance. In this paper, we study the…

Machine Learning · Statistics 2007-06-26 Bharath K. Sriperumbudur , Gert R. G. Lanckriet

In this paper, we revamp the forgotten classical Semi-Supervised Distance Metric Learning (SSDML) problem from a Riemannian geometric lens, to leverage stochastic optimization within a end-to-end deep framework. The motivation comes from…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Ujjal Kr Dutta , Mehrtash Harandi , Chellu Chandra Sekhar

Most existing metric learning methods focus on learning a similarity or distance measure relying on similar and dissimilar relations between sample pairs. However, pairs of samples cannot be simply identified as similar or dissimilar in…

Machine Learning · Computer Science 2020-08-19 Lifeng Gu

In recent years, we have witnessed a surge of interests in learning a suitable distance metric from weakly supervised data. Most existing methods aim to pull all the similar samples closer while push the dissimilar ones as far as possible.…

Machine Learning · Computer Science 2021-02-05 Huiyuan Deng , Xiangzhu Meng , Lin Feng

We present a new approach to obtaining photometric redshifts using a kernel learning technique called Support Vector Machines (SVMs). Unlike traditional spectral energy distribution fitting, this technique requires a large and…

Astrophysics · Physics 2009-11-10 Yogesh Wadadekar

We present an approximation scheme for support vector machine models that use an RBF kernel. A second-order Maclaurin series approximation is used for exponentials of inner products between support vectors and test instances. The…

Machine Learning · Statistics 2014-10-06 Marc Claesen , Frank De Smet , Johan A. K. Suykens , Bart De Moor

The need for appropriate ways to measure the distance or similarity between data is ubiquitous in machine learning, pattern recognition and data mining, but handcrafting such good metrics for specific problems is generally difficult. This…

Machine Learning · Computer Science 2019-01-25 Aurélien Bellet , Amaury Habrard , Marc Sebban

Support vector machines (SVMs) have been successful in solving many computer vision tasks including image and video category recognition especially for small and mid-scale training problems. The principle of these non-parametric models is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Hichem Sahbi

The objective of this study is to investigate the efficient determination of $C$ and $\gamma$ for Support Vector Regression with RBF or mahalanobis kernel based on numerical and statistician considerations, which indicates the connection…

Machine Learning · Computer Science 2015-06-15 Longfei Lu

Metric learning has been shown to be highly effective to improve the performance of nearest neighbor classification. In this paper, we address the problem of metric learning for Symmetric Positive Definite (SPD) matrices such as covariance…

Machine Learning · Computer Science 2015-02-13 Florian Yger , Masashi Sugiyama

Support vector machine (SVM) is one of the most studied paradigms in the realm of machine learning for classification and regression problems. It relies on vectorized input data. However, a significant portion of the real-world data exists…

Machine Learning · Computer Science 2023-10-31 Anuradha Kumari , Mushir Akhtar , Rupal Shah , M. Tanveer

Metric learning is an important family of algorithms for classification and similarity search, but the robustness of learned metrics against small adversarial perturbations is less studied. In this paper, we show that existing metric…

Machine Learning · Computer Science 2020-12-22 Lu Wang , Xuanqing Liu , Jinfeng Yi , Yuan Jiang , Cho-Jui Hsieh

Support vector machines (SVM) and other kernel techniques represent a family of powerful statistical classification methods with high accuracy and broad applicability. Because they use all or a significant portion of the training data,…

Machine Learning · Statistics 2023-01-31 Peter Mills

Quantum machine learning (QML) has witnessed immense progress recently, with quantum support vector machines (QSVMs) emerging as a promising model. This paper focuses on the two existing QSVM methods: quantum kernel SVM (QK-SVM) and quantum…

Quantum Physics · Physics 2024-02-02 Nouhaila Innan , Muhammad Al-Zafar Khan , Biswaranjan Panda , Mohamed Bennai

Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is…

Machine Learning · Computer Science 2021-02-16 Thomas Kobber Panum , Zi Wang , Pengyu Kan , Earlence Fernandes , Somesh Jha

In nonparametric classification and regression problems, regularized kernel methods, in particular support vector machines, attract much attention in theoretical and in applied statistics. In an abstract sense, regularized kernel methods…

Machine Learning · Statistics 2011-04-13 Robert Hable

Support vector machines (SVM) can classify data sets along highly non-linear decision boundaries because of the kernel-trick. This expressiveness comes at a price: During test-time, the SVM classifier needs to compute the kernel…

Machine Learning · Computer Science 2015-02-03 Zhixiang Xu , Jacob R. Gardner , Stephen Tyree , Kilian Q. Weinberger

We consider the problem of metric learning subject to a set of constraints on relative-distance comparisons between the data items. Such constraints are meant to reflect side-information that is not expressed directly in the feature vectors…

Machine Learning · Computer Science 2016-12-06 Ehsan Amid , Aristides Gionis , Antti Ukkonen

The primary aim of this paper is to comprehend, assess, and analyze the role, relevance, and efficiency of machine learning models in predicting heart disease risks using clinical data. While the importance of heart disease risk prediction…

Machine Learning · Computer Science 2024-10-22 Balaji Shesharao Ingole , Vishnu Ramineni , Nikhil Bangad , Koushik Kumar Ganeeb , Priyankkumar Patel