English
Related papers

Related papers: Random Forests for Metric Learning with Implicit P…

200 papers

The learning of appropriate distance metrics is a critical problem in image classification and retrieval. In this work, we propose a boosting-based technique, termed \BoostMetric, for learning a Mahalanobis distance metric. One of the…

Computer Vision and Pattern Recognition · Computer Science 2009-10-14 Chunhua Shen , Junae Kim , Lei Wang , Anton van den Hengel

Standard supervised learning procedures are validated against a test set that is assumed to have come from the same distribution as the training data. However, in many problems, the test data may have come from a different distribution. We…

Machine Learning · Statistics 2019-08-28 Tim Coleman , Kimberly Kaufeld , Mary Frances Dorn , Lucas Mentch

Random forests are a statistical learning method widely used in many areas of scientific research because of its ability to learn complex relationships between input and output variables and also its capacity to handle high-dimensional…

Machine Learning · Statistics 2024-02-19 Louis Capitaine , Jérémie Bigot , Rodolphe Thiébaut , Robin Genuer

Online metric learning has been widely applied in classification and retrieval. It can automatically learn a suitable metric from data by restricting similar instances to be separated from dissimilar instances with a given margin. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Wenbin Li , Yanfang Liu , Jing Huo , Yinghuan Shi , Yang Gao , Lei Wang , Jiebo Luo

Machine Learning has attracted considerable attention throughout the past decade due to its potential to solve far-reaching tasks, such as image classification, object recognition, anomaly detection, and data forecasting. A standard…

Machine Learning · Computer Science 2022-02-09 Gustavo Henrique de Rosa , Mateus Roder , João Paulo Papa

Random Forests (RF) is a popular machine learning method for classification and regression problems. It involves a bagging application to decision tree models. One of the primary advantages of the Random Forests model is the reduction in…

Machine Learning · Statistics 2022-07-06 Sai K Popuri

Deep semi-supervised learning has been widely implemented in the real-world due to the rapid development of deep learning. Recently, attention has shifted to the approaches such as Mean-Teacher to penalize the inconsistency between two…

Machine Learning · Statistics 2020-04-30 Sanyou Wu , Xingdong Feng , Fan Zhou

Many researches have been devoted to learn a Mahalanobis distance metric, which can effectively improve the performance of kNN classification. Most approaches are iterative and computational expensive and linear rigidity still critically…

Machine Learning · Computer Science 2013-11-14 Jianbo Ye

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

For many data mining and machine learning tasks, the quality of a similarity measure is the key for their performance. To automatically find a good similarity measure from datasets, metric learning and similarity learning are proposed and…

Machine Learning · Computer Science 2021-04-16 Dezhong Yao , Peilin Zhao , Chen Yu , Hai Jin , Bin Li

This work briefly explores the possibility of approximating spatial distance (alternatively, similarity) between data points using the Isolation Forest method envisioned for outlier detection. The logic is similar to that of isolation: the…

Machine Learning · Statistics 2019-11-26 David Cortes

Random forest (RF) stands out as a highly favored machine learning approach for classification problems. The effectiveness of RF hinges on two key factors: the accuracy of individual trees and the diversity among them. In this study, we…

Machine Learning · Computer Science 2024-10-28 Ye-eun Kim , Seoung Yun Kim , Hyunjoong Kim

Metric learning aims to embed one metric space into another to benefit tasks like classification and clustering. Although a greatly distorted metric space has a high degree of freedom to fit training data, it is prone to overfitting and…

Machine Learning · Computer Science 2015-05-12 Renjie Liao , Jianping Shi , Ziyang Ma , Jun Zhu , Jiaya Jia

We propose novel model transfer-learning methods that refine a decision forest model M learned within a "source" domain using a training set sampled from a "target" domain, assumed to be a variation of the source. We present two random…

Machine Learning · Computer Science 2018-05-01 Noam Segev , Maayan Harel , Shie Mannor , Koby Crammer , Ran El-Yaniv

It was recently demonstrated that two machine-learning architectures, reservoir computing and time-delayed feed-forward neural networks, can be exploited for detecting the Earth's anomaly magnetic field immersed in overwhelming complex…

Signal Processing · Electrical Eng. & Systems 2024-05-30 Mohammadamin Moradi , Zheng-Meng Zhai , Aaron Nielsen , Ying-Cheng Lai

Metric learning from a set of triplet comparisons in the form of "Do you think item h is more similar to item i or item j?", indicating similarity and differences between items, plays a key role in various applications including image…

Machine Learning · Statistics 2025-08-07 Gokcan Tatli , Yi Chen , Blake Mason , Robert Nowak , Ramya Korlakai Vinayak

Distance metric learning is of fundamental interest in machine learning because the distance metric employed can significantly affect the performance of many learning methods. Quadratic Mahalanobis metric learning is a popular approach to…

Machine Learning · Computer Science 2013-02-15 Chunhua Shen , Junae Kim , Fayao Liu , Lei Wang , Anton van den Hengel

The success of many machine learning and pattern recognition methods relies heavily upon the identification of an appropriate distance metric on the input data. It is often beneficial to learn such a metric from the input training data,…

Computer Vision and Pattern Recognition · Computer Science 2015-03-19 Chunhua Shen , Junae Kim , Lei Wang , Anton van den Hengel

We propose a method for transfer learning in nonparametric regression using a random forest (RF) with distance covariance-based feature weights, assuming the unknown source and target regression functions are sparsely different. Our method…

Machine Learning · Statistics 2026-03-17 Chenze Li , Subhadeep Paul

A common practice in metric learning is to train and test an embedding model for each dataset. This dataset-specific approach fails to simulate real-world scenarios that involve multiple heterogeneous distributions of data. In this regard,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Sungyeon Kim , Donghyun Kim , Suha Kwak