English
Related papers

Related papers: Deep Metric Learning with Density Adaptivity

200 papers

In metric learning, the goal is to learn an embedding so that data points with the same class are close to each other and data points with different classes are far apart. We propose a distance-ratio-based (DR) formulation for metric…

Machine Learning · Computer Science 2022-01-24 Hyeongji Kim , Pekka Parviainen , Ketil Malde

Active learning is commonly used to train label-efficient models by adaptively selecting the most informative queries. However, most active learning strategies are designed to either learn a representation of the data (e.g., embedding or…

Machine Learning · Computer Science 2022-02-07 Namrata Nadagouda , Austin Xu , Mark A. Davenport

Although much of the success of Deep Learning builds on learning good representations, a rigorous method to evaluate their quality is lacking. In this paper, we treat the evaluation of representations as a model selection problem and…

Machine Learning · Computer Science 2024-11-19 Yazhe Li , Jorg Bornschein , Marcus Hutter

Recent advances in deep learning have achieved impressive gains in classification accuracy on a variety of types of data, including images and text. Despite these gains, however, concerns have been raised about the calibration, robustness,…

Machine Learning · Computer Science 2018-11-20 Dallas Card , Michael Zhang , Noah A. Smith

Learning with few labeled data is a key challenge for visual recognition, as deep neural networks tend to overfit using a few samples only. One of the Few-shot learning methods called metric learning addresses this challenge by first…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Li Ke , Meng Pan , Weigao Wen , Dong Li

As deep learning methodologies have developed, it has been generally agreed that increasing neural network size improves model quality. However, this is at the expense of memory and compute requirements, which also need to be increased.…

Machine Learning · Computer Science 2024-08-07 Mitchelle Rasquinha , Gil Tabak

A key approach to state abstraction is approximating behavioral metrics (notably, bisimulation metrics) in the observation space and embedding these learned distances in the representation space. While promising for robustness to…

Machine Learning · Computer Science 2025-09-10 Ziyan Luo , Tianwei Ni , Pierre-Luc Bacon , Doina Precup , Xujie Si

We consider the problem of constructing embeddings of large attributed graphs and supporting multiple downstream learning tasks. We develop a graph embedding method, which is based on extending deep metric and unbiased contrastive learning…

Machine Learning · Computer Science 2024-11-22 Xiang Li , Gagan Agrawal , Ruoming Jin , Rajiv Ramnath

Deep Learning (DL) , a variant of the neural network algorithms originally proposed in the 1980s, has made surprising progress in Artificial Intelligence (AI), ranging from language translation, protein folding, autonomous cars, and more…

Artificial Intelligence · Computer Science 2023-07-24 Stephen Josè Hanson , Vivek Yadav , Catherine Hanson

Datasets with significant proportions of noisy (incorrect) class labels present challenges for training accurate Deep Neural Networks (DNNs). We propose a new perspective for understanding DNN generalization for such datasets, by…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Xingjun Ma , Yisen Wang , Michael E. Houle , Shuo Zhou , Sarah M. Erfani , Shu-Tao Xia , Sudanthi Wijewickrema , James Bailey

Deep Learning performs well when training data densely covers the experience space. For complex problems this makes data collection prohibitively expensive. We propose to intelligently select samples when constructing data sets in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mark Philip Philipsen , Thomas Baltzer Moeslund

Training deep networks that generalize to a wide range of variations in test data is essential to building accurate and robust image classifiers. One standard strategy is to apply data augmentation to synthetically enlarge the training set.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Yunhan Zhao , Ye Tian , Charless Fowlkes , Wei Shen , Alan Yuille

Recently, there has been a growing interest in applying machine learning methods to problems in engineering mechanics. In particular, there has been significant interest in applying deep learning techniques to predicting the mechanical…

Machine Learning · Computer Science 2023-03-15 Saeed Mohammadzadeh , Peerasait Prachaseree , Emma Lejeune

We investigate metric learning in the context of dynamic time warping (DTW), the by far most popular dissimilarity measure used for the comparison and analysis of motion capture data. While metric learning enables a problem-adapted…

Machine Learning · Computer Science 2019-03-13 Babak Hosseini , Barbara Hammer

The exponential growth in the number of complex datasets every year requires more enhancement in machine learning methods to provide robust and accurate data classification. Lately, deep learning approaches have achieved surpassing results…

Machine Learning · Computer Science 2018-10-22 Mojtaba Heidarysafa , Kamran Kowsari , Donald E. Brown , Kiana Jafari Meimandi , Laura E. Barnes

The goal of transfer learning is to improve the performance of target learning task by leveraging information (or transferring knowledge) from other related tasks. In this paper, we examine the problem of transfer distance metric learning…

Machine Learning · Statistics 2019-04-09 Yong Luo , Yonggang Wen , Tongliang Liu , Dacheng Tao

Deep metric learning has been widely applied in many computer vision tasks, and recently, it is more attractive in \emph{zero-shot image retrieval and clustering}(ZSRC) where a good embedding is requested such that the unseen classes can be…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Binghui Chen , Weihong Deng

The vast majority of Dimensionality Reduction (DR) techniques rely on second-order statistics to define their optimization objective. Even though this provides adequate results in most cases, it comes with several shortcomings. The methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Nikolaos Passalis , Anastasios Tefas

We study the problem of similarity learning and its application to image retrieval with large-scale data. The similarity between pairs of images can be measured by the distances between their high dimensional representations, and the…

Machine Learning · Computer Science 2015-12-08 Qi Qian , Inci M. Baytas , Rong Jin , Anil Jain , Shenghuo Zhu

Distributed machine learning (DML) over time-varying networks can be an enabler for emerging decentralized ML applications such as autonomous driving and drone fleeting. However, the commonly used weighted arithmetic mean model aggregation…

Machine Learning · Computer Science 2022-02-22 Haizhou Du , Ryan Yang , Yijian Chen , Qiao Xiang , Andre Wibisono , Wei Huang