English
Related papers

Related papers: SoftTriple Loss: Deep Metric Learning Without Trip…

200 papers

Deep Metric Learning (DML) models often require strong local and global representations, however, effective integration of local and global features in DML model training is a challenge. DML models are often trained with specific loss…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Mohammad K. Ebrahimpour , Gang Qian , Allison Beach

Deep neural networks trained using a softmax layer at the top and the cross-entropy loss are ubiquitous tools for image classification. Yet, this does not naturally enforce intra-class similarity nor inter-class margin of the learned deep…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 José Lezama , Qiang Qiu , Pablo Musé , Guillermo Sapiro

In this paper, we reveal that metric learning would suffer from serious inseparable problem if without informative sample mining. Since the inseparable samples are often mixed with hard samples, current informative sample mining strategies…

Machine Learning · Computer Science 2022-01-21 Kun Song , Junwei Han , Gong Cheng , Jiwen Lu , Feiping Nie

Distance metric learning (DML) is an important task that has found applications in many domains. The high computational cost of DML arises from the large number of variables to be determined and the constraint that a distance metric has to…

Machine Learning · Computer Science 2013-04-05 Qi Qian , Rong Jin , Jinfeng Yi , Lijun Zhang , Shenghuo Zhu

Deep Metric Learning (DML) is helpful in computer vision tasks. In this paper, we firstly introduce DML into image co-segmentation. We propose a novel Triplet loss for Image Segmentation, called IS-Triplet loss for short, and combine it…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Zhengwen Li , Xiabi Liu

We attribute the vulnerability of natural language processing models to the fact that similar inputs are converted to dissimilar representations in the embedding space, leading to inconsistent outputs, and we propose a novel robust training…

Computation and Language · Computer Science 2022-07-28 Yichen Yang , Xiaosen Wang , Kun He

This paper presents a deep relational metric learning (DRML) framework for image clustering and retrieval. Most existing deep metric learning methods learn an embedding space with a general objective of increasing interclass distances and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Wenzhao Zheng , Borui Zhang , Jiwen Lu , Jie Zhou

Deep metric learning seeks to define an embedding where semantically similar images are embedded to nearby locations, and semantically dissimilar images are embedded to distant locations. Substantial work has focused on loss functions and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Hong Xuan , Abby Stylianou , Robert Pless

Deep Metric Learning (DML) aims to learn representation spaces on which semantic relations can simply be expressed through predefined distance metrics. Best performing approaches commonly leverage class proxies as sample stand-ins for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Karsten Roth , Oriol Vinyals , Zeynep Akata

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and removing duplicates, which risks the loss of valuable…

Computation and Language · Computer Science 2024-07-10 Nan He , Weichen Xiong , Hanwen Liu , Yi Liao , Lei Ding , Kai Zhang , Guohua Tang , Xiao Han , Wei Yang

Metric learning algorithms aim to learn a distance function that brings the semantically similar data items together and keeps dissimilar ones at a distance. The traditional Mahalanobis distance learning is equivalent to find a linear…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Karrar Al-Kaabi , Reza Monsefi , Davood Zabihzadeh

Deep Metric Learning (DML) methods aim at learning an embedding space in which distances are closely related to the inherent semantic similarity of the inputs. Previous studies have shown that popular benchmark datasets often contain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Oriol Barbany , Xiaofan Lin , Muhammet Bastan , Arnab Dhua

Modern image retrieval systems increasingly rely on the use of deep neural networks to learn embedding spaces in which distance encodes the relevance between a given query and image. In this setting, existing approaches tend to emphasize…

Machine Learning · Computer Science 2020-11-18 Andreas Veit , Kimberly Wilber

Building robust deterministic neural networks remains a challenge. On the one hand, some approaches improve out-of-distribution detection at the cost of reducing classification accuracy in some situations. On the other hand, some methods…

Machine Learning · Computer Science 2022-08-09 David Macêdo , Cleber Zanchettin , Teresa Ludermir

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

In deep metric learning, the Triplet Loss has emerged as a popular method to learn many computer vision and natural language processing tasks such as facial recognition, object detection, and visual-semantic embeddings. One issue that…

Machine Learning · Computer Science 2022-10-21 Albert Xu , Jhih-Yi Hsieh , Bhaskar Vundurthy , Eliana Cohen , Howie Choset , Lu Li

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

When incrementally trained on new classes, deep neural networks are subject to catastrophic forgetting which leads to an extreme deterioration of their performance on the old classes while learning the new ones. Using a small memory…

Machine Learning · Computer Science 2022-11-15 Quentin Jodelet , Xin Liu , Tsuyoshi Murata

The deep metric learning (DML) objective is to learn a neural network that maps into an embedding space where similar data are near and dissimilar data are far. However, conventional proxy-based losses for DML have two problems: gradient…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Shozo Saeki , Minoru Kawahara , Hirohisa Aman

Deep learning models have become increasingly useful in many different industries. On the domain of image classification, convolutional neural networks proved the ability to learn robust features for the closed set problem, as shown in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rafael S. Pereira , Alexis Joly , Patrick Valduriez , Fabio Porto