English
Related papers

Related papers: Mathematical Justification of Hard Negative Mining…

200 papers

Deep Metric Learning trains a neural network to map input images to a lower-dimensional embedding space such that similar images are closer together than dissimilar images. When used for item retrieval, a query image is embedded using the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Konstantin Kobs , Andreas Hotho

Visual Semantic Embedding (VSE) aims to extract the semantics of images and their descriptions, and embed them into the same latent space for cross-modal information retrieval. Most existing VSE networks are trained by adopting a hard…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Yan Gong , Georgina Cosma

Dropout Regularization, serving to reduce variance, is nearly ubiquitous in Deep Learning models. We explore the relationship between the dropout rate and model complexity by training 2,000 neural networks configured with random…

Machine Learning · Computer Science 2021-08-30 Christopher Sun , Jai Sharma , Milind Maiti

According to AdS/DL (Anti de Sitter/ Deep Learning) correspondence given by \cite{Has}, in this paper with a data-driven approach and leveraging holography principle we have designed an artificial neural network architecture to produce…

General Physics · Physics 2024-01-03 Emad Yaraie , Hossein Ghaffarnejad , Mohammad Farsam

In this paper, we propose a novel approach for implicit data representation to evaluate similarity of input data using a trained neural network. In contrast to the previous approach, which uses gradients for representation, we utilize only…

Machine Learning · Computer Science 2020-10-12 Alan Savushkin , Nikita Benkovich , Dmitry Golubev

Deep metric learning (DML) aims to minimize empirical expected loss of the pairwise intra-/inter- class proximity violations in the embedding space. We relate DML to feasibility problem of finite chance constraints. We show that minimizer…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yeti Z. Gurbuz , Ogul Can , A. Aydin Alatan

Metric learning aims to construct an embedding where two extracted features corresponding to the same identity are likely to be closer than features from different identities. This paper presents a method for learning such a feature space…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Nicolai Wojke , Alex Bewley

Deep metric learning is essential for visual recognition. The widely used pair-wise (or triplet) based loss objectives cannot make full use of semantical information in training samples or give enough attention to those hard samples during…

Computer Vision and Pattern Recognition · Computer Science 2019-03-22 Lin Xu , Han Sun , Yuai Liu

Hard negative mining has shown effective in enhancing self-supervised contrastive learning (CL) on diverse data types, including graph CL (GCL). The existing hardness-aware CL methods typically treat negative instances that are most similar…

Machine Learning · Computer Science 2024-01-09 Chaoxi Niu , Guansong Pang , Ling Chen

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

Graph contrastive learning (GCL) often suffers from false negatives, which degrades the performance on downstream tasks. The existing methods addressing the false negative issue usually rely on human prior knowledge, still leading GCL to…

Machine Learning · Computer Science 2025-05-16 Yiyang Zhao , Chengpei Wu , Lilin Zhang , Ning Yang

Metric learning from a set of triplet comparisons in the form of "Do you think item h is more similar to item i or item j?", indicating similarity and differences between items, plays a key role in various applications including image…

Machine Learning · Statistics 2025-08-07 Gokcan Tatli , Yi Chen , Blake Mason , Robert Nowak , Ramya Korlakai Vinayak

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

We employ triplet loss as a feature embedding regularizer to boost classification performance. Standard architectures, like ResNet and Inception, are extended to support both losses with minimal hyper-parameter tuning. This promotes…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

Despite significant progress made over the past twenty five years, unconstrained face verification remains a challenging problem. This paper proposes an approach that couples a deep CNN-based approach with a low-dimensional discriminative…

Computer Vision and Pattern Recognition · Computer Science 2017-01-19 Swami Sankaranarayanan , Azadeh Alavi , Carlos Castillo , Rama Chellappa

In this paper, we reveal that metric learning would suffer from serious inseparable problem if without informative sample mining. Since the inseparable samples are often mixed with hard samples, current informative sample mining strategies…

Machine Learning · Computer Science 2022-01-21 Kun Song , Junwei Han , Gong Cheng , Jiwen Lu , Feiping Nie

The optimization foundations of deep linear networks have recently received significant attention. However, due to their inherent non-convexity and hierarchical structure, analyzing the loss functions of deep linear networks remains a…

Optimization and Control · Mathematics 2025-09-24 Po Chen , Rujun Jiang , Peng Wang

Image classification is a fundamental computer vision task and an important baseline for deep metric learning. In decades efforts have been made on enhancing image classification accuracy by using deep learning models while less attention…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Yunfeng Zhao , Huiyu Zhou , Fei Wu , Xifeng Wu

Image matting is a fundamental computer vision problem and has many applications. Previous algorithms have poor performance when an image has similar foreground and background colors or complicated textures. The main reasons are prior…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Ning Xu , Brian Price , Scott Cohen , Thomas Huang

Metric and kernel learning are important in several machine learning applications. However, most existing metric learning algorithms are limited to learning metrics over low-dimensional data, while existing kernel learning algorithms are…

Machine Learning · Computer Science 2009-11-02 Prateek Jain , Brian Kulis , Jason V. Davis , Inderjit S. Dhillon