English
Related papers

Related papers: Cross-modal Deep Metric Learning with Multi-task R…

200 papers

Supervised contrastive learning has achieved remarkable success by leveraging label information; however, determining positive samples in multi-label scenarios remains a critical challenge. In multi-label supervised contrastive learning…

Machine Learning · Computer Science 2025-09-30 Guangming Huang , Yunfei Long , Cunjin Luo

Deep Metric Learning (DML) models often require strong local and global representations, however, effective integration of local and global features in DML model training is a challenge. DML models are often trained with specific loss…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Mohammad K. Ebrahimpour , Gang Qian , Allison Beach

Cross-modal retrieval aims to learn discriminative and modal-invariant features for data from different modalities. Unlike the existing methods which usually learn from the features extracted by offline networks, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Longlong Jing , Elahe Vahdani , Jiaxing Tan , Yingli Tian

Given the benefits of its low storage requirements and high retrieval efficiency, hashing has recently received increasing attention. In particular,cross-modal hashing has been widely and successfully used in multimedia similarity search…

Information Retrieval · Computer Science 2019-04-05 Cheng Deng , Zhaojia Chen , Xianglong Liu , Xinbo Gao , Dacheng Tao

With the advancement in technology and the expansion of broadcasting, cross-media retrieval has gained much attention. It plays a significant role in big data applications and consists in searching and finding data from different types of…

Information Retrieval · Computer Science 2020-08-05 Sadaqat ur Rehman , Muhammad Waqas , Shanshan Tu , Anis Koubaa , Obaid ur Rehman , Jawad Ahmad , Muhammad Hanif , Zhu Han

Contrastive learning (CL) has shown impressive advances in image representation learning in whichever supervised multi-class classification or unsupervised learning. However, these CL methods fail to be directly adapted to multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Zhongchen Ma , Lisha Li , Qirong Mao , Songcan Chen

Cross-modality distillation arises as an important topic for data modalities containing limited knowledge such as depth maps and high-quality sketches. Such techniques are of great importance, especially for memory and privacy-restricted…

Machine Learning · Computer Science 2024-05-29 Hangyu Lin , Chen Liu , Chengming Xu , Zhengqi Gao , Yanwei Fu , Yuan Yao

We propose a novel distance-based regularization method for deep metric learning called Multi-level Distance Regularization (MDR). MDR explicitly disturbs a learning procedure by regularizing pairwise distances between embedding vectors…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Yonghyun Kim , Wonpyo Park

Multi-modal Contrastive Representation learning aims to encode different modalities into a semantically aligned shared space. This paradigm shows remarkable generalization ability on numerous downstream tasks across various modalities.…

Machine Learning · Computer Science 2023-10-20 Zehan Wang , Yang Zhao , Xize Cheng , Haifeng Huang , Jiageng Liu , Li Tang , Linjun Li , Yongqi Wang , Aoxiong Yin , Ziang Zhang , Zhou Zhao

Compared with single-label image classification, multi-label image classification is more practical and challenging. Some recent studies attempted to leverage the semantic information of categories for improving multi-label image…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Fengtao Zhou , Sheng Huang , Yun Xing

Deep Learning (DL) is considered the state-of-the-art in computer vision, speech recognition and natural language processing. Until recently, it was also widely accepted that DL is irrelevant for learning tasks on tabular data, especially…

Machine Learning · Computer Science 2021-06-30 Karim Lounici , Katia Meziani , Benjamin Riu

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

The burgeoning volume of multi-modal data necessitates advanced retrieval paradigms beyond unimodal and cross-modal approaches. Composed Multi-modal Retrieval (CMR) emerges as a pivotal next-generation technology, enabling users to query…

Information Retrieval · Computer Science 2025-07-22 Kun Zhang , Jingyu Li , Zhe Li , Jingjing Zhang , Fan Li , Yandong Liu , Rui Yan , Zihang Jiang , Nan Chen , Lei Zhang , Yongdong Zhang , Zhendong Mao , S. Kevin Zhou

Deep Metric Learning (DML) plays a critical role in various machine learning tasks. However, most existing deep metric learning methods with binary similarity are sensitive to noisy labels, which are widely present in real-world data. Since…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Jiexi Yan , Lei Luo , Cheng Deng , Heng Huang

Distance metric learning (DML) is a critical factor for image analysis and pattern recognition. To learn a robust distance metric for a target task, we need abundant side information (i.e., the similarity/dissimilarity pairwise constraints…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yong Luo , Tongliang Liu , Dacheng Tao , Chao Xu

Deep Metric Learning (DML) methods have been proven relevant for visual similarity learning. However, they sometimes lack generalization properties because they are trained often using an inappropriate sample selection strategy or due to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jorge Gonzalez-Zapata , Ivan Reyes-Amezcua , Daniel Flores-Araiza , Mauricio Mendez-Ruiz , Gilberto Ochoa-Ruiz , Andres Mendez-Vazquez

The abundance of multimodal data (e.g. social media posts) has inspired interest in cross-modal retrieval methods. Popular approaches rely on a variety of metric learning losses, which prescribe what the proximity of image and text should…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Christopher Thomas , Adriana Kovashka

Matching information across image and text modalities is a fundamental challenge for many applications that involve both vision and natural language processing. The objective is to find efficient similarity metrics to compare the similarity…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Li Ren , Kai Li , LiQiang Wang , Kien Hua

Multi-label classification, which involves assigning multiple labels to a single input, has emerged as a key area in both research and industry due to its wide-ranging applications. Designing effective loss functions is crucial for…

Machine Learning · Computer Science 2025-01-06 Alexandre Audibert , Aurélien Gauffre , Massih-Reza Amini

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as…

Machine Learning · Statistics 2016-12-07 Tan Nguyen , Wanjia Liu , Ethan Perez , Richard G. Baraniuk , Ankit B. Patel