English
Related papers

Related papers: Joint Generalized Cosine Similarity: A Novel Metho…

200 papers

In recent times, contrastive learning based loss functions have become increasingly popular for visual self-supervised representation learning owing to their state-of-the-art (SOTA) performance. Most of the modern contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chaitanya Animesh , Manmohan Chandraker

Hash coding has been widely used in the approximate nearest neighbor search for large-scale image retrieval. Recently, many deep hashing methods have been proposed and shown largely improved performance over traditional…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Zheng Zhang , Qin Zou , Yuewei Lin , Long Chen , Song Wang

Cross-lingual summarization (CLS) is a sophisticated branch in Natural Language Processing that demands models to accurately translate and summarize articles from different source languages. Despite the improvement of the subsequent…

Computation and Language · Computer Science 2024-11-27 Sanzana Karim Lora , M. Sohel Rahman , Rifat Shahriyar

Image-Text Retrieval (ITR) is challenging in bridging visual and lingual modalities. Contrastive learning has been adopted by most prior arts. Except for limited amount of negative image-text pairs, the capability of constrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Wang , Dongliang He , Wenhao Wu , Boyang Xia , Min Yang , Fu Li , Yunlong Yu , Zhong Ji , Errui Ding , Jingdong Wang

In deep regression, capturing the relationship among continuous labels in feature space is a fundamental challenge that has attracted increasing interest. Addressing this issue can prevent models from converging to suboptimal solutions…

Machine Learning · Computer Science 2025-01-14 Botao Zhao , Xiaoyang Qu , Zuheng Kang , Junqing Peng , Jing Xiao , Jianzong Wang

Contrastive learning has achieved promising performance in the field of multi-view clustering recently. However, the positive and negative sample construction mechanisms ignoring semantic consistency lead to false negative pairs, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Siwen Liu , Jinyan Liu , Hanning Yuan , Qi Li , Jing Geng , Ziqiang Yuan , Huaxu Han

A deep hashing model typically has two main learning objectives: to make the learned binary hash codes discriminative and to minimize a quantization error. With further constraints such as bit balance and code orthogonality, it is not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Jiun Tian Hoe , Kam Woh Ng , Tianyu Zhang , Chee Seng Chan , Yi-Zhe Song , Tao Xiang

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

Hard negative mining has shown effective in enhancing self-supervised contrastive learning (CL) on diverse data types, including graph CL (GCL). The existing hardness-aware CL methods typically treat negative instances that are most similar…

Machine Learning · Computer Science 2024-01-09 Chaoxi Niu , Guansong Pang , Ling Chen

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

Computation and Language · Computer Science 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Contrastive deep graph clustering, which aims to divide nodes into disjoint groups via contrastive mechanisms, is a challenging research spot. Among the recent works, hard sample mining-based algorithms have achieved great attention for…

Machine Learning · Computer Science 2023-01-31 Yue Liu , Xihong Yang , Sihang Zhou , Xinwang Liu , Zhen Wang , Ke Liang , Wenxuan Tu , Liang Li , Jingcan Duan , Cancan Chen

Machine unlearning, the efficient deletion of the impact of specific data in a trained model, remains a challenging problem. Current machine unlearning approaches that focus primarily on data-centric or weight-based strategies frequently…

Machine Learning · Computer Science 2025-08-07 Thang Duc Tran , Thai Hoang Le

Recently, seismic facies classification based on convolutional neural networks (CNN) has garnered significant research interest. However, existing CNN-based supervised learning approaches necessitate massive labeled data. Labeling is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Kewen Li , Wenlong Liu , Yimin Dou , Zhifeng Xu , Hongjie Duan , Ruilin Jing

Lesion detection is a fundamental problem in the computer-aided diagnosis scheme for mammography. The advance of deep learning techniques have made a remarkable progress for this task, provided that the training data are large and…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Zheren Li , Zhiming Cui , Sheng Wang , Yuji Qi , Xi Ouyang , Qitian Chen , Yuezhi Yang , Zhong Xue , Dinggang Shen , Jie-Zhi Cheng

To date, most existing self-supervised learning methods are designed and optimized for image classification. These pre-trained models can be sub-optimal for dense prediction tasks due to the discrepancy between image-level prediction and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Xinlong Wang , Rufeng Zhang , Chunhua Shen , Tao Kong , Lei Li

Humans perceive the world through multisensory integration, blending the information of different modalities to adapt their behavior. Contrastive learning offers an appealing solution for multimodal self-supervised learning. Indeed, by…

Machine Learning · Computer Science 2025-03-06 Benoit Dufumier , Javiera Castillo-Navarro , Devis Tuia , Jean-Philippe Thiran

Pose-estimation methods enable extracting human motion from common videos in the structured form of 3D skeleton sequences. Despite great application opportunities, effective content-based access to such spatio-temporal motion data is a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Nicola Messina , Jan Sedmidubsky , Fabrizio Falchi , Tomáš Rebok

Graph contrastive learning (GCL) aligns node representations by classifying node pairs into positives and negatives using a selection process that typically relies on establishing correspondences within two augmented graphs. The…

Machine Learning · Computer Science 2024-11-27 Maysam Behmanesh , Maks Ovsjanikov

Lyrics alignment gained considerable attention in recent years. State-of-the-art systems either re-use established speech recognition toolkits, or design end-to-end solutions involving a Connectionist Temporal Classification (CTC) loss.…

Sound · Computer Science 2023-06-14 Simon Durand , Daniel Stoller , Sebastian Ewert

As medical diagnoses increasingly leverage multimodal data, machine learning models are expected to effectively fuse heterogeneous information while remaining robust to missing modalities. In this work, we propose a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yi Gu , Kuniaki Saito , Jiaxin Ma