English
Related papers

Related papers: Joint Generalized Cosine Similarity: A Novel Metho…

200 papers

Recent studies have demonstrated that gradient matching-based dataset synthesis, or dataset condensation (DC), methods can achieve state-of-the-art performance when applied to data-efficient learning tasks. However, in this study, we prove…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Saehyung Lee , Sanghyuk Chun , Sangwon Jung , Sangdoo Yun , Sungroh Yoon

The performance of state-of-the-art neural rankers can deteriorate substantially when exposed to noisy inputs or applied to a new domain. In this paper, we present a novel method for fine-tuning neural rankers that can significantly improve…

Information Retrieval · Computer Science 2021-06-01 Xiaofei Ma , Cicero Nogueira dos Santos , Andrew O. Arnold

Recommender systems guide users through vast amounts of information by suggesting items based on their predicted preferences. Collaborative filtering-based deep learning techniques have regained popularity due to their straightforward…

Machine Learning · Computer Science 2024-09-11 Makbule Gulcin Ozsoy

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Bi'an Du , Xiang Gao , Wei Hu , Xin Li

Cross entropy loss has served as the main objective function for classification-based tasks. Widely deployed for learning neural network classifiers, it shows both effectiveness and a probabilistic interpretation. Recently, after the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Rahaf Aljundi , Yash Patel , Milan Sulc , Daniel Olmeda , Nikolay Chumerin

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Graph Contrastive Learning (GCL) has emerged as a powerful tool for extracting consistent representations from graphs, independent of labeled information. However, existing methods predominantly focus on undirected graphs, disregarding the…

Machine Learning · Computer Science 2025-10-21 Daohan Su , Yang Zhang , Xunkai Li , Rong-Hua Li , Guoren Wang

Recent studies have demonstrated the superior performance of introducing ``scan-wise" contrast labels into contrastive learning for multi-organ segmentation on multi-phase computed tomography (CT). However, such scan-wise labels are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ho Hin Lee , Yucheng Tang , Han Liu , Yubo Fan , Leon Y. Cai , Qi Yang , Xin Yu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

This study proposes a novel hybrid retrieval strategy for Retrieval-Augmented Generation (RAG) that integrates cosine similarity and cosine distance measures to improve retrieval performance, particularly for sparse data. The traditional…

Information Retrieval · Computer Science 2024-06-05 Kush Juvekar , Anupam Purwar

The development of unsupervised hashing is advanced by the recent popular contrastive learning paradigm. However, previous contrastive learning-based works have been hampered by (1) insufficient data similarity mining based on global-only…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Jiaguo Yu , Huming Qiu , Dubing Chen , Haofeng Zhang

Nowadays, cross-modal retrieval plays an indispensable role to flexibly find information across different modalities of data. Effectively measuring the similarity between different modalities of data is the key of cross-modal retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-17 Yuxin Peng , Jinwei Qi , Yuxin Yuan

The impressive performance of GPT-3 using natural language prompts and in-context learning has inspired work on better fine-tuning of moderately-sized models under this paradigm. Following this line of work, we present a contrastive…

Computation and Language · Computer Science 2022-05-04 Yiren Jian , Chongyang Gao , Soroush Vosoughi

Recently, deep metric learning techniques received attention, as the learned distance representations are useful to capture the similarity relationship among samples and further improve the performance of various of supervised or…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Zhiyuan Li , Anca Ralescu

Language-supervised vision models have recently attracted great attention in computer vision. A common approach to build such models is to use contrastive learning on paired data across the two modalities, as exemplified by Contrastive…

Machine Learning · Computer Science 2023-03-16 Ryumei Nakada , Halil Ibrahim Gulluk , Zhun Deng , Wenlong Ji , James Zou , Linjun Zhang

The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature. These methods contrast semantically similar and…

Machine Learning · Computer Science 2022-06-03 Ganqu Cui , Yufeng Du , Cheng Yang , Jie Zhou , Liang Xu , Xing Zhou , Xingyi Cheng , Zhiyuan Liu

Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning…

Computation and Language · Computer Science 2023-06-06 John Wieting , Jonathan H. Clark , William W. Cohen , Graham Neubig , Taylor Berg-Kirkpatrick

To improve the detection accuracy and generalization of steganalysis, this paper proposes the Steganalysis Contrastive Framework (SCF) based on contrastive learning. The SCF improves the feature representation of steganalysis by maximizing…

Artificial Intelligence · Computer Science 2021-03-02 Yanzhen Ren , Yiwen Liu , Lina Wang

Cross-modal retrieval is the task of retrieving samples of a given modality by using queries of a different one. Due to the wide range of practical applications, the problem has been mainly focused on the vision and language case, e.g. text…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jorge Sánchez , Rodrigo Laguna

With the advent of big data across multiple high-impact applications, we are often facing the challenge of complex heterogeneity. The newly collected data usually consist of multiple modalities and are characterized with multiple labels,…

Machine Learning · Computer Science 2022-07-27 Lecheng Zheng , Jinjun Xiong , Yada Zhu , Jingrui He

Several automatic approaches for objective music performance assessment (MPA) have been proposed in the past, however, existing systems are not yet capable of reliably predicting ratings with the same accuracy as professional judges. This…

Sound · Computer Science 2021-08-16 Pavan Seshadri , Alexander Lerch