中文
相关论文

相关论文: Discriminative Representation learning via Attenti…

200 篇论文

As an exemplary self-supervised approach for representation learning, time-series contrastive learning has exhibited remarkable advancements in contemporary research. While recent contrastive learning strategies have focused on how to…

机器学习 · 计算机科学 2024-08-27 Xiyuan Jin , Jing Wang , Lei Liu , Youfang Lin

Contrastive representation learning has gained much attention due to its superior performance in learning representations from both image and sequential data. However, the learned representations could potentially lead to performance…

计算与语言 · 计算机科学 2022-11-01 Jianfeng Chi , William Shand , Yaodong Yu , Kai-Wei Chang , Han Zhao , Yuan Tian

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

The challenges in applying contrastive learning to speaker verification (SV) are that the softmax-based contrastive loss lacks discriminative power and that the hard negative pairs can easily influence learning. To overcome the first…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Zhe Li , Man-Wai Mak , Helen Mei-Ling Meng

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

机器学习 · 计算机科学 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

Implicit degradation modeling-based blind super-resolution (SR) has attracted more increasing attention in the community due to its excellent generalization to complex degradation scenarios and wide application range. How to extract more…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Jiang Yuan , Ji Ma , Bo Wang , Weiming Hu

Network representation learning seeks to embed networks into a low-dimensional space while preserving the structural and semantic properties, thereby facilitating downstream tasks such as classification, trait prediction, edge…

机器学习 · 统计学 2025-09-16 Zihan Dong , Xin Zhou , Ryumei Nakada , Lexin Li , Linjun Zhang

In this paper, we propose a one-stage online clustering method called Contrastive Clustering (CC) which explicitly performs the instance- and cluster-level contrastive learning. To be specific, for a given dataset, the positive and negative…

机器学习 · 计算机科学 2020-09-22 Yunfan Li , Peng Hu , Zitao Liu , Dezhong Peng , Joey Tianyi Zhou , Xi Peng

For a widely-studied data model and general loss and sample-hardening functions we prove that the losses of Supervised Contrastive Learning (SCL), Hard-SCL (HSCL), and Unsupervised Contrastive Learning (UCL) are minimized by representations…

机器学习 · 计算机科学 2025-05-08 Ruijie Jiang , Thuan Nguyen , Shuchin Aeron , Prakash Ishwar

Graph clustering is a crucial task in network analysis with widespread applications, focusing on partitioning nodes into distinct groups with stronger intra-group connections than inter-group ones. Recently, contrastive learning has…

机器学习 · 计算机科学 2024-08-20 Xunlian Wu , Jingqi Hu , Anqi Zhang , Yining Quan , Qiguang Miao , Peng Gang Sun

Fine-grained classification involves dealing with datasets with larger number of classes with subtle differences between them. Guiding the model to focus on differentiating dimensions between these commonly confusable classes is key to…

计算与语言 · 计算机科学 2021-09-14 Varsha Suresh , Desmond C. Ong

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

机器学习 · 计算机科学 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

Contrastive learning (CL) is a predominant technique in image classification, but they showed limited performance with an imbalanced dataset. Recently, several supervised CL methods have been proposed to promote an ideal regular simplex…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Sumin Roh , Harim Kim , Ho Yun Lee , Il Yong Chun

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Haojin Deng , Yimin Yang

Graphs model complex relationships between entities, with nodes and edges capturing intricate connections. Node representation learning involves transforming nodes into low-dimensional embeddings. These embeddings are typically used as…

机器学习 · 计算机科学 2024-11-04 Ying-Chun Lin , Jennifer Neville

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

In this paper, we propose a hierarchical contrastive learning framework, HiCL, which considers local segment-level and global sequence-level relationships to improve training efficiency and effectiveness. Traditional methods typically…

计算与语言 · 计算机科学 2023-10-17 Zhuofeng Wu , Chaowei Xiao , VG Vinod Vydiswaran

Continual relation extraction (CRE) aims to extract relations towards the continuous and iterative arrival of new data, of which the major challenge is the catastrophic forgetting of old tasks. In order to alleviate this critical problem…

信息检索 · 计算机科学 2022-10-11 Chengwei Hu , Deqing Yang , Haoliang Jin , Zhen Chen , Yanghua Xiao

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi