中文
相关论文

相关论文: Beyond Expression Similarity: Contrastive Learning…

200 篇论文

Contrastive self-supervised learning based on point-wise comparisons has been widely studied for vision tasks. In the visual cortex of the brain, neuronal responses to distinct stimulus classes are organized into geometric structures known…

机器学习 · 计算机科学 2026-01-06 Guanming Zhang , David J. Heeger , Stefano Martiniani

The analysis of correlations of amino acid occurrences in globular proteins has led to the development of statistical tools that can identify native contacts -- portions of the chains that come to close distance in folded structural…

生物大分子 · 定量生物学 2014-07-28 Rocío Espada , R. Gonzalo Parra , Thierry Mora , Aleksandra M. Walczak , Diego Ferreiro

As one of the most intuitive interfaces known to humans, natural language has the potential to mediate many tasks that involve human-computer interaction, especially in application-focused fields like Music Information Retrieval. In this…

声音 · 计算机科学 2022-08-26 Ilaria Manco , Emmanouil Benetos , Elio Quinton , György Fazekas

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

计算与语言 · 计算机科学 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Data augmentation is a crucial component in unsupervised contrastive learning (CL). It determines how positive samples are defined and, ultimately, the quality of the learned representation. In this work, we open the door to new…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Benoit Dufumier , Carlo Alberto Barbano , Robin Louiset , Edouard Duchesnay , Pietro Gori

Contrastive learning has become a popular approach in natural language processing, particularly for the learning of sentence embeddings. However, the discrete nature of natural language makes it difficult to ensure the quality of positive…

计算与语言 · 计算机科学 2023-05-23 Qinyuan Cheng , Xiaogui Yang , Tianxiang Sun , Linyang Li , Xipeng Qiu

Self-supervised learning aims to learn a embedding space where semantically similar samples are close. Contrastive learning methods pull views of samples together and push different samples away, which utilizes semantic invariance of…

机器学习 · 计算机科学 2023-02-17 Lu Han , Han-Jia Ye , De-Chuan Zhan

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Modern neural recording techniques such as two-photon imaging or Neuropixel probes allow to acquire vast time-series datasets with responses of hundreds or thousands of neurons. Contrastive learning is a powerful self-supervised framework…

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

In this work, we tackle the challenging problem of arbitrary image style transfer using a novel style feature representation learning method. A suitable style representation, as a key component in image stylization tasks, is essential to…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Yuxin Zhang , Fan Tang , Weiming Dong , Haibin Huang , Chongyang Ma , Tong-Yee Lee , Changsheng Xu

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

In recent years, several unsupervised, "contrastive" learning algorithms in vision have been shown to learn representations that perform remarkably well on transfer tasks. We show that this family of algorithms maximizes a lower bound on…

机器学习 · 计算机科学 2020-06-08 Mike Wu , Chengxu Zhuang , Milan Mosse , Daniel Yamins , Noah Goodman

Unsupervised cell type identification is crucial for uncovering and characterizing heterogeneous populations in single cell omics studies. Although a range of clustering methods have been developed, most focus exclusively on intrinsic…

人工智能 · 计算机科学 2025-12-12 Liang Peng , Haopeng Liu , Yixuan Ye , Cheng Liu , Wenjun Shen , Si Wu , Hau-San Wong

Visual emotion recognition (VER) is a longstanding field that has garnered increasing attention with the advancement of deep neural networks. Although recent studies have achieved notable improvements by leveraging the knowledge embedded…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Daiqing Wu , Dongbao Yang , Yu Zhou , Can Ma

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

计算与语言 · 计算机科学 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Contrastive learning constitutes an emerging branch of self-supervised learning that leverages large amounts of unlabeled data, by learning a latent space, where pairs of different views of the same sample are associated. In this paper, we…

音频与语音处理 · 电气工程与系统科学 2023-05-12 Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Contrastive learning has shown to learn better quality representations than models trained using cross-entropy loss. They also transfer better to downstream datasets from different domains. However, little work has been done to explore the…

计算机视觉与模式识别 · 计算机科学 2023-09-28 Alvin De Jun Tan , Clement Tan , Chai Kiat Yeo

Self-supervised learning, especially contrastive learning, has made an outstanding contribution to the development of many deep learning research fields. Recently, researchers in the acoustic signal processing field noticed its success and…

声音 · 计算机科学 2022-04-05 Dong Yao , Zhou Zhao , Shengyu Zhang , Jieming Zhu , Yudong Zhu , Rui Zhang , Xiuqiang He

Cross-domain offline reinforcement learning leverages source domain data with diverse transition dynamics to alleviate the data requirement for the target domain. However, simply merging the data of two domains leads to performance…

机器学习 · 计算机科学 2024-05-13 Xiaoyu Wen , Chenjia Bai , Kang Xu , Xudong Yu , Yang Zhang , Xuelong Li , Zhen Wang