English
Related papers

Related papers: Cluster-Level Contrastive Learning for Emotion Rec…

200 papers

In Emotion Recognition in Conversations (ERC), the emotions of target utterances are closely dependent on their context. Therefore, existing works train the model to generate the response of the target utterance, which aims to recognise…

Computation and Language · Computer Science 2023-05-30 Kailai Yang , Tianlin Zhang , Sophia Ananiadou

Contrastive learning (CL) aims to learn useful representation without relying on expert annotations in the context of medical image segmentation. Existing approaches mainly contrast a single positive vector (i.e., an augmentation of the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Chenyu You , Ruihan Zhao , Lawrence Staib , James S. Duncan

Speaker embeddings carry valuable emotion-related information, which makes them a promising resource for enhancing speech emotion recognition (SER), especially with limited labeled data. Traditionally, it has been assumed that emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-03 Ismail Rasim Ulgen , Zongyang Du , Carlos Busso , Berrak Sisman

State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data.…

Computation and Language · Computer Science 2024-05-13 Bowen Xing , Ivor W. Tsang

Neural networks exhibit severe brittleness to semantically irrelevant transformations. A mere 75ms electrocardiogram (ECG) phase shift degrades latent cosine similarity from 1.0 to 0.2, while sensor rotations collapse activity recognition…

Machine Learning · Computer Science 2025-11-20 Zhengyang Shen , Hua Tu , Mayue Shi

This paper aims to bridge the affective gap between image content and the emotional response of the viewer it elicits by using High-Level Concepts (HLCs). In contrast to previous work that relied solely on low-level features or used…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Afsheen Rafaqat Ali , Usman Shahid , Mohsen Ali , Jeffrey Ho

In this work, we aim to consider the application of contrastive learning in the scenario of the recommendation system adequately, making it more suitable for recommendation task. We propose a learning paradigm called supervised contrastive…

Information Retrieval · Computer Science 2022-04-20 Chun Yang

We present Cycle-Contrastive Learning (CCL), a novel self-supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Quan Kong , Wenpeng Wei , Ziwei Deng , Tomoaki Yoshinaga , Tomokazu Murakami

Existing Image-Text Sentiment Analysis (ITSA) methods may suffer from inconsistent intra-modal and inter-modal sentiment relationships. Therefore, we develop a method that balances before fusing to solve the issue of vision-language…

Multimedia · Computer Science 2026-02-25 Jiesheng Wu , Shengrong Li

The field of emotion recognition of conversation (ERC) has been focusing on separating sentence feature encoding and context modeling, lacking exploration in generative paradigms based on unified designs. In this study, we propose a novel…

Computation and Language · Computer Science 2024-08-30 Shanglin Lei , Guanting Dong , Xiaoping Wang , Keheng Wang , Runqi Qiao , Sirui Wang

State-of-the-art natural language understanding classification models follow two-stages: pre-training a large language model on an auxiliary task, and then fine-tuning the model on a task-specific labeled dataset using cross-entropy loss.…

Computation and Language · Computer Science 2021-04-06 Beliz Gunel , Jingfei Du , Alexis Conneau , Ves Stoyanov

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

Low-light image enhancement (LLE) remains challenging due to the unfavorable prevailing low-contrast and weak-visibility problems of single RGB images. In this paper, we respond to the intriguing learning-related question -- if leveraging…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Dong Liang , Ling Li , Mingqiang Wei , Shuo Yang , Liyan Zhang , Wenhan Yang , Yun Du , Huiyu Zhou

Existed pre-trained models have achieved state-of-the-art performance on various text classification tasks. These models have proven to be useful in learning universal language representations. However, the semantic discrepancy between…

Machine Learning · Computer Science 2022-01-07 Jinhe Lan , Qingyuan Zhan , Chenhao Jiang , Kunping Yuan , Desheng Wang

Biologically inspired spiking neural networks (SNNs) have garnered considerable attention due to their low-energy consumption and spatio-temporal information processing capabilities. Most existing SNNs training methods first integrate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Haonan Qiu , Zeyin Song , Yanqi Chen , Munan Ning , Wei Fang , Tao Sun , Zhengyu Ma , Li Yuan , Yonghong Tian

Efficiently capturing the complex spatiotemporal representations from large-scale unlabeled traffic data remains to be a challenging task. In considering of the dilemma, this work employs the advanced contrastive learning and proposes a…

Machine Learning · Computer Science 2023-12-19 Lincan Li , Kaixiang Yang , Fengji Luo , Jichao Bi

Emotion recognition based on electroencephalography (EEG) holds significant promise for affective brain-computer interfaces (aBCIs). However, its practical deployment faces challenges due to the variability within inter-subject and the…

Human-Computer Interaction · Computer Science 2025-09-25 Jiahao Tang , Youjun Li , Xiangting Fan , Yangxuan Zheng , Siyuan Lu , Xueping Li , Peng Fang , Chenxi Li , Zi-Gang Huang

Contrastive representation learning has proven to be an effective self-supervised learning method. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as positives that should be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault , Stéphane Canu

In this paper, we introduce MultiviewVLM, a vision-language model designed for unsupervised contrastive multiview representation learning of facial emotions from 3D/4D data. Our architecture integrates pseudo-labels derived from generated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Muzammil Behzad

We propose a framework for sequence-to-sequence contrastive learning (SeqCLR) of visual representations, which we apply to text recognition. To account for the sequence-to-sequence structure, each feature map is divided into different…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Aviad Aberdam , Ron Litman , Shahar Tsiper , Oron Anschel , Ron Slossberg , Shai Mazor , R. Manmatha , Pietro Perona