English
Related papers

Related papers: Face-to-Face Contrastive Learning for Social Intel…

200 papers

Computer vision algorithms, e.g. for face recognition, favour groups of individuals that are better represented in the training data. This happens because of the generalization that classifiers have to make. It is simpler to fit the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Viktoriia Sharmanska , Lisa Anne Hendricks , Trevor Darrell , Novi Quadrianto

Multi-task learning is an effective learning strategy for deep-learning-based facial expression recognition tasks. However, most existing methods take into limited consideration the feature selection, when transferring information between…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Rui Zhao , Tianshan Liu , Jun Xiao , Daniel P. K. Lun , Kin-Man Lam

The end-to-end speech translation (E2E-ST) model has gradually become a mainstream paradigm due to its low latency and less error propagation. However, it is non-trivial to train such a model well due to the task complexity and data…

Computation and Language · Computer Science 2023-04-21 Hao Zhang , Nianwen Si , Yaqi Chen , Wenlin Zhang , Xukui Yang , Dan Qu , Wei-Qiang Zhang

Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words. Most previous work applies a dual-encoder structure to separately encode image and text, but fails…

Computation and Language · Computer Science 2024-03-12 Ming Zhang , Ke Chang , Yunfang Wu

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

Machine Learning · Computer Science 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng

In this paper, we propose a one-stage online clustering method called Contrastive Clustering (CC) which explicitly performs the instance- and cluster-level contrastive learning. To be specific, for a given dataset, the positive and negative…

Machine Learning · Computer Science 2020-09-22 Yunfan Li , Peng Hu , Zitao Liu , Dezhong Peng , Joey Tianyi Zhou , Xi Peng

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Face analysis tasks have a wide range of applications, but the universal facial representation has only been explored in a few works. In this paper, we explore high-performance pre-training methods to boost the face analysis tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yue Wang , Jinlong Peng , Jiangning Zhang , Ran Yi , Liang Liu , Yabiao Wang , Chengjie Wang

Contrastive learning is a discriminative approach that aims at grouping similar samples closer and diverse samples far from each other. It it an efficient technique to train an encoder generating distinguishable and informative…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Qing Chen , Jian Zhang

In terms of human-computer interaction, it is becoming more and more important to correctly understand the user's emotional state in a conversation, so the task of multimodal emotion recognition (MER) started to receive more attention.…

Computation and Language · Computer Science 2024-01-04 Wei Ai , FuChen Zhang , Tao Meng , YunTao Shou , HongEn Shao , Keqin Li

Federated learning (FL) provides a decentralized machine learning paradigm where a server collaborates with a group of clients to learn a global model without accessing the clients' data. User heterogeneity is a significant challenge for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jiangming Shi , Shanshan Zheng , Xiangbo Yin , Yang Lu , Yuan Xie , Yanyun Qu

Contrastive pretraining is well-known to improve downstream task performance and model generalisation, especially in limited label settings. However, it is sensitive to the choice of augmentation pipeline. Positive pairs should preserve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Melanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Modern self-supervised learning algorithms typically enforce persistency of instance representations across views. While being very effective on learning holistic image and video representations, such an objective becomes sub-optimal for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Liangzhe Yuan , Rui Qian , Yin Cui , Boqing Gong , Florian Schroff , Ming-Hsuan Yang , Hartwig Adam , Ting Liu

Face recognition systems are present in many modern solutions and thousands of applications in our daily lives. However, current solutions are not easily scalable, especially when it comes to the addition of new targeted people. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Paulo R C Mendes , Antonio J G Busson , Sérgio Colcher , Daniel Schwabe , Álan L V Guedes , Carlos Laufer

Federated learning (FL) facilitates a privacy-preserving neural network training paradigm through collaboration between edge clients and a central server. One significant challenge is that the distributed data is not independently and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yu Qiao , Huy Q. Le , Mengchun Zhang , Apurba Adhikary , Chaoning Zhang , Choong Seon Hong

Graph Neural Networks (GNNs) are powerful learning methods for recommender systems owing to their robustness in handling complicated user-item interactions. Recently, the integration of contrastive learning with GNNs has demonstrated…

Machine Learning · Computer Science 2024-08-12 Junfeng Long , Hao Wu

Automated deception detection (ADD) from real-life videos is a challenging task. It specifically needs to address two problems: (1) Both face and body contain useful cues regarding whether a subject is deceptive. How to effectively fuse the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Mingyu Ding , An Zhao , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos