English
Related papers

Related papers: Contrastive Learning with Cross-Modal Knowledge Mi…

200 papers

A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is an expensive task, unsupervised and semi-supervised learning…

Machine Learning · Computer Science 2022-02-03 Yash Jain , Chi Ian Tang , Chulhong Min , Fahim Kawsar , Akhil Mathur

We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following research questions: (i) How transferable are general-domain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Shuvendu Roy , Yasaman Parhizkar , Franklin Ogidi , Vahid Reza Khazaie , Michael Colacci , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

In skeleton-based human activity understanding, existing methods often adopt the contrastive learning paradigm to construct a discriminative feature space. However, many of these approaches fail to exploit the structural inter-class…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Hongda Liu , Yunfan Liu , Min Ren , Lin Sui , Yunlong Wang , Zhenan Sun

Complex data mining has wide application value in many fields, especially in the feature extraction and classification tasks of unlabeled data. This paper proposes an algorithm based on self-supervised learning and verifies its…

Machine Learning · Computer Science 2025-04-08 Yingbin Liang , Lu Dai , Shuo Shi , Minghao Dai , Junliang Du , Haige Wang

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Real-world decision-making often begins with identifying which modality contains the most relevant information for a given query. While recent multimodal models have made impressive progress in processing diverse inputs, it remains unclear…

Multimodal emotion recognition plays a key role in many domains, including mental health monitoring, educational interaction, and human-computer interaction. However, existing methods often face three major challenges: unbalanced category…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Feng Li , Ke Wu , Yongwei Li

Contrastive learning has achieved promising performance in the field of multi-view clustering recently. However, the positive and negative sample construction mechanisms ignoring semantic consistency lead to false negative pairs, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Siwen Liu , Jinyan Liu , Hanning Yuan , Qi Li , Jing Geng , Ziqiang Yuan , Huaxu Han

We present an approach to learn voice-face representations from the talking face videos, without any identity labels. Previous works employ cross-modal instance discrimination tasks to establish the correlation of voice and face. These…

Sound · Computer Science 2022-05-30 Boqing Zhu , Kele Xu , Changjian Wang , Zheng Qin , Tao Sun , Huaimin Wang , Yuxing Peng

Humans view the world through many sensory channels, e.g., the long-wavelength light channel, viewed by the left eye, or the high-frequency vibrations channel, heard by the right ear. Each view is noisy and incomplete, but important…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Yonglong Tian , Dilip Krishnan , Phillip Isola

Cross-modal contrastive distillation has recently been explored for learning effective 3D representations. However, existing methods focus primarily on modality-shared features, neglecting the modality-specific features during the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yifan Zhang , Junhui Hou

Visual modality is the most vulnerable to privacy leakage in real-world multimodal applications like autonomous driving with visual and radar data; Machine unlearning removes specific training data from pre-trained models to address privacy…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jinghan Xu Yuyang Zhang Qixuan Cai Jiancheng Chen Keqiu Li

Continual learning aims to learn knowledge of tasks observed in sequential time steps while mitigating the forgetting of previously learned knowledge. Existing methods were designed to learn a single modality (e.g., image) over time, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Hyundong Jin , Eunwoo Kim

Implementing cross-modal hashing between 2D images and 3D point-cloud data is a growing concern in real-world retrieval systems. Simply applying existing cross-modal approaches to this new task fails to adequately capture latent multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Rukai Wei , Heng Cui , Yu Liu , Yufeng Hou , Yanzhao Xie , Ke Zhou

With the prevalence of RGB-D cameras, multi-modal video data have become more available for human action recognition. One main challenge for this task lies in how to effectively leverage their complementary information. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Sijie Song , Jiaying Liu , Yanghao Li , Zongming Guo

Language-supervised vision models have recently attracted great attention in computer vision. A common approach to build such models is to use contrastive learning on paired data across the two modalities, as exemplified by Contrastive…

Machine Learning · Computer Science 2023-03-16 Ryumei Nakada , Halil Ibrahim Gulluk , Zhun Deng , Wenlong Ji , James Zou , Linjun Zhang

Sensory input from multiple sources is crucial for robust and coherent human perception. Different sources contribute complementary explanatory factors. Similarly, research studies often collect multimodal imaging data, each of which can…

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Quantifying and evaluating image complexity can be instrumental in enhancing the performance of various computer vision tasks. Supervised learning can effectively learn image complexity features from well-annotated datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shipeng Liu , Liang Zhao , Dengfeng Chen , Zhanping Song