English
Related papers

Related papers: Self-supervised Contrastive Learning for Audio-Vis…

200 papers

Deep learning-based AMC methods have achieved remarkable performance, but their practical deployment remains constrained by the high cost of labeled data. Although self-supervised learning (SSL) reduces the reliance on labels, existing…

Signal Processing · Electrical Eng. & Systems 2026-05-13 Chenxu Wang , Shuang Wang , Lirong Han , Xinyu Hu , Hanlin Mo , Hantong Xing , Licheng Jiao

Vein recognition has received increasing attention due to its high security and privacy. Recently, deep neural networks such as Convolutional neural networks (CNN) and Transformers have been introduced for vein recognition and achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Huafeng Qin , Yiquan Wu , Mounim A. El-Yacoubi , Jun Wang , Guangxiang Yang

In this paper, we present a novel approach to the audio-visual video parsing (AVVP) task that demarcates events from a video separately for audio and visual modalities. The proposed parsing approach simultaneously detects the temporal…

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Associating sound and its producer in complex audiovisual scene is a challenging task, especially when we are lack of annotated training data. In this paper, we present a flexible audiovisual model that introduces a soft-clustering module…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Di Hu , Zheng Wang , Haoyi Xiong , Dong Wang , Feiping Nie , Dejing Dou

Self-Supervised Learning (SSL) is a new paradigm for learning discriminative representations without labelled data and has reached comparable or even state-of-the-art results in comparison to supervised counterparts. Contrastive Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Shohreh Deldari , Hao Xue , Aaqib Saeed , Daniel V. Smith , Flora D. Salim

Action recognition and detection in the context of long untrimmed video sequences has seen an increased attention from the research community. However, annotation of complex activities is usually time consuming and challenging in practice.…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Sirnam Swetha , Hilde Kuehne , Yogesh S Rawat , Mubarak Shah

This paper is concerned with contrastive learning (CL) for low-level image restoration and enhancement tasks. We propose a new label-efficient learning paradigm based on residuals, residual contrastive learning (RCL), and derive an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Nanqing Dong , Matteo Maggioni , Yongxin Yang , Eduardo Pérez-Pellitero , Ales Leonardis , Steven McDonagh

Self-supervised contrastive learning has demonstrated great potential in learning visual representations. Despite their success in various downstream tasks such as image classification and object detection, self-supervised pre-training for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Di Wu , Siyuan Li , Zelin Zang , Stan Z. Li

In this paper, we first extend the recent Masked Auto-Encoder (MAE) model from a single modality to audio-visual multi-modalities. Subsequently, we propose the Contrastive Audio-Visual Masked Auto-Encoder (CAV-MAE) by combining contrastive…

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

Machine Learning · Computer Science 2022-05-03 Ralph Peeters , Christian Bizer

Contrastive learning has gained significant attention in short text clustering, yet it has an inherent drawback of mistakenly identifying samples from the same category as negatives and then separating them in the feature space (false…

Machine Learning · Computer Science 2026-03-16 Zhihao Yao

A good clustering algorithm can discover natural groupings in data. These groupings, if used wisely, provide a form of weak supervision for learning representations. In this work, we present Clustering-based Contrastive Learning (CCL), a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

Video object detection is a challenging task because videos often suffer from image deterioration such as motion blur, occlusion, and deformable shapes, making it significantly more difficult than detecting objects in still images. Prior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Lucas Rakotoarivony

Foundation models for vision have transformed visual recognition with powerful pretrained representations and strong zero-shot capabilities, yet their potential for data-efficient learning remains largely untapped. Active Learning (AL) aims…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huy Hoang Nguyen , Cédric Jung , Shirin Salehi , Tobias Glück , Anke Schmeink , Andreas Kugi

Existing adversarial learning approaches mostly use class labels to generate adversarial samples that lead to incorrect predictions, which are then used to augment the training of the model for improved robustness. While some recent works…

Machine Learning · Computer Science 2020-10-27 Minseon Kim , Jihoon Tack , Sung Ju Hwang

Robust detection of moving vehicles is a critical task for any autonomously operating outdoor robot or self-driving vehicle. Most modern approaches for solving this task rely on training image-based detectors using large-scale vehicle…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Jannik Zürn , Wolfram Burgard

Language-supervised vision models have recently attracted great attention in computer vision. A common approach to build such models is to use contrastive learning on paired data across the two modalities, as exemplified by Contrastive…

Machine Learning · Computer Science 2023-03-16 Ryumei Nakada , Halil Ibrahim Gulluk , Zhun Deng , Wenlong Ji , James Zou , Linjun Zhang

The recent success in human action recognition with deep learning methods mostly adopt the supervised learning paradigm, which requires significant amount of manually labeled data to achieve good performance. However, label collection is an…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Junnan Li , Yongkang Wong , Qi Zhao , Mohan S. Kankanhalli

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das