English
Related papers

Related papers: Self-Supervised Predictive Learning: A Negative-Fr…

200 papers

Self-supervised visual pretraining has shown significant progress recently. Among those methods, SimCLR greatly advanced the state of the art in self-supervised and semi-supervised learning on ImageNet. The input feature representations for…

Computation and Language · Computer Science 2021-07-06 Dongwei Jiang , Wubo Li , Miao Cao , Wei Zou , Xiangang Li

Recently, contrastive learning has largely advanced the progress of unsupervised visual representation learning. Pre-trained on ImageNet, some self-supervised algorithms reported higher transfer learning performance compared to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Longhui Wei , Lingxi Xie , Jianzhong He , Jianlong Chang , Xiaopeng Zhang , Wengang Zhou , Houqiang Li , Qi Tian

Sound source localization (SSL) technology plays a crucial role in various application areas such as fault diagnosis, speech separation, and vibration noise reduction. Although beamforming algorithms are widely used in SSL, their resolution…

Sound · Computer Science 2024-10-01 Wenbo Ma , Yan Lu , Yijun Liu

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

This article is a survey on deep learning methods for single and multiple sound source localization. We are particularly interested in sound source localization in indoor/domestic environment, where reverberation and diffuse noise are…

Sound · Computer Science 2022-07-20 Pierre-Amaury Grumiaux , Srđan Kitić , Laurent Girin , Alexandre Guérin

Large-scale pre-trained Vision Language Models (VLMs) have proven effective for zero-shot classification. Despite the success, most traditional VLMs-based methods are restricted by the assumption of partial source supervision or ideal…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Sheng Zhang , Muzammal Naseer , Guangyi Chen , Zhiqiang Shen , Salman Khan , Kun Zhang , Fahad Khan

Recent studies on learning-based sound source localization have mainly focused on the localization performance perspective. However, prior work and existing benchmarks overlook a crucial aspect: cross-modal interaction, which is essential…

Multimedia · Computer Science 2024-07-19 Arda Senocak , Hyeonggon Ryu , Junsik Kim , Tae-Hyun Oh , Hanspeter Pfister , Joon Son Chung

Acoustic matching aims to re-synthesize an audio clip to sound as if it were recorded in a target acoustic environment. Existing methods assume access to paired training data, where the audio is observed in both source and target…

Multimedia · Computer Science 2023-11-27 Arjun Somayazulu , Changan Chen , Kristen Grauman

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Purpose: Surgical scene understanding is key to advancing computer-aided and intelligent surgical systems. Current approaches predominantly rely on visual data or end-to-end learning, which limits fine-grained contextual modeling. This work…

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two…

Machine Learning · Computer Science 2019-11-20 Qian Wang , Toby P. Breckon

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Significant progress has been made in self-supervised image denoising (SSID) in the recent few years. However, most methods focus on dealing with spatially independent noise, and they have little practicality on real-world sRGB images with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Junyi Li , Zhilu Zhang , Xiaoyu Liu , Chaoyu Feng , Xiaotao Wang , Lei Lei , Wangmeng Zuo

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

Machine Learning · Computer Science 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Visual place recognition (VPR) using deep networks has achieved state-of-the-art performance. However, most of them require a training set with ground truth sensor poses to obtain positive and negative samples of each observation's spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Chao Chen , Zegang Cheng , Xinhao Liu , Yiming Li , Li Ding , Ruoyu Wang , Chen Feng

Currently, learning better unsupervised sentence representations is the pursuit of many natural language processing communities. Lots of approaches based on pre-trained language models (PLMs) and contrastive learning have achieved promising…

Computation and Language · Computer Science 2023-05-11 Nuo Chen , Linjun Shou , Ming Gong , Jian Pei , Bowen Cao , Jianhui Chang , Daxin Jiang , Jia Li

Domain adaptive person re-identification (re-ID) is a challenging task due to the large discrepancy between the source domain and the target domain. To reduce the domain discrepancy, existing methods mainly attempt to generate pseudo labels…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Junhui Yin , Jiayan Qiu , Siqing Zhang , Zhanyu Ma , Jun Guo

Alleviating noisy pseudo labels remains a key challenge in Semi-Supervised Temporal Action Localization (SS-TAL). Existing methods often filter pseudo labels based on strict conditions, but they typically assess classification and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Feixiang Zhou , Bryan Williams , Hossein Rahmani

Visual place recognition (VPR) is a fundamental task of computer vision for visual localization. Existing methods are trained using image pairs that either depict the same place or not. Such a binary indication does not consider continuous…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Maria Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov