English
Related papers

Related papers: Regularized Contrastive Pre-training for Few-shot …

200 papers

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

Existing contrastive learning methods for anomalous sound detection refine the audio representation of each audio sample by using the contrast between the samples' augmentations (e.g., with time or frequency masking). However, they might be…

Sound · Computer Science 2023-04-11 Jian Guan , Feiyang Xiao , Youde Liu , Qiaoxi Zhu , Wenwu Wang

In this paper we present our system for the detection and classification of acoustic scenes and events (DCASE) 2020 Challenge Task 4: Sound event detection and separation in domestic environments. We introduce two new models: the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-12 Janek Ebbers , Reinhold Haeb-Umbach

Sound event detection is a core module for acoustic environmental analysis. Semi-supervised learning technique allows to largely scale up the dataset without increasing the annotation budget, and recently attracts lots of research…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-02 Xiaofei Li

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

Multi-channel audio alignment is a key requirement in bioacoustic monitoring, spatial audio systems, and acoustic localization. However, existing methods often struggle to address nonlinear clock drift and lack mechanisms for quantifying…

Sound · Computer Science 2025-09-23 Ragib Amin Nihal , Benjamin Yen , Takeshi Ashizawa , Kazuhiro Nakadai

In this paper, we introduce a novel attentional similarity module for the problem of few-shot sound recognition. Given a few examples of an unseen sound event, a classifier must be quickly adapted to recognize the new sound event without…

Sound · Computer Science 2019-02-19 Szu-Yu Chou , Kai-Hsiang Cheng , Jyh-Shing Roger Jang , Yi-Hsuan Yang

Detecting critical transitions in complex, noisy time-series data is a fundamental challenge across science and engineering. Such transitions may be anticipated by the emergence of a low-dimensional order parameter, whose signature is often…

Machine Learning · Computer Science 2025-12-16 Wenqi Fang , Ye Li

Most previous few-shot learning algorithms are based on meta-training with fake few-shot tasks as training samples, where large labeled base classes are required. The trained model is also limited by the type of tasks. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jianyi Li , Guizhong Liu

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

New classes of sounds constantly emerge with a few samples, making it challenging for models to adapt to dynamic acoustic environments. This challenge motivates us to address the new problem of few-shot class-incremental audio…

Sound · Computer Science 2023-05-30 Wei Xie , Yanxiong Li , Qianhua He , Wenchang Cao , Tuomas Virtanen

Recently, more and more personalized speech enhancement systems (PSE) with excellent performance have been proposed. However, two critical issues still limit the performance and generalization ability of the model: 1) Acoustic environment…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Xiaofeng Ge , Jiangyu Han , Haixin Guan , Yanhua Long

In open-domain Question Answering (QA), dense retrieval is crucial for finding relevant passages for answer generation. Typically, contrastive learning is used to train a retrieval model that maps passages and queries to the same semantic…

Computation and Language · Computer Science 2024-01-17 Shiqi Wang , Yeqin Zhang , Cam-Tu Nguyen

Deep anomaly detection methods learn representations that separate between normal and anomalous images. Although self-supervised representation learning is commonly used, small dataset sizes limit its effectiveness. It was previously shown…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Tal Reiss , Yedid Hoshen

In this work, we focus on a more challenging few-shot intent detection scenario where many intents are fine-grained and semantically similar. We present a simple yet effective few-shot intent detection schema via contrastive pre-training…

Computation and Language · Computer Science 2021-09-15 Jianguo Zhang , Trung Bui , Seunghyun Yoon , Xiang Chen , Zhiwei Liu , Congying Xia , Quan Hung Tran , Walter Chang , Philip Yu

This paper focuses on few-shot Sound Event Detection (SED), which aims to automatically recognize and classify sound events with limited samples. However, prevailing methods methods in few-shot SED predominantly rely on segment-level…

Sound · Computer Science 2024-03-20 Liang Zou , Genwei Yan , Ruoyu Wang , Jun Du , Meng Lei , Tian Gao , Xin Fang

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Sound event detection is an important facet of audio tagging that aims to identify sounds of interest and define both the sound category and time boundaries for each sound event in a continuous recording. With advances in deep neural…

Sound · Computer Science 2024-12-31 Sangwook Park , David K. Han , Mounya Elhilali

Few-shot classification aims to recognize unseen classes with few labeled samples from each class. Many meta-learning models for few-shot classification elaborately design various task-shared inductive bias (meta-knowledge) to solve such…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Haoqing Wang , Zhi-Hong Deng

Turn-level user satisfaction is one of the most important performance metrics for conversational agents. It can be used to monitor the agent's performance and provide insights about defective user experiences. Moreover, a powerful…

Machine Learning · Computer Science 2021-04-13 Mohammad Kachuee , Hao Yuan , Young-Bum Kim , Sungjin Lee