English
Related papers

Related papers: Pretraining Representations for Bioacoustic Few-sh…

200 papers

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

In this paper, we propose a model for bird sound event detection that focuses on a small number of training samples within the everyday long-tail distribution. As a result, we investigate bird sound detection using the few-shot learning…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-27 Lingwen Liu , Yuxuan Feng , Haitao Fu , Yajie Yang , Xin Pan , Chenlei Jin

Existing approaches towards anomaly detection~(AD) often rely on a substantial amount of anomaly-free data to train representation and density models. However, large anomaly-free datasets may not always be available before the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Jingyi Liao , Xun Xu , Manh Cuong Nguyen , Adam Goodge , Chuan Sheng Foo

Few-shot classification and meta-learning methods typically struggle to generalize across diverse domains, as most approaches focus on a single dataset, failing to transfer knowledge across various seen and unseen domains. Existing…

Machine Learning · Computer Science 2025-10-07 Kristi Topollai , Anna Choromanska

In this paper, we present a method called HODGEPODGE\footnotemark[1] for large-scale detection of sound events using weakly labeled, synthetic, and unlabeled data proposed in the Detection and Classification of Acoustic Scenes and Events…

Sound · Computer Science 2019-07-18 Ziqiang Shi , Liu Liu , Huibin Lin , Rujie Liu , Anyan Shi

In this paper, we describe in detail the system we submitted to DCASE2019 task 4: sound event detection (SED) in domestic environments. We employ a convolutional neural network (CNN) with an embedding-level attention pooling module to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-16 Liwei Lin , Xiangdong Wang , Hong Liu , Yueliang Qian

Few-shot classification is a challenging task which aims to formulate the ability of humans to learn concepts from limited prior data and has drawn considerable attention in machine learning. Recent progress in few-shot classification has…

Machine Learning · Computer Science 2020-04-14 Meiyu Huang , Xueshuang Xiang , Yao Xu

Few-shot learning aims to generalize unseen classes that appear during testing but are unavailable during training. Prototypical networks incorporate few-shot metric learning, by constructing a class prototype in the form of a mean vector…

Sound · Computer Science 2021-02-17 Swapnil Bhosale , Rupayan Chakraborty , Sunil Kumar Kopparapu

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Turn-level user satisfaction is one of the most important performance metrics for conversational agents. It can be used to monitor the agent's performance and provide insights about defective user experiences. Moreover, a powerful…

Machine Learning · Computer Science 2021-04-13 Mohammad Kachuee , Hao Yuan , Young-Bum Kim , Sungjin Lee

With emerging online topics as a source for numerous new events, detecting unseen / rare event types presents an elusive challenge for existing event detection methods, where only limited data access is provided for training. To address the…

Computation and Language · Computer Science 2023-05-30 Zhenrui Yue , Huimin Zeng , Mengfei Lan , Heng Ji , Dong Wang

We investigate a strategy for improving the efficiency of contrastive learning of visual representations by leveraging a small amount of supervised information during pre-training. We propose a semi-supervised loss, SuNCEt, based on…

Machine Learning · Computer Science 2020-12-03 Mahmoud Assran , Nicolas Ballas , Lluis Castrejon , Michael Rabbat

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Learning quickly from very few labeled samples is a fundamental attribute that separates machines and humans in the era of deep representation learning. Unsupervised few-shot learning (U-FSL) aspires to bridge this gap by discarding the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Stylianos Poulakakis-Daktylidis , Hadi Jamali-Rad

Few-shot learning aims to handle previously unseen tasks using only a small amount of new training data. In preparing (or meta-training) a few-shot learner, however, massive labeled data are necessary. In the real world, unfortunately,…

Machine Learning · Computer Science 2020-03-19 Jun Seo , Sung Whan Yoon , Jaekyun Moon

In this paper, we propose addressing the lack of strongly labeled data by using pseudo strongly labeled data approximated using Convolutive Nonnegative Matrix Factorization. Using this set of data, we then train a novel architecture called…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Teck Kai Chan , Cheng Siong Chin

In training a deep learning system to perform audio transcription, two practical problems may arise. Firstly, most datasets are weakly labelled, having only a list of events present in each recording without any temporal information for…

Machine Learning · Computer Science 2018-07-12 Veronica Morfi , Dan Stowell

Few-shot learning methods offer pre-training techniques optimized for easier later adaptation of the model to new classes (unseen during training) using one or a few examples. This adaptivity to unseen classes is especially important for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Guy Bukchin , Eli Schwartz , Kate Saenko , Ori Shahar , Rogerio Feris , Raja Giryes , Leonid Karlinsky

Few-shot relation extraction (FSRE) focuses on recognizing novel relations by learning with merely a handful of annotated instances. Meta-learning has been widely adopted for such a task, which trains on randomly generated few-shot tasks to…

Computation and Language · Computer Science 2021-10-26 Jiale Han , Bo Cheng , Wei Lu

Vision-language models trained with contrastive learning on large-scale noisy data are becoming increasingly popular for zero-shot recognition problems. In this paper we improve the following three aspects of the contrastive pre-training…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Filip Radenovic , Abhimanyu Dubey , Abhishek Kadian , Todor Mihaylov , Simon Vandenhende , Yash Patel , Yi Wen , Vignesh Ramanathan , Dhruv Mahajan