English
Related papers

Related papers: Formula-Supervised Sound Event Detection: Pre-Trai…

200 papers

Sound event detection (SED) is an active area of audio research that aims to detect the temporal occurrence of sounds. In this paper, we apply SED to engine fault detection by introducing a multimodal SED framework that detects fine-grained…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-19 Dennis Fedorishin , Livio Forte , Philip Schneider , Srirangaraj Setlur , Venu Govindaraju

Synthetic datasets are being recognized in the deep learning realm as a valuable alternative to exhaustively labeled real data. One such synthetic data generation method is Formula Driven Supervised Learning (FDSL), which can provide an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Marko Putak , Thomas B. Moeslund , Joakim Bruslund Haurum

We propose a methodology for training foundation models that enhances their in-context learning capabilities within the domain of bioacoustic signal processing. We use synthetically generated training data, introducing a…

Semi-supervised learning and domain adaptation techniques have drawn increasing attention in the field of domestic sound event detection thanks to the availability of large amounts of unlabeled data and the relative ease to generate…

Sound · Computer Science 2022-08-18 Fang-Ching Chen , Kuan-Dar Chen , Yi-Wen Liu

Federated Learning is a distributed machine learning paradigm dealing with decentralized and personal datasets. Since data reside on devices like smartphones and virtual assistants, labeling is entrusted to the clients, or labels are…

Machine Learning · Computer Science 2022-02-28 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi

Semi-supervised learning holds great promise for many real-world applications, due to its ability to leverage both unlabeled and expensive labeled data. However, most semi-supervised learning algorithms still heavily rely on the limited…

Machine Learning · Computer Science 2023-12-29 Huiling Qin , Xianyuan Zhan , Yuanxun Li , Yu Zheng

Acoustic Scene Classification (ASC) and Sound Event Detection (SED) are two separate tasks in the field of computational sound scene analysis. In this work, we present a new dataset with both sound scene and sound event labels and use this…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Helen L. Bear , Ines Nolasco , Emmanouil Benetos

State-of-the-art sound event detection (SED) methods usually employ a series of convolutional neural networks (CNNs) to extract useful features from the input audio signal, and then recurrent neural networks (RNNs) to model longer temporal…

This paper introduces a novel dataset for polyphonic sound event detection in urban sound monitoring use-cases. Based on isolated sounds taken from the FSD50k dataset, 20,000 polyphonic soundscapes are synthesized with sounds being randomly…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-07 Jakob Abeßer

Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization. Federated learning (FL) is a compelling framework that decouples data collection and model training to…

Sound · Computer Science 2022-03-24 Meng Feng , Chieh-Chi Kao , Qingming Tang , Ming Sun , Viktor Rozgic , Spyros Matsoukas , Chao Wang

Self-supervised pre-training using unlabeled data is widely used in automatic speech recognition. In this paper, we propose a new self-supervised pre-training approach to dealing with heterogeneous data. Instead of mixing all the data and…

Machine Learning · Computer Science 2025-09-10 Xiaodong Cui , A F M Saif , Brian Kingsbury , Tianyi Chen

We show that large pre-trained language models are inherently highly capable of identifying label errors in natural language datasets: simply examining out-of-sample data points in descending order of fine-tuned task loss significantly…

Computation and Language · Computer Science 2022-12-16 Derek Chong , Jenny Hong , Christopher D. Manning

Semi-supervised object detection (SSOD) aims to facilitate the training and deployment of object detectors with the help of a large amount of unlabeled data. Though various self-training based and consistency-regularization based SSOD…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Binghui Chen , Pengyu Li , Xiang Chen , Biao Wang , Lei Zhang , Xian-Sheng Hua

Recent studies have shown that the benefits provided by self-supervised pre-training and self-training (pseudo-labeling) are complementary. Semi-supervised fine-tuning strategies under the pre-training framework, however, remain…

Sound · Computer Science 2022-06-28 Bowen Zhang , Songjun Cao , Xiaoming Zhang , Yike Zhang , Long Ma , Takahiro Shinozaki

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

Our goal is to develop a sound event localization and detection (SELD) system that works robustly in unknown environments. A SELD system trained on known environment data is degraded in an unknown environment due to environmental effects…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-21 Masahiro Yasuda , Yasunori Ohishi , Shoichiro Saito

Semi-supervised 3D object detection is a common strategy employed to circumvent the challenge of manually labeling large-scale autonomous driving perception datasets. Pseudo-labeling approaches to semi-supervised learning adopt a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Philip Jacobson , Yichen Xie , Mingyu Ding , Chenfeng Xu , Masayoshi Tomizuka , Wei Zhan , Ming C. Wu

Sound event localization and detection (SELD) is an emerging research topic that aims to unify the tasks of sound event detection and direction-of-arrival estimation. As a result, SELD inherits the challenges of both tasks, such as noise,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-28 Thi Ngoc Tho Nguyen , Karn N. Watcharasupat , Zhen Jian Lee , Ngoc Khanh Nguyen , Douglas L. Jones , Woon Seng Gan

Distantly Supervised Named Entity Recognition (DS-NER) has attracted attention due to its scalability and ability to automatically generate labeled data. However, distant annotation introduces many mislabeled instances, limiting its…

Computation and Language · Computer Science 2025-04-08 Qi Zhang , Huitong Pan , Zhijia Chen , Longin Jan Latecki , Cornelia Caragea , Eduard Dragut

In many situations, we would like to hear desired sound events (SEs) while being able to ignore interference. Target sound extraction (TSE) tackles this problem by estimating the audio signal of the sounds of target SE classes in a mixture…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Marc Delcroix , Jorge Bennasar Vázquez , Tsubasa Ochiai , Keisuke Kinoshita , Yasunori Ohishi , Shoko Araki