中文
相关论文

相关论文: Global birdsong embeddings enable superior transfe…

200 篇论文

We study the usability of pre-trained weakly supervised audio tagging (AT) models as feature extractors for general audio representations. We mainly analyze the feasibility of transferring those embeddings to other tasks within the speech…

声音 · 计算机科学 2022-10-03 Heinrich Dinkel , Zhiyong Yan , Yongqing Wang , Junbo Zhang , Yujun Wang

Research into automated systems for detecting and classifying marine mammals in acoustic recordings is expanding internationally due to the necessity to analyze large collections of data for conservation purposes. In this work, we present a…

声音 · 计算机科学 2019-08-01 Mark Thomas , Bruce Martin , Katie Kowarski , Briand Gaudet , Stan Matwin

Based on the transfer learning, we design a bird species identification model that uses the VGG-16 model (pretrained on ImageNet) for feature extraction, then a classifier consisting of two fully-connected hidden layers and a Softmax layer…

声音 · 计算机科学 2018-03-06 Jiang-jian Xie , Chang-qing Ding , Wen-bin Li , Cheng-hao Cai

Dialect variation hampers automatic recognition of bird calls collected by passive acoustic monitoring. We address the problem on DB3V, a three-region, ten-species corpus of 8-s clips, and propose a deployable framework built on Time-Delay…

声音 · 计算机科学 2025-09-29 Jiani Ding , Qiyang Sun , Alican Akman , Björn W. Schuller

In this paper, we tackle the problem of handling narrowband and wideband speech by building a single acoustic model (AM), also called mixed bandwidth AM. In the proposed approach, an auxiliary input feature is used to provide the bandwidth…

音频与语音处理 · 电气工程与系统科学 2019-09-09 Gautam Mantena , Ozlem Kalinli , Ossama Abdel-Hamid , Don McAllaster

Event detection improves when events are captured by two different modalities rather than just one. But to train detection systems on multiple modalities is challenging, in particular when there is abundance of unlabelled data but limited…

声音 · 计算机科学 2022-11-18 Sumit Kumar , B. Anshuman , Linus Ruettimann , Richard H. R. Hahnloser , Vipul Arora

Unsupervised feature learning often finds low-dimensional embeddings that capture the structure of complex data. For tasks for which prior expert topological knowledge is available, incorporating this into the learned representation may…

机器学习 · 计算机科学 2022-03-08 Robin Vandaele , Bo Kang , Jefrey Lijffijt , Tijl De Bie , Yvan Saeys

Acoustic word embeddings --- fixed-dimensional vector representations of variable-length spoken word segments --- have begun to be considered for tasks such as speech recognition and query-by-example search. Such embeddings can be learned…

计算与语言 · 计算机科学 2016-11-09 Shane Settle , Karen Livescu

Understanding evolution of vocal communication in social animals is an important research problem. In that context, beyond humans, there is an interest in analyzing vocalizations of other social animals such as, meerkats, marmosets, apes.…

音频与语音处理 · 电气工程与系统科学 2024-08-29 Imen Ben Mahmoud , Eklavya Sarkar , Marta Manser , Mathew Magimai. -Doss

With an increase of dataset availability, the potential for learning from a variety of data sources has increased. One particular method to improve learning from multiple data sources is to embed the data source during training. This allows…

计算与语言 · 计算机科学 2021-12-08 Rob van der Goot , Miryam de Lhoneux

Automatic analysis of bioacoustic signals is a fundamental tool to evaluate the vitality of our planet. Frogs and bees, for instance, may act like biological sensors providing information about environmental changes. This task is…

While models in audio and speech processing are becoming deeper and more end-to-end, they as a consequence need expensive training on large data, and are often brittle. We build on a classical model of human hearing and make it…

声音 · 计算机科学 2024-09-16 Ruolan Leslie Famularo , Dmitry N. Zotkin , Shihab A. Shamma , Ramani Duraiswami

Many biological monitoring projects rely on acoustic detection of birds. Despite increasingly large datasets, this detection is often manual or semi-automatic, requiring manual tuning/postprocessing. We review the state of the art in…

声音 · 计算机科学 2024-02-01 Dan Stowell , Mike Wood , Yannis Stylianou , Hervé Glotin

Many recent works on deep speaker embeddings train their feature extraction networks on large classification tasks, distinguishing between all speakers in a training set. Empirically, this has been shown to produce speaker-discriminative…

声音 · 计算机科学 2020-02-04 Chau Luu , Peter Bell , Steve Renals

In speech recognition, it is essential to model the phonetic content of the input signal while discarding irrelevant factors such as speaker variations and noise, which is challenging in low-resource settings. Self-supervised pre-training…

计算与语言 · 计算机科学 2023-01-04 Sreepratha Ram , Hanan Aldarmaki

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

机器学习 · 统计学 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani

Recent efforts have been made on acoustic scene classification in the audio signal processing community. In contrast, few studies have been conducted on acoustic scene clustering, which is a newly emerging problem. Acoustic scene clustering…

音频与语音处理 · 电气工程与系统科学 2023-06-12 Yanxiong Li , Mingle Liu , Wucheng Wang , Yuhan Zhang , Qianhua He

Pre-trained models (PTMs) have shown great promise in the speech and audio domain. Embeddings leveraged from these models serve as inputs for learning algorithms with applications in various downstream tasks. One such crucial task is Speech…

音频与语音处理 · 电气工程与系统科学 2023-04-25 Orchid Chetia Phukan , Arun Balaji Buduru , Rajesh Sharma

Natural language processing methods have been applied in a variety of music studies, drawing the connection between music and language. In this paper, we expand those approaches by investigating \textit{chord embeddings}, which we apply in…

Despite there being clear evidence for top-down (e.g., attentional) effects in biological spatial hearing, relatively few machine hearing systems exploit top-down model-based knowledge in sound localisation. This paper addresses this issue…

音频与语音处理 · 电气工程与系统科学 2019-04-08 Ning Ma , Jose A. Gonzalez , Guy J. Brown