English
Related papers

Related papers: PANNs: Large-Scale Pretrained Audio Neural Network…

200 papers

Automated audio captioning (AAC) aims to describe the content of an audio clip using simple sentences. Existing AAC methods are developed based on an encoder-decoder architecture that success is attributed to the use of a pre-trained CNN10…

Sound · Computer Science 2022-10-18 Jianyuan Sun , Xubo Liu , Xinhao Mei , Mark D. Plumbley , Volkan Kilic , Wenwu Wang

This paper presents a methodology for early detection of audio events from audio streams. Early detection is the ability to infer an ongoing event during its initial stage. The proposed system consists of a novel inference step coupled with…

Sound · Computer Science 2019-04-09 Huy Phan , Philipp Koch , Ian McLoughlin , Alfred Mertins

Audio scene classification, the problem of predicting class labels of audio scenes, has drawn lots of attention during the last several years. However, it remains challenging and falls short of accuracy and efficiency. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-21 Kele Xu , Dawei Feng , Haibo Mi , Boqing Zhu , Dezhi Wang , Lilun Zhang , Hengxing Cai , Shuwen Liu

In the past decade, convolutional neural networks (CNNs) have been widely adopted as the main building block for end-to-end audio classification models, which aim to learn a direct mapping from audio spectrograms to corresponding labels. To…

Sound · Computer Science 2021-07-12 Yuan Gong , Yu-An Chung , James Glass

Whistle contour extraction aims to derive animal whistles from time-frequency spectrograms as polylines. For toothed whales, whistle extraction results can serve as the basis for analyzing animal abundance, species identity, and social…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Pu Li , Marie Roch , Holger Klinck , Erica Fleishman , Douglas Gillespie , Eva-Marie Nosal , Yu Shiu , Xiaobai Liu

Despite the parallel challenges that audio and text domains face in evaluating generative model outputs, preference learning remains remarkably underexplored in audio applications. Through a PRISMA-guided systematic review of approximately…

Sound · Computer Science 2025-11-19 Aaron Broukhim , Yiran Shen , Prithviraj Ammanabrolu , Nadir Weibel

Self-supervised learning (SSL) on large-scale datasets like AudioSet has become the dominant paradigm for audio representation learning. While the continuous influx of new, unlabeled audio presents an opportunity to enrich these static…

Sound · Computer Science 2026-01-26 Yizhou Zhang , Yuan Gao , Wangjin Zhou , Zicheng Yuan , Keisuke Imoto , Tatsuya Kawahara

In this work, we provide a broad comparative analysis of strategies for pre-training audio understanding models for several tasks in the music domain, including labelling of genre, era, origin, mood, instrumentation, key, pitch, vocal…

Recent studies have demonstrated that the representations of artificial neural networks (ANNs) can exhibit notable similarities to cortical representations when subjected to identical auditory sensory inputs. In these studies, the ability…

Neurons and Cognition · Quantitative Biology 2024-12-23 Taketo Akama , Zhuohao Zhang , Pengcheng Li , Kotaro Hongo , Hiroaki Kitano , Shun Minamikawa , Natalia Polouliakh

Neural Architecture Search (NAS) is a promising and rapidly evolving research area. Training a large number of neural networks requires an exceptional amount of computational power, which makes NAS unreachable for those researchers who have…

Machine Learning · Computer Science 2020-06-15 Nikita Klyuchnikov , Ilya Trofimov , Ekaterina Artemova , Mikhail Salnikov , Maxim Fedorov , Evgeny Burnaev

The recent developments in technology have re-warded us with amazing audio synthesis models like TACOTRON and WAVENETS. On the other side, it poses greater threats such as speech clones and deep fakes, that may go undetected. To tackle…

Machine Learning · Computer Science 2021-07-27 Arun Kumar Singh , Priyanka Singh , Karan Nathwani

Recent advances in deep neural networks (DNNs) have significantly improved various audio processing applications, including speech enhancement, synthesis, and hearing-aid algorithms. DNN-based closed-loop systems have gained popularity in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-07 Chuan Wen , Guy Torfs , Sarah Verhulst

This paper proposes a framework for modeling sound change that combines deep learning and iterative learning. Acquisition and transmission of speech is modeled by training generations of Generative Adversarial Networks (GANs) on unannotated…

Computation and Language · Computer Science 2021-09-23 Gašper Beguš

Dysphonia, a prevalent medical condition, leads to voice loss, hoarseness, or speech interruptions. To assess it, researchers have been investigating various machine learning techniques alongside traditional medical assessments.…

Emerging Technologies · Computer Science 2025-02-14 Ha Tran , Bipasha Kashyap , Pubudu N. Pathirana

Recently, instruction-following audio-language models have received broad attention for audio interaction with humans. However, the absence of pre-trained audio models capable of handling diverse audio types and tasks has hindered progress…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-22 Yunfei Chu , Jin Xu , Xiaohuan Zhou , Qian Yang , Shiliang Zhang , Zhijie Yan , Chang Zhou , Jingren Zhou

Next-generation wireless networks must support ultra-reliable, low-latency communication and intelligently manage a massive number of Internet of Things (IoT) devices in real-time, within a highly dynamic environment. This need for…

Information Theory · Computer Science 2019-07-02 Mingzhe Chen , Ursula Challita , Walid Saad , Changchuan Yin , Mérouane Debbah

End-to-end neural network based approaches to audio modelling are generally outperformed by models trained on high-level data representations. In this paper we present preliminary work that shows the feasibility of training the first layers…

Sound · Computer Science 2017-12-04 Tycho Max Sylvester Tax , Jose Luis Diez Antich , Hendrik Purwins , Lars Maaløe

We introduce a new audio processing technique that increases the sampling rate of signals such as speech or music using deep convolutional neural networks. Our model is trained on pairs of low and high-quality audio examples; at test-time,…

Sound · Computer Science 2017-08-03 Volodymyr Kuleshov , S. Zayd Enam , Stefano Ermon

In addition to being extremely non-linear, modern problems require millions if not billions of parameters to solve or at least to get a good approximation of the solution, and neural networks are known to assimilate that complexity by…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-14 Habib Ben Abdallah , Christopher J. Henry , Sheela Ramanna

Today, data collection has improved in various areas, and the medical domain is no exception. Auscultation, as an important diagnostic technique for physicians, due to the progress and availability of digital stethoscopes, lends itself well…