English
Related papers

Related papers: PANNs: Large-Scale Pretrained Audio Neural Network…

200 papers

Audio classification is considered as a challenging problem in pattern recognition. Recently, many algorithms have been proposed using deep neural networks. In this paper, we introduce a new attention-based neural network architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Haoye Lu , Haolong Zhang , Amit Nayak

Obtaining large-scale human-labeled datasets to train acoustic representation models is a very challenging task. On the contrary, we can easily collect data with machine-generated labels. In this work, we propose to exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Shaoyong Jia , Xin Shu , Yang Yang , Dawei Liang , Qiyue Liu , Junhui Liu

Giant pandas, stereotyped as silent animals, make significantly more vocal sounds during breeding season, suggesting that sounds are essential for coordinating their reproduction and expression of mating preference. Previous biological…

Sound · Computer Science 2026-05-20 WeiRan Yan , MaoLin Tang , Qijun Zhao , Peng Chen , Dunwu Qi , Rong Hou , Zhihe Zhang

This report presents our audio event detection system submitted for Task 2, "Detection of rare sound events", of DCASE 2017 challenge. The proposed system is based on convolutional neural networks (CNNs) and deep neural networks (DNNs)…

Sound · Computer Science 2017-10-19 Huy Phan , Martin Krawczyk-Becker , Timo Gerkmann , Alfred Mertins

In recent years, speech enhancement (SE) has achieved impressive progress with the success of deep neural networks (DNNs). However, the DNN approach usually fails to generalize well to unseen environmental noise that is not included in the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Haoyu Li , Junichi Yamagishi

Pronounced as "musician", the musicnn library contains a set of pre-trained musically motivated convolutional neural networks for music audio tagging: https://github.com/jordipons/musicnn. This repository also includes some pre-trained…

Sound · Computer Science 2019-09-17 Jordi Pons , Xavier Serra

In this paper, we present a deep neural network (DNN)-based acoustic scene classification framework. Two hierarchical learning methods are proposed to improve the DNN baseline performance by incorporating the hierarchical taxonomy…

Sound · Computer Science 2016-08-16 Yong Xu , Qiang Huang , Wenwu Wang , Mark D. Plumbley

While audio quality is a key performance metric for various audio processing tasks, including generative modeling, its objective measurement remains a challenge. Audio-Language Models (ALMs) are pre-trained on audio-text pairs that may…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-02 Soham Deshmukh , Dareen Alharthi , Benjamin Elizalde , Hannes Gamper , Mahmoud Al Ismail , Rita Singh , Bhiksha Raj , Huaming Wang

Audio tagging aims to label sound events appearing in an audio recording. In this paper, we propose region-specific audio tagging, a new task which labels sound events in a given region for spatial audio recorded by a microphone array. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-12 Jinzheng Zhao , Yong Xu , Haohe Liu , Davide Berghi , Xinyuan Qian , Qiuqiang Kong , Junqi Zhao , Mark D. Plumbley , Wenwu Wang

There have been several successful deep learning models that perform audio super-resolution. Many of these approaches involve using preprocessed feature extraction which requires a lot of domain-specific signal processing knowledge to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-01 James King , Ramon Viñas Torné , Alexander Campbell , Pietro Liò

Sound event localization and detection (SELD) has seen substantial advancements through learning-based methods. These systems, typically trained from scratch on specific datasets, have shown considerable generalization capabilities.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Jinbo Hu , Yin Cao , Ming Wu , Fang Kang , Feiran Yang , Wenwu Wang , Mark D. Plumbley , Jun Yang

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene…

Sound · Computer Science 2022-03-01 Dengxin Dai , Arun Balajee Vasudevan , Jiri Matas , Luc Van Gool

Natural Language Processing (NLP) is widely used in fields like machine translation and sentiment analysis. However, traditional NLP models struggle with accuracy and efficiency. This paper introduces Deep Convolutional Neural Networks…

Computation and Language · Computer Science 2024-12-23 Chang Weng , Scott Rood , Mehdi Ali Ramezani , Amir Aslani , Reza Zarrab , Wang Zwuo , Sanjeev Salimans , Tim Satheesh

Power consumption is a major obstacle in the deployment of deep neural networks (DNNs) on end devices. Existing approaches for reducing power consumption rely on quite general principles, including avoidance of multiplication operations and…

Machine Learning · Computer Science 2022-02-08 Nurit Spingarn Eliezer , Ron Banner , Elad Hoffer , Hilla Ben-Yaakov , Tomer Michaeli

In this work we propose approaches to effectively transfer knowledge from weakly labeled web audio data. We first describe a convolutional neural network (CNN) based framework for sound event detection and classification using weakly…

Sound · Computer Science 2018-09-10 Anurag Kumar , Maksim Khadkevich , Christian Fugen

With a constant improvement in the network architectures and training methodologies, Neural Networks (NNs) are increasingly being deployed in real-world Machine Learning systems. However, despite their impressive performance on "known…

Machine Learning · Computer Science 2020-05-18 Mahum Naseer , Mishal Fatima Minhas , Faiq Khalid , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Incorporation of prior knowledge about organ shape and location is key to improve performance of image analysis approaches. In particular, priors can be useful in cases where images are corrupted and contain artefacts due to limitations in…

Practical natural language processing (NLP) tasks are commonly long-tailed with noisy labels. Those problems challenge the generalization and robustness of complex models such as Deep Neural Networks (DNNs). Some commonly used resampling…

Computation and Language · Computer Science 2023-05-04 Sunyi Chi , Bo Dong , Yiming Xu , Zhenyu Shi , Zheng Du

Speaker recognition systems based on Convolutional Neural Networks (CNNs) are often built with off-the-shelf backbones such as VGG-Net or ResNet. However, these backbones were originally proposed for image classification, and therefore may…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-01 Shaojin Ding , Tianlong Chen , Xinyu Gong , Weiwei Zha , Zhangyang Wang

Audio representation learning based on deep neural networks (DNNs) emerged as an alternative approach to hand-crafted features. For achieving high performance, DNNs often need a large amount of annotated data which can be difficult and…

Machine Learning · Computer Science 2020-07-09 Xavier Favory , Konstantinos Drossos , Tuomas Virtanen , Xavier Serra