English
Related papers

Related papers: Learning General Audio Representations with Large-…

200 papers

In this paper, adaptive mechanisms are applied in deep neural network (DNN) training for x-vector-based text-independent speaker verification. First, adaptive convolutional neural networks (ACNNs) are employed in frame-level embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-18 Bin Gu , Wu Guo , Lirong Dai , Jun Du

Conventional Convolutional Neural Networks (CNNs) in the real domain have been widely used for audio classification. However, their convolution operations process multi-channel inputs independently, limiting the ability to capture…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-27 Arshdeep Singh , Vinayak Abrol , Mark D. Plumbley

Deep convolutional neural networks (CNNs) for image denoising are usually trained on large datasets. These models achieve the current state of the art, but they have difficulties generalizing when applied to data that deviate from the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sreyas Mohan , Joshua L. Vincent , Ramon Manzorro , Peter A. Crozier , Eero P. Simoncelli , Carlos Fernandez-Granda

End-to-end neural network based approaches to audio modelling are generally outperformed by models trained on high-level data representations. In this paper we present preliminary work that shows the feasibility of training the first layers…

Sound · Computer Science 2017-12-04 Tycho Max Sylvester Tax , Jose Luis Diez Antich , Hendrik Purwins , Lars Maaløe

Voice conversion methods have advanced rapidly over the last decade. Studies have shown that speaker characteristics are captured by spectral feature as well as various prosodic features. Most existing conversion methods focus on the…

Sound · Computer Science 2015-12-08 Hy Quy Nguyen , Siu Wa Lee , Xiaohai Tian , Minghui Dong , Eng Siong Chng

In this paper, we show that ImageNet-Pretrained standard deep CNN models can be used as strong baseline networks for audio classification. Even though there is a significant difference between audio Spectrogram and standard ImageNet image…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Kamalesh Palanisamy , Dipika Singhania , Angela Yao

Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Lukas S. Huber , Fred W. Mast , Felix A. Wichmann

Neural network-based methods have recently demonstrated state-of-the-art results on image synthesis and super-resolution tasks, in particular by using variants of generative adversarial networks (GANs) with supervised feature losses.…

Sound · Computer Science 2019-03-22 Sung Kim , Visvesh Sathe

In this paper, we study the performance of variants of well-known Convolutional Neural Network (CNN) architectures on different audio tasks. We show that tuning the Receptive Field (RF) of CNNs is crucial to their generalization. An…

Sound · Computer Science 2021-05-27 Khaled Koutini , Hamid Eghbal-zadeh , Gerhard Widmer

Transformers have seen an unprecedented rise in Natural Language Processing and Computer Vision tasks. However, in audio tasks, they are either infeasible to train due to extremely large sequence length of audio waveforms or incur a…

Machine Learning · Computer Science 2022-02-02 Surya Kant Sahu , Sai Mitheran , Juhi Kamdar , Meet Gandhi

Recently, speaker embeddings extracted with deep neural networks became the state-of-the-art method for speaker verification. In this paper we aim to facilitate its implementation on a more generic toolkit than Kaldi, which we anticipate to…

Sound · Computer Science 2018-11-07 Hossein Zeinali , Lukas Burget , Johan Rohdin , Themos Stafylakis , Jan Cernocky

The audio denoising technique has captured widespread attention in the deep neural network field. Recently, the audio denoising problem has been converted into an image generation task, and deep learning-based approaches have been applied…

Sound · Computer Science 2024-06-14 Junhui Li , Pu Wang , Jialu Li , Youshan Zhang

Convolutional Neural Networks (CNNs) have had great success in many machine vision as well as machine audition tasks. Many image recognition network architectures have consequently been adapted for audio processing tasks. However, despite…

Machine Learning · Computer Science 2019-07-04 Khaled Koutini , Hamid Eghbal-zadeh , Matthias Dorfer , Gerhard Widmer

Convolutional Neural Networks (CNNs) have been dominating classification tasks in various domains, such as machine vision, machine listening, and natural language processing. In machine listening, while generally exhibiting very good…

Sound · Computer Science 2021-07-20 Khaled Koutini , Hamid Eghbal-zadeh , Florian Henkel , Jan Schlüter , Gerhard Widmer

In this work, we thoroughly evaluate the efficacy of pretrained neural networks as feature extractors for anomalous sound detection. In doing so, we leverage the knowledge that is contained in these neural networks to extract semantically…

Sound · Computer Science 2021-02-19 Robert Müller , Steffen Illium , Fabian Ritz , Kyrill Schmid

Audio pattern recognition is an important research topic in the machine learning area, and includes several tasks such as audio tagging, acoustic scene classification, music classification, speech emotion classification and sound event…

Sound · Computer Science 2020-08-25 Qiuqiang Kong , Yin Cao , Turab Iqbal , Yuxuan Wang , Wenwu Wang , Mark D. Plumbley

This paper investigates a self-adaptation method for speech enhancement using auxiliary speaker-aware features; we extract a speaker representation used for adaptation directly from the test utterance. Conventional studies of deep neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Yuma Koizumi , Kohei Yatabe , Marc Delcroix , Yoshiki Masuyama , Daiki Takeuchi

The absence of large labeled datasets remains a significant challenge in many application areas of deep learning. Researchers and practitioners typically resort to transfer learning and data augmentation to alleviate this issue. We study…

Sound · Computer Science 2022-11-01 Paul Primus , Gerhard Widmer

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

Sound · Computer Science 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

We study the usability of pre-trained weakly supervised audio tagging (AT) models as feature extractors for general audio representations. We mainly analyze the feasibility of transferring those embeddings to other tasks within the speech…

Sound · Computer Science 2022-10-03 Heinrich Dinkel , Zhiyong Yan , Yongqing Wang , Junbo Zhang , Yujun Wang