English
Related papers

Related papers: Speaker Clustering With Neural Networks And Audio …

200 papers

Speaker recognition systems are widely used in various applications to identify a person by their voice; however, the high degree of variability in speech signals makes this a challenging task. Dealing with emotional variations is very…

Sound · Computer Science 2022-01-11 Ali Bou Nassif , Ismail Shahin , Ashraf Elnagar , Divya Velayudhan , Adi Alhudhaif , Kemal Polat

Probabilistic clustering models (or equivalently, mixture models) are basic building blocks in countless statistical models and involve latent random variables over discrete spaces. For these models, posterior inference methods can be…

Machine Learning · Statistics 2020-06-24 Ari Pakman , Yueqi Wang , Catalin Mitelut , JinHyung Lee , Liam Paninski

In speaker verification, the extraction of voice representations is mainly based on the Residual Neural Network (ResNet) architecture. ResNet is built upon convolution layers which learn filters to capture local spatial patterns along all…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-14 Mickael Rouvier , Pierre-Michel Bousquet

Acoustic scene classification is an intricate problem for a machine. As an emerging field of research, deep Convolutional Neural Networks (CNN) achieve convincing results. In this paper, we explore the use of multi-scale Dense connected…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Dawei Feng , Kele Xu , Haibo Mi , Feifan Liao , Yan Zhou

Audio captioning is an important research area that aims to generate meaningful descriptions for audio clips. Most of the existing research extracts acoustic features of audio clips as input to encoder-decoder and transformer architectures…

Sound · Computer Science 2022-04-20 Ayşegül Özkaya Eren , Mustafa Sert

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

Machine Learning · Computer Science 2021-07-23 Louis Mahon , Thomas Lukasiewicz

This paper presents an Expert Decision Support System for the identification of time-invariant, aeroacoustic source types. The system comprises two steps: first, acoustic properties are calculated based on spectral and spatial information.…

Sound · Computer Science 2022-03-09 Armin Goudarzi , Carsten Spehr , Steffen Herbold

Target speaker extraction is to extract the target speaker, specified by enrollment utterance, in an environment with other competing speakers. Therefore, the task needs to solve two problems, speaker identification and separation, at the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Pengjie Shen , Shulin He , Xueliang Zhang

Leveraging additional speaker information to facilitate speech separation has received increasing attention in recent years. Recent research includes extracting target speech by using the target speaker's voice snippet and jointly…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Cong Han , Yi Luo , Chenda Li , Tianyan Zhou , Keisuke Kinoshita , Shinji Watanabe , Marc Delcroix , Hakan Erdogan , John R. Hershey , Nima Mesgarani , Zhuo Chen

Although highly correlated, speech and speaker recognition have been regarded as two independent tasks and studied by two communities. This is certainly not the way that people behave: we decipher both speech content and speaker traits at…

Computation and Language · Computer Science 2016-09-28 Zhiyuan Tang , Lantian Li , Dong Wang

This study investigates discriminative patterns learned by neural networks for accurate speech classification, with a specific focus on vowel classification tasks. By examining the activations and features of neural networks for vowel…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Jesin James , Balamurali B. T. , Binu Abeysinghe , Junchen Liu

Speaker identification in noisy audio recordings, specifically those from collaborative learning environments, can be extremely challenging. There is a need to identify individual students talking in small groups from other students talking…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-05 Antonio Gomez

Speaker extraction aims to extract the target speaker's voice from a multi-talker speech mixture given an auxiliary reference utterance. Recent studies show that speaker extraction benefits from the location or direction of the target…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Meng Ge , Chenglin Xu , Longbiao Wang , Eng Siong Chng , Jianwu Dang , Haizhou Li

To make sense of massive data, we often fit simplified models and then interpret the parameters; for example, we cluster the text embeddings and then interpret the mean parameters of each cluster. However, these parameters are often…

Artificial Intelligence · Computer Science 2025-01-14 Ruiqi Zhong , Heng Wang , Dan Klein , Jacob Steinhardt

The paper copes with the task of automatic assessment of second language proficiency from the language learners' spoken responses to test prompts. The task has significant relevance to the field of computer assisted language learning. The…

Computation and Language · Computer Science 2023-10-19 Sara Papi , Edmondo Trentin , Roberto Gretter , Marco Matassoni , Daniele Falavigna

We introduce a sophisticated multi-speaker speech data simulator, specifically engineered to generate multi-speaker speech recordings. A notable feature of this simulator is its capacity to modulate the distribution of silence and overlap…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-20 Tae Jin Park , He Huang , Coleman Hooper , Nithin Koluguri , Kunal Dhawan , Ante Jukic , Jagadeesh Balam , Boris Ginsburg

Deep learning is still not a very common tool in speaker verification field. We study deep convolutional neural network performance in the text-prompted speaker verification task. The prompted passphrase is segmented into word states - i.e.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-15 Sergey Novoselov , Oleg Kudashev , Vadim Schemelinin , Ivan Kremnev , Galina Lavrentyeva

Acoustic scene classification (ASC) has been approached in the last years using deep learning techniques such as convolutional neural networks or recurrent neural networks. Many state-of-the-art solutions are based on image classification…

Voice cloning is a highly desired feature for personalized speech interfaces. Neural network based speech synthesis has been shown to generate high quality speech for a large number of speakers. In this paper, we introduce a neural voice…

Computation and Language · Computer Science 2018-10-15 Sercan O. Arik , Jitong Chen , Kainan Peng , Wei Ping , Yanqi Zhou

Target speaker extraction aims at extracting the target speaker from a mixture of multiple speakers exploiting auxiliary information about the target speaker. In this paper, we consider a complete time-domain target speaker extraction…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-30 Ragini Sinha , Marvin Tammen , Christian Rollwage , Simon Doclo