English
Related papers

Related papers: Prosodic-Enhanced Siamese Convolutional Neural Net…

200 papers

This work explores the application of various supervised classification approaches using prosodic information for the identification of spoken North S\'ami language varieties. Dialects are language varieties that enclose characteristics…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-12 Sofoklis Kakouros , Katri Hiovain , Martti Vainio , Juraj Šimko

In this paper we present a Deep Neural Network architecture for the task of acoustic scene classification which harnesses information from increasing temporal resolutions of Mel-Spectrogram segments. This architecture is composed of…

Sound · Computer Science 2018-11-13 Alexander Schindler , Thomas Lidy , Andreas Rauber

While there has been substantial amount of work in speaker diarization recently, there are few efforts in jointly employing lexical and acoustic information for speaker segmentation. Towards that, we investigate a speaker diarization system…

Audio and Speech Processing · Electrical Eng. & Systems 2018-05-29 Tae Jin Park , Panayiotis Georgiou

This paper proposes a novel neural denoising vocoder that can generate clean speech waveforms from noisy mel-spectrograms. The proposed neural denoising vocoder consists of two components, i.e., a spectrum predictor and a enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-20 Hui-Peng Du , Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

This research introduces an enhanced version of the multi-objective speech assessment model--MOSA-Net+, by leveraging the acoustic features from Whisper, a large-scaled weakly supervised model. We first investigate the effectiveness of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Ryandhimas E. Zezario , Yu-Wen Chen , Szu-Wei Fu , Yu Tsao , Hsin-Min Wang , Chiou-Shann Fuh

This work presents a novel back-end framework for speaker verification using graph attention networks. Segment-wise speaker embeddings extracted from multiple crops within an utterance are interpreted as node representations of a graph. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Jee-weon Jung , Hee-Soo Heo , Ha-Jin Yu , Joon Son Chung

We propose prosody embeddings for emotional and expressive speech synthesis networks. The proposed methods introduce temporal structures in the embedding networks, thus enabling fine-grained control of the speaking style of the synthesized…

Computation and Language · Computer Science 2019-02-19 Younggun Lee , Taesu Kim

Convolutional neural networks (CNNs) are widely used in computer vision. They can be used not only for conventional digital image material to recognize patterns, but also for feature extraction from digital imagery representing spectral and…

Sound · Computer Science 2025-09-16 Friedrich Wolf-Monheim

In this paper, we propose a model to perform style transfer of speech to singing voice. Contrary to the previous signal processing-based methods, which require high-quality singing templates or phoneme synchronization, we explore a…

Sound · Computer Science 2022-08-29 Shrutina Agarwal , Sriram Ganapathy , Naoya Takahashi

Deep learning approaches are still not very common in the speaker verification field. We investigate the possibility of using deep residual convolutional neural network with spectrograms as an input features in the text-dependent speaker…

Sound · Computer Science 2017-05-31 Egor Malykh , Sergey Novoselov , Oleg Kudashev

Current voice conversion (VC) methods can successfully convert timbre of the audio. As modeling source audio's prosody effectively is a challenging task, there are still limitations of transferring source style to the converted speech. This…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-29 Zhichao Wang , Xinyong Zhou , Fengyu Yang , Tao Li , Hongqiang Du , Lei Xie , Wendong Gan , Haitao Chen , Hai Li

A deep learning approach has been proposed recently to derive speaker identifies (d-vector) by a deep neural network (DNN). This approach has been applied to text-dependent speaker recognition tasks and shows reasonable performance gains…

Computation and Language · Computer Science 2015-06-30 Lantian Li , Yiye Lin , Zhiyong Zhang , Dong Wang

Cross-speaker style transfer in speech synthesis aims at transferring a style from source speaker to synthesized speech of a target speaker's timbre. In most previous methods, the synthesized fine-grained prosody features often represent…

Sound · Computer Science 2023-03-15 Chunyu Qiang , Peng Yang , Hao Che , Ying Zhang , Xiaorui Wang , Zhongyuan Wang

In multi-speaker applications is common to have pre-computed models from enrolled speakers. Using these models to identify the instances in which these speakers intervene in a recording is the task of speaker tracking. In this paper, we…

Recent advances in transformer-based architectures which are pre-trained in self-supervised manner have shown great promise in several machine learning tasks. In the audio domain, such architectures have also been successfully utilised in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-11 Johannes Wagner , Andreas Triantafyllopoulos , Hagen Wierstorf , Maximilian Schmitt , Felix Burkhardt , Florian Eyben , Björn W. Schuller

Developing comprehensive assistive technologies requires the seamless integration of visual and auditory perception. This research evaluates the feasibility of a modular architecture inspired by core functionalities of perceptive systems…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Akshit Pramod Anchan , Jewelith Thomas , Sritama Roy

Most of the speech processing applications use triangular filters spaced in mel-scale for feature extraction. In this paper, we propose a new data-driven filter design method which optimizes filter parameters from a given speech data.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-22 Susanta Sarangi , Md Sahidullah , Goutam Saha

In this work, a sentiment analysis method that is capable of accepting audio of any length, without being fixed a priori, is proposed. Mel spectrogram and Mel Frequency Cepstral Coefficients are used as audio description methods and a Fully…

Deep speaker embeddings have become the leading method for encoding speaker identity in speaker recognition tasks. The embedding space should ideally capture the variations between all possible speakers, encoding the multiple acoustic…

Sound · Computer Science 2021-04-26 Chau Luu , Peter Bell , Steve Renals

Speech recognition system performance degrades in noisy environments. If the acoustic models are built using features of clean utterances, the features of a noisy test utterance would be acoustically mismatched with the trained model. This…

Computation and Language · Computer Science 2015-07-16 D. S. Pavan Kumar