English
Related papers

Related papers: Voice Timbre Attribute Detection with Compact and …

200 papers

Vocal fatigue refers to the feeling of tiredness and weakness of voice due to extended utilization. This paper investigates the effectiveness of neural embeddings for the detection of vocal fatigue. We compare x-vectors, ECAPA-TDNN, and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-18 Sebastian P. Bayerl , Dominik Wagner , Ilja Baumann , Korbinian Riedhammer , Tobias Bocklet

Psychoacoustical so-called "timbre spaces" map perceptual similarity ratings of instrument sounds onto low-dimensional embeddings via multidimensional scaling, but suffer from scalability issues and are incapable of generalization. Recent…

Sound · Computer Science 2025-07-11 Haokun Tian , Stefan Lattner , Charalampos Saitis

Recent studies show the ability of unsupervised models to learn invertible audio representations using Auto-Encoders. They enable high-quality sound synthesis but a limited control since the latent spaces do not disentangle timbre…

Sound · Computer Science 2020-08-18 Antoine Caillon , Adrien Bitton , Brice Gatinet , Philippe Esling

Voice activity detection (VAD) is an essential pre-processing step for tasks such as automatic speech recognition (ASR) and speaker recognition. A basic goal is to remove silent segments within an audio, while a more general VAD system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Yefei Chen , Shuai Wang , Yanmin Qian , Kai Yu

The task of voice activity detection (VAD) is an often required module in various speech processing, analysis and classification tasks. While state-of-the-art neural network based VADs can achieve great results, they often exceed…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-20 Sebastian Braun , Ivan Tashev

In this paper, we propose "personal VAD", a system to detect the voice activity of a target speaker at the frame level. This system is useful for gating the inputs to a streaming on-device speech recognition system, such that it only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Shaojin Ding , Quan Wang , Shuo-yiin Chang , Li Wan , Ignacio Lopez Moreno

Sociometric badges are an emerging technology for study how teams interact in physical places. Audio data recorded by sociometric badges is often downsampled to not record discussions of the sociometric badges holders. To gain more…

Automatic recognition of disordered speech remains a highly challenging task to date. Sources of variability commonly found in normal speech including accent, age or gender, when further compounded with the underlying causes of speech…

Sound · Computer Science 2022-01-20 Mengzhe Geng , Shansong Liu , Jianwei Yu , Xurong Xie , Shoukang Hu , Zi Ye , Zengrui Jin , Xunying Liu , Helen Meng

Estimating noise information exactly is crucial for noise aware training in speech applications including speech enhancement (SE) which is our focus in this paper. To estimate noise-only frames, we employ voice activity detection (VAD) to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-04 Joohyung Lee , Youngmoon Jung , Myunghun Jung , Hoirin Kim

Voice Activity Detection (VAD) refers to the problem of distinguishing speech segments from background noise. Numerous approaches have been proposed for this purpose. Some are based on features derived from the power spectral density,…

Sound · Computer Science 2019-03-08 Thomas Drugman , Yannis Stylianou , Yusuke Kida , Masami Akamine

Automatic accent identification (AID) remains a challenging task due to the complex variability of accents, the entanglement of accent cues with speaker traits, and the scarcity of reliable accentlabelled data. To address these challenges,…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Rayane Bakari , Olivier Le Blouch , Nicolas Gengembre , Nicholas Evans

Voice Activity Detection (VAD) is an important pre-processing step in a wide variety of speech processing systems. VAD should in a practical application be able to detect speech in both noisy and noise-free environments, while not…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-06 Claus Meyer Larsen , Peter Koch , Zheng-Hua Tan

Audio-visual speech enhancement (AVSE) methods use both audio and visual features for the task of speech enhancement and the use of visual features has been shown to be particularly effective in multi-speaker scenarios. In the majority of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-18 Shrishti Saha Shetu , Soumitro Chakrabarty , Emanuël A. P. Habets

We propose an approach to extract speaker embeddings that are robust to speaking style variations in text-independent speaker verification. Typically, speaker embedding extraction includes training a DNN for speaker classification and using…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Amber Afshan , Abeer Alwan

An embedding-based speaker adaptive training (SAT) approach is proposed and investigated in this paper for deep neural network acoustic modeling. In this approach, speaker embedding vectors, which are a constant given a particular speaker,…

Computation and Language · Computer Science 2017-10-20 Xiaodong Cui , Vaibhava Goel , George Saon

Voice Activity Detection (VAD) in the presence of background noise remains a challenging problem in speech processing. Accurate VAD is essential in automatic speech recognition, voice-to-text, conversational agents, etc, where noise can…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Hamed Jafarzadeh Asl , Mahsa Ghazvini Nejad , Amin Edraki , Masoud Asgharian , Vahid Partovi Nia

This paper presents NOMAD (Non-Matching Audio Distance), a differentiable perceptual similarity metric that measures the distance of a degraded signal against non-matching references. The proposed method is based on learning deep feature…

Sound · Computer Science 2024-01-22 Alessandro Ragano , Jan Skoglund , Andrew Hines

In this paper, we focus on audio violence detection (AVD). AVD is necessary for several reasons, especially in the context of maintaining safety, preventing harm, and ensuring security in various environments. This calls for accurate AVD…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Sarthak Jain , Orchid Chetia Phukan , Arun Balaji Buduru , Rajesh Sharma

Approximately 1.2% of the world's population has impaired voice production. As a result, automatic dysphonic voice detection has attracted considerable academic and clinical interest. However, existing methods for automated voice assessment…

Sound · Computer Science 2023-01-27 Jianwei Zhang , Julie Liss , Suren Jayasuriya , Visar Berisha

Voice Activity Detection (VAD) plays a key role in speech processing, often utilizing hand-crafted or neural features. This study examines the effectiveness of Mel-Frequency Cepstral Coefficients (MFCCs) and pre-trained model (PTM)…

Sound · Computer Science 2025-06-03 Kumud Tripathi , Chowdam Venkata Kumar , Pankaj Wasnik