English
Related papers

Related papers: Unsupervised Voice Activity Detection by Modeling …

200 papers

In this paper, we show how to use audio to supervise the learning of active speaker detection in video. Voice Activity Detection (VAD) guides the learning of the vision-based classifier in a weakly supervised manner. The classifier uses…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Punarjay Chakravarty , Tinne Tuytelaars

In this paper we demonstrate that performance of voice activity detection (VAD) system operating in presence of background noise can be improved by concatenating acoustic input features with electroencephalography (EEG) features. We also…

Sound · Computer Science 2020-03-18 Gautam Krishna , Co Tran , Mason Carnahan , Yan Han , Ahmed H Tewfik

Voice activity detection (VAD) is a critical component in various applications such as speech recognition, speech enhancement, and hands-free communication systems. With the increasing demand for personalized and context-aware technologies,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-17 Satyam Kumar , Sai Srujana Buddi , Utkarsh Oggy Sarawgi , Vineet Garg , Shivesh Ranjan , Ognjen , Rudovic , Ahmed Hussen Abdelaziz , Saurabh Adya

Voice Activity Detection (VAD) is an important pre-processing step in a wide variety of speech processing systems. VAD should in a practical application be able to detect speech in both noisy and noise-free environments, while not…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-06 Claus Meyer Larsen , Peter Koch , Zheng-Hua Tan

In this paper, we propose "personal VAD", a system to detect the voice activity of a target speaker at the frame level. This system is useful for gating the inputs to a streaming on-device speech recognition system, such that it only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Shaojin Ding , Quan Wang , Shuo-yiin Chang , Li Wan , Ignacio Lopez Moreno

Voice activity detection is the task of detecting speech regions in a given audio stream or recording. First, we design a neural network combining trainable filters and recurrent layers to tackle voice activity detection directly from the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-27 Marvin Lavechin , Marie-Philippe Gill , Ruben Bousbib , Hervé Bredin , Leibny Paola Garcia-Perera

This paper integrates a voice activity detection (VAD) function with end-to-end automatic speech recognition toward an online speech interface and transcribing very long audio recordings. We focus on connectionist temporal classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-16 Takenori Yoshimura , Tomoki Hayashi , Kazuya Takeda , Shinji Watanabe

Voice activity detection (VAD) is a challenging task in low signal-to-noise ratio (SNR) environment, especially in non-stationary noise. To deal with this issue, we propose a novel attention module that can be integrated in Long Short-Term…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-26 Joohyung Lee , Youngmoon Jung , Hoirin Kim

Voice Activity Detection (VAD) plays a key role in speech processing, often utilizing hand-crafted or neural features. This study examines the effectiveness of Mel-Frequency Cepstral Coefficients (MFCCs) and pre-trained model (PTM)…

Sound · Computer Science 2025-06-03 Kumud Tripathi , Chowdam Venkata Kumar , Pankaj Wasnik

The task of voice activity detection (VAD) is an often required module in various speech processing, analysis and classification tasks. While state-of-the-art neural network based VADs can achieve great results, they often exceed…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-20 Sebastian Braun , Ivan Tashev

Sociometric badges are an emerging technology for study how teams interact in physical places. Audio data recorded by sociometric badges is often downsampled to not record discussions of the sociometric badges holders. To gain more…

Voice Activity Detection (VAD) is a fundamental module in many audio applications. Recent state-of-the-art VAD systems are often based on neural networks, but they require a computational budget that usually exceeds the capabilities of a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-07 Niccolo' Polvani , Damien Ronssin , Milos Cernak

For speech interaction, voice activity detection (VAD) is often used as a front-end. However, traditional VAD algorithms usually need to wait for a continuous tail silence to reach a preset maximum duration before segmentation, resulting in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Mohan Shi , Yuchun Shu , Lingyun Zuo , Qian Chen , Shiliang Zhang , Jie Zhang , Li-Rong Dai

Target-Speaker Voice Activity Detection (TS-VAD) utilizes a set of speaker profiles alongside an input audio signal to perform speaker diarization. While its superiority over conventional methods has been demonstrated, the method can suffer…

Sound · Computer Science 2024-04-05 Dongmei Wang , Xiong Xiao , Naoyuki Kanda , Midia Yousefi , Takuya Yoshioka , Jian Wu

Detecting anchor's voice in live musical streams is an important preprocessing for music and speech signal processing. Existing approaches to voice activity detection (VAD) primarily rely on audio, however, audio-based VAD is difficult to…

Sound · Computer Science 2020-11-03 Yuanbo Hou , Yi Deng , Bilei Zhu , Zejun Ma , Dick Botteldooren

Voice activity detection (VAD), used as the front end of speech enhancement, speech and speaker recognition algorithms, determines the overall accuracy and efficiency of the algorithms. Therefore, a VAD with low complexity and high accuracy…

Sound · Computer Science 2019-02-06 Jayanta Dey , Md Sanzid Bin Hossain , Mohammad Ariful Haque

Target-speaker voice activity detection (TS-VAD) has recently shown promising results for speaker diarization on highly overlapped speech. However, the original model requires a fixed (and known) number of speakers, which limits its…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-10 Maokui He , Desh Raj , Zili Huang , Jun Du , Zhuo Chen , Shinji Watanabe

We present a novel personalized voice activity detection (PVAD) learning method that does not require enrollment data during training. PVAD is a task to detect the speech segments of a specific target speaker at the frame level using…

We propose supervised systems for speech activity detection (SAD) and speaker identification (SID) tasks in Fearless Steps Challenge Phase-2. The proposed systems for both the tasks share a common convolutional neural network (CNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Karthik Pandia D S , Cosimo Spera

Speech activity detection (SAD) plays an important role in current speech processing systems, including automatic speech recognition (ASR). SAD is particularly difficult in environments with acoustic noise. A practical solution is to…

Computation and Language · Computer Science 2023-05-15 Fei Tao , Carlos Busso