English
Related papers

Related papers: Semantic VAD: Low-Latency Voice Activity Detection…

200 papers

Voice Activity Detection (VAD) in the presence of background noise remains a challenging problem in speech processing. Accurate VAD is essential in automatic speech recognition, voice-to-text, conversational agents, etc, where noise can…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-31 Hamed Jafarzadeh Asl , Mahsa Ghazvini Nejad , Amin Edraki , Masoud Asgharian , Vahid Partovi Nia

Voice activity detection (VAD) is the task of detecting speech in an audio stream, which is challenging due to numerous unseen noises and low signal-to-noise ratios in real environments. Recently, neural network-based VADs have alleviated…

Sound · Computer Science 2024-05-28 Jidong Jia , Pei Zhao , Di Wang

Voice Activity Detection (VAD) is a fundamental preprocessing step in automatic speech recognition. This is especially true within the broadcast industry where a wide variety of audio materials and recording conditions are encountered.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-10 Misa Ogura , Matt Haynes

Achieving natural full-duplex interaction in spoken dialogue systems (SDS) remains a challenge due to the difficulty of accurately detecting user interruptions. Current solutions are polarized between "trigger-happy" VAD-based methods that…

Sound · Computer Science 2026-03-26 Kangxiang Xia , Bingshen Mu , Xian Shi , Jin Xu , Lei Xie

Personalization of on-device speech recognition (ASR) has seen explosive growth in recent years, largely due to the increasing popularity of personal assistant features on mobile devices and smart home speakers. In this work, we present…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Shaojin Ding , Rajeev Rikhye , Qiao Liang , Yanzhang He , Quan Wang , Arun Narayanan , Tom O'Malley , Ian McGraw

Voice activity detection (VAD) is a challenging task in low signal-to-noise ratio (SNR) environment, especially in non-stationary noise. To deal with this issue, we propose a novel attention module that can be integrated in Long Short-Term…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-26 Joohyung Lee , Youngmoon Jung , Hoirin Kim

This paper presents an unsupervised segment-based method for robust voice activity detection (rVAD). The method consists of two passes of denoising followed by a voice activity detection (VAD) stage. In the first pass, high-energy segments…

Sound · Computer Science 2022-01-12 Zheng-Hua Tan , Achintya kr. Sarkar , Najim Dehak

This paper delves into the challenging task of Active Speaker Detection (ASD), where the system needs to determine in real-time whether a person is speaking or not in a series of video frames. While previous works have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Arnav Kundu , Yanzi Jin , Mohammad Sekhavat , Max Horton , Danny Tormoen , Devang Naik

Speech applications are expected to be low-power and robust under noisy conditions. An effective Voice Activity Detection (VAD) front-end lowers the computational need. Spiking Neural Networks (SNNs) are known to be biologically plausible…

Sound · Computer Science 2024-03-12 Qu Yang , Qianhui Liu , Nan Li , Meng Ge , Zeyang Song , Haizhou Li

The task of voice activity detection (VAD) is an often required module in various speech processing, analysis and classification tasks. While state-of-the-art neural network based VADs can achieve great results, they often exceed…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-20 Sebastian Braun , Ivan Tashev

In a speech recognition system, voice activity detection (VAD) is a crucial frontend module. Addressing the issues of poor noise robustness in traditional binary VAD systems based on DFSMN, the paper further proposes semantic VAD based on…

Sound · Computer Science 2023-12-25 Lingyun Zuo , Keyu An , Shiliang Zhang , Zhijie Yan

Voice activity detection (VAD) makes a distinction between speech and non-speech and its performance is of crucial importance for speech based services. Recently, deep neural network (DNN)-based VADs have achieved better performance than…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Zhenpeng Zheng , Jianzong Wang , Ning Cheng , Jian Luo , Jing Xiao

Robots are becoming everyday devices, increasing their interaction with humans. To make human-machine interaction more natural, cognitive features like Visual Voice Activity Detection (VVAD), which can detect whether a person is speaking or…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Adrian Lubitz , Matias Valdenegro-Toro , Frank Kirchner

Voice Activity Detection (VAD) is the process of automatically determining whether a person is speaking and identifying the timing of their speech in an audiovisual data. Traditionally, this task has been tackled by processing either audio…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Andrea Appiani , Cigdem Beyan

Voice Activity Detection (VAD) refers to the problem of distinguishing speech segments from background noise. Numerous approaches have been proposed for this purpose. Some are based on features derived from the power spectral density,…

Sound · Computer Science 2019-03-08 Thomas Drugman , Yannis Stylianou , Yusuke Kida , Masami Akamine

Voice activity detection is an essential pre-processing component for speech-related tasks such as automatic speech recognition (ASR). Traditional supervised VAD systems obtain frame-level labels from an ASR pipeline by using, e.g., a…

Sound · Computer Science 2021-05-11 Heinrich Dinkel , Shuai Wang , Xuenan Xu , Mengyue Wu , Kai Yu

Voice Activity Detection (VAD) refers to the task of identification of regions of human speech in digital signals such as audio and video. While VAD is a necessary first step in many speech processing systems, it poses challenges when there…

Machine Learning · Computer Science 2020-08-24 Arnab Kumar Mondal , Prathosh A. P

In this work we present a novel single-channel Voice Activity Detector (VAD) approach. We utilize a Convolutional Neural Network (CNN) which exploits the spatial information of the noisy input spectrum to extract frame-wise embedding…

Sound · Computer Science 2022-03-08 Amit Sofer , Shlomo E. Chazan

Voice activity detection (VAD) remains a challenge in noisy environments. With access to multiple microphones, prior studies have attempted to improve the noise robustness of VAD by creating multi-channel VAD (MVAD) methods. However, MVAD…

Voice activity detection (VAD) is essential in speech-based systems, but traditional methods detect only speech presence without identifying speakers. Target-speaker VAD (TS-VAD) extends this by detecting the speech of a known speaker using…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-16 Wen-Yung Wu , Pei-Chin Hsieh , Tai-Shih Chi