English
Related papers

Related papers: Voice Activity Detection (VAD) in Noisy Environmen…

200 papers

Voice activity detection is an essential pre-processing component for speech-related tasks such as automatic speech recognition (ASR). Traditional supervised VAD systems obtain frame-level labels from an ASR pipeline by using, e.g., a…

Sound · Computer Science 2021-05-11 Heinrich Dinkel , Shuai Wang , Xuenan Xu , Mengyue Wu , Kai Yu

In this paper, we propose "personal VAD", a system to detect the voice activity of a target speaker at the frame level. This system is useful for gating the inputs to a streaming on-device speech recognition system, such that it only…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Shaojin Ding , Quan Wang , Shuo-yiin Chang , Li Wan , Ignacio Lopez Moreno

Speech applications are expected to be low-power and robust under noisy conditions. An effective Voice Activity Detection (VAD) front-end lowers the computational need. Spiking Neural Networks (SNNs) are known to be biologically plausible…

Sound · Computer Science 2024-03-12 Qu Yang , Qianhui Liu , Nan Li , Meng Ge , Zeyang Song , Haizhou Li

This paper presents an unsupervised segment-based method for robust voice activity detection (rVAD). The method consists of two passes of denoising followed by a voice activity detection (VAD) stage. In the first pass, high-energy segments…

Sound · Computer Science 2022-01-12 Zheng-Hua Tan , Achintya kr. Sarkar , Najim Dehak

Voice Activity Detection (VAD) is a fundamental module in many audio applications. Recent state-of-the-art VAD systems are often based on neural networks, but they require a computational budget that usually exceeds the capabilities of a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-07 Niccolo' Polvani , Damien Ronssin , Milos Cernak

Speech activity detection (SAD), which often rests on the fact that the noise is "more" stationary than speech, is particularly challenging in non-stationary environments, because the time variance of the acoustic scene makes it difficult…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Jens Heitkaemper , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

Speech activity detection (SAD) is an essential component for a variety of speech processing applications. It has been observed that performances of various speech based tasks are very much dependent on the efficiency of the SAD. In this…

Multimedia · Computer Science 2012-10-09 Md. Sahidullah , Goutam Saha

Sociometric badges are an emerging technology for study how teams interact in physical places. Audio data recorded by sociometric badges is often downsampled to not record discussions of the sociometric badges holders. To gain more…

In this study, we propose an encoder-decoder structured system with fully convolutional networks to implement voice activity detection (VAD) directly on the time-domain waveform. The proposed system processes the input waveform to identify…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-22 Cheng Yu , Kuo-Hsuan Hung , I-Fan Lin , Szu-Wei Fu , Yu Tsao , Jeih-weih Hung

Voice Activity Detection (VAD) aims at detecting speech segments on an audio signal, which is a necessary first step for many today's speech based applications. Current state-of-the-art methods focus on training a neural network exploiting…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-23 Sina Alisamir , Fabien Ringeval , Francois Portet

Recent advances in Visual Anomaly Detection (VAD) have introduced sophisticated algorithms leveraging embeddings generated by pre-trained feature extractors. Inspired by these developments, we investigate the adaptation of such algorithms…

We address voice activity detection in acoustic environments of transients and stationary noises, which often occur in real life scenarios. We exploit unique spatial patterns of speech and non-speech audio frames by independently learning…

Sound · Computer Science 2021-06-28 Amir Ivry , Baruch Berdugo , Israel Cohen

For speech interaction, voice activity detection (VAD) is often used as a front-end. However, traditional VAD algorithms usually need to wait for a continuous tail silence to reach a preset maximum duration before segmentation, resulting in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Mohan Shi , Yuchun Shu , Lingyun Zuo , Qian Chen , Shiliang Zhang , Jie Zhang , Li-Rong Dai

Voice activity detection (VAD) makes a distinction between speech and non-speech and its performance is of crucial importance for speech based services. Recently, deep neural network (DNN)-based VADs have achieved better performance than…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Zhenpeng Zheng , Jianzong Wang , Ning Cheng , Jian Luo , Jing Xiao

Target-Speaker Voice Activity Detection (TS-VAD) is the task of detecting the presence of speech from a known target-speaker in an audio frame. Recently, deep neural network-based models have shown good performance in this task. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Holger Severin Bovbjerg , Jan Østergaard , Jesper Jensen , Zheng-Hua Tan

Recently, the deep-belief-networks (DBN) based voice activity detection (VAD) has been proposed. It is powerful in fusing the advantages of multiple features, and achieves the state-of-the-art performance. However, the deep layers of the…

Machine Learning · Computer Science 2013-11-05 Xiao-Lei Zhang , Ji Wu

In this paper, we show how to use audio to supervise the learning of active speaker detection in video. Voice Activity Detection (VAD) guides the learning of the vision-based classifier in a weakly supervised manner. The classifier uses…

Computer Vision and Pattern Recognition · Computer Science 2016-03-30 Punarjay Chakravarty , Tinne Tuytelaars

Traditional supervised voice activity detection (VAD) methods work well in clean and controlled scenarios, with performance severely degrading in real-world applications. One possible bottleneck is that speech in the wild contains…

Sound · Computer Science 2020-08-18 Heinrich Dinkel , Yefei Chen , Mengyue Wu , Kai Yu

Isolating the voice of a specific person while filtering out other voices or background noises is challenging when video is shot in noisy environments. We propose audio-visual methods to isolate the voice of a single speaker and eliminate…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Aviv Gabbay , Ariel Ephrat , Tavi Halperin , Shmuel Peleg

In this work we present a novel single-channel Voice Activity Detector (VAD) approach. We utilize a Convolutional Neural Network (CNN) which exploits the spatial information of the noisy input spectrum to extract frame-wise embedding…

Sound · Computer Science 2022-03-08 Amit Sofer , Shlomo E. Chazan