English
Related papers

Related papers: Voice activity detection in the wild via weakly su…

200 papers

Recently, the deep-belief-networks (DBN) based voice activity detection (VAD) has been proposed. It is powerful in fusing the advantages of multiple features, and achieves the state-of-the-art performance. However, the deep layers of the…

Machine Learning · Computer Science 2013-11-05 Xiao-Lei Zhang , Ji Wu

Speech activity detection (SAD) plays an important role in current speech processing systems, including automatic speech recognition (ASR). SAD is particularly difficult in environments with acoustic noise. A practical solution is to…

Computation and Language · Computer Science 2023-05-15 Fei Tao , Carlos Busso

Sound event detection (SED) is typically posed as a supervised learning problem requiring training data with strong temporal labels of sound events. However, the production of datasets with strong labels normally requires unaffordable labor…

Sound · Computer Science 2018-11-02 Dezhi Wang , Lilun Zhang , Changchun Bao , Kele Xu , Boqing Zhu , Qiuqiang Kong

Robots are becoming everyday devices, increasing their interaction with humans. To make human-machine interaction more natural, cognitive features like Visual Voice Activity Detection (VVAD), which can detect whether a person is speaking or…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Adrian Lubitz , Matias Valdenegro-Toro , Frank Kirchner

Video Anomaly Detection (VAD) serves as a pivotal technology in the intelligent surveillance systems, enabling the temporal or spatial identification of anomalous events within videos. While existing reviews predominantly concentrate on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yang Liu , Dingkang Yang , Yan Wang , Jing Liu , Jun Liu , Azzedine Boukerche , Peng Sun , Liang Song

Speaker verification (SV) has recently attracted considerable research interest due to the growing popularity of virtual assistants. At the same time, there is an increasing requirement for an SV system: it should be robust to short speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-07 Youngmoon Jung , Yeunju Choi , Hyungjun Lim , Hoirin Kim

Robust voice activity detection (VAD) is a challenging task in low signal-to-noise (SNR) environments. Recent studies show that speech enhancement is helpful to VAD, but the performance improvement is limited. To address this issue, here we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-14 Xu Tan , Xiao-Lei Zhang

Target-Speaker Voice Activity Detection (TS-VAD) utilizes a set of speaker profiles alongside an input audio signal to perform speaker diarization. While its superiority over conventional methods has been demonstrated, the method can suffer…

Sound · Computer Science 2024-04-05 Dongmei Wang , Xiong Xiao , Naoyuki Kanda , Midia Yousefi , Takuya Yoshioka , Jian Wu

For speech interaction, voice activity detection (VAD) is often used as a front-end. However, traditional VAD algorithms usually need to wait for a continuous tail silence to reach a preset maximum duration before segmentation, resulting in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Mohan Shi , Yuchun Shu , Lingyun Zuo , Qian Chen , Shiliang Zhang , Jie Zhang , Li-Rong Dai

Personal voice activity detection has received increased attention due to the growing popularity of personal mobile devices and smart speakers. PVAD is often an integral element to speech enhancement and recognition for these applications…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Yicheng Hsu , Mingsian R. Bai

In this study, we propose an encoder-decoder structured system with fully convolutional networks to implement voice activity detection (VAD) directly on the time-domain waveform. The proposed system processes the input waveform to identify…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-22 Cheng Yu , Kuo-Hsuan Hung , I-Fan Lin , Szu-Wei Fu , Yu Tsao , Jeih-weih Hung

Detecting anchor's voice in live musical streams is an important preprocessing for music and speech signal processing. Existing approaches to voice activity detection (VAD) primarily rely on audio, however, audio-based VAD is difficult to…

Sound · Computer Science 2020-11-03 Yuanbo Hou , Yi Deng , Bilei Zhu , Zejun Ma , Dick Botteldooren

Audio-visual speaker diarization aims at detecting "who spoke when" using both auditory and visual signals. Existing audio-visual diarization datasets are mainly focused on indoor environments like meeting rooms or news studios, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Eric Zhongcong Xu , Zeyang Song , Satoshi Tsutsui , Chao Feng , Mang Ye , Mike Zheng Shou

Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Huajian Fang , Guillaume Carbajal , Stefan Wermter , Timo Gerkmann

Keyword spotting (KWS) and speaker verification (SV) have been studied independently although it is known that acoustic and speaker domains are complementary. In this paper, we propose a multi-task network that performs KWS and SV…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Myunghun Jung , Youngmoon Jung , Jahyun Goo , Hoirin Kim

A distributed multi-speaker voice activity detection (DM-VAD) method for wireless acoustic sensor networks (WASNs) is proposed. DM-VAD is required in many signal processing applications, e.g. distributed speech enhancement based on…

Voice activity and overlapped speech detection (respectively VAD and OSD) are key pre-processing tasks for speaker diarization. The final segmentation performance highly relies on the robustness of these sub-tasks. Recent studies have shown…

Video anomaly detection (VAD) aims to temporally locate abnormal events in a video. Existing works mostly rely on training deep models to learn the distribution of normality with either video-level supervision, one-class supervision, or in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Luca Zanella , Willi Menapace , Massimiliano Mancini , Yiming Wang , Elisa Ricci

Voice Activity Detection (VAD) plays a key role in speech processing, often utilizing hand-crafted or neural features. This study examines the effectiveness of Mel-Frequency Cepstral Coefficients (MFCCs) and pre-trained model (PTM)…

Sound · Computer Science 2025-06-03 Kumud Tripathi , Chowdam Venkata Kumar , Pankaj Wasnik

Video Anomaly Detection (VAD) automates the identification of unusual events, such as security threats in surveillance videos. In real-world applications, VAD models must effectively operate in cross-domain settings, identifying rare…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Yashika Jain , Ali Dabouei , Min Xu