English
Related papers

Related papers: A Hybrid CNN-BiLSTM Voice Activity Detector

200 papers

The ongoing biodiversity crisis, driven by factors such as land-use change and global warming, emphasizes the need for effective ecological monitoring methods. Acoustic monitoring of biodiversity has emerged as an important monitoring tool.…

Sound · Computer Science 2023-12-18 Drew Priebe , Burooj Ghani , Dan Stowell

In this paper, we propose a stacked convolutional and recurrent neural network (CRNN) with a 3D convolutional neural network (CNN) in the first layer for the multichannel sound event detection (SED) task. The 3D CNN enables the network to…

Sound · Computer Science 2018-01-30 Sharath Adavanne , Archontis Politis , Tuomas Virtanen

One of the main open challenges in visual odometry (VO) is the robustness to difficult illumination conditions or high dynamic range (HDR) environments. The main difficulties in these situations come from both the limitations of the sensors…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Ruben Gomez-Ojeda , Zichao Zhang , Javier Gonzalez-Jimenez , Davide Scaramuzza

This paper proposes a Sub-band Convolutional Neural Network for spoken term classification. Convolutional neural networks (CNNs) have proven to be very effective in acoustic applications such as spoken term classification, keyword spotting,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-03 Chieh-Chi Kao , Ming Sun , Yixin Gao , Shiv Vitaladevuni , Chao Wang

Higher penetration of renewable and smart home technologies at the residential level challenges grid stability as utility-customer interactions add complexity to power system operations. In response, short-term residential load forecasting…

Machine Learning · Computer Science 2023-02-13 Bharat Bohara , Raymond I. Fernandez , Vysali Gollapudi , Xingpeng Li

This report describes our submission to the ActivityNet Challenge at CVPR 2019. We use a 3D convolutional neural network (CNN) based front-end and an ensemble of temporal convolution and LSTM classifiers to predict whether a visible person…

Sound · Computer Science 2019-06-26 Joon Son Chung

Target-Speaker Voice Activity Detection (TS-VAD) is the task of detecting the presence of speech from a known target-speaker in an audio frame. Recently, deep neural network-based models have shown good performance in this task. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-07 Holger Severin Bovbjerg , Jan Østergaard , Jesper Jensen , Zheng-Hua Tan

In a speech recognition system, voice activity detection (VAD) is a crucial frontend module. Addressing the issues of poor noise robustness in traditional binary VAD systems based on DFSMN, the paper further proposes semantic VAD based on…

Sound · Computer Science 2023-12-25 Lingyun Zuo , Keyu An , Shiliang Zhang , Zhijie Yan

This work analyzes how attention-based Bidirectional Long Short-Term Memory (BLSTM) models adapt to noise-augmented speech. We identify crucial components for noise adaptation in BLSTM models by freezing model components during fine-tuning.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-27 Coleman Hooper , Thierry Tambe , Gu-Yeon Wei

In recent times, non-intrusive load monitoring (NILM) has emerged as an important tool for distribution-level energy management systems owing to its potential for energy conservation and management. However, load monitoring in smart…

Systems and Control · Electrical Eng. & Systems 2022-06-01 Himanshu Grover , Lokesh Panwar , Ashu Verma , B. K. Panigrahi , T. S. Bhatti

In this paper, we propose hybrid real- and complex-valued neural networks for speech enhancement. Real- or complex-valued models are either inefficient or present high complexity. We devise a straightforward design method for extending a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-26 Luan Vinícius Fiorio , Alex Young , Ronald M. Aarts

Sleep-disordered breathing (SDB) is a serious and prevalent condition, and acoustic analysis via consumer devices (e.g. smartphones) offers a low-cost solution to screening for it. We present a novel approach for the acoustic identification…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-08 Hector E. Romero , Ning Ma , Guy J. Brown , Amy V. Beeston , Madina Hasan

Voice activity detection (VAD) is an essential pre-processing step for tasks such as automatic speech recognition (ASR) and speaker recognition. A basic goal is to remove silent segments within an audio, while a more general VAD system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Yefei Chen , Shuai Wang , Yanmin Qian , Kai Yu

Detecting anchor's voice in live musical streams is an important preprocessing for music and speech signal processing. Existing approaches to voice activity detection (VAD) primarily rely on audio, however, audio-based VAD is difficult to…

Sound · Computer Science 2020-11-03 Yuanbo Hou , Yi Deng , Bilei Zhu , Zejun Ma , Dick Botteldooren

Long short-term memory (LSTM) recurrent neural networks (RNNs) have been shown to give state-of-the-art performance on many speech recognition tasks, as they are able to provide the learned dynamically changing contextual window of all…

Computation and Language · Computer Science 2016-10-12 Xiangang Li , Xihong Wu

There still remains an extreme performance gap between Vision Transformers (ViTs) and Convolutional Neural Networks (CNNs) when training from scratch on small datasets, which is concluded to the lack of inductive bias. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhiying Lu , Hongtao Xie , Chuanbin Liu , Yongdong Zhang

To improve speech intelligibility and speech quality in noisy environments, binaural noise reduction algorithms for head-mounted assistive listening devices are of crucial importance. Several binaural noise reduction algorithms such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Marvin Tammen , Simon Doclo

Voice controlled virtual assistants (VAs) are now available in smartphones, cars, and standalone devices in homes. In most cases, the user needs to first "wake-up" the VA by saying a particular word/phrase every time he or she wants the VA…

Human-Computer Interaction · Computer Science 2019-02-05 Atta Norouzian , Bogdan Mazoure , Dermot Connolly , Daniel Willett

We previously established a large lung sound database, HF_Lung_V2 (Lung_V2). We trained convolutional-bidirectional gated recurrent unit (CNN-BiGRU) networks for detecting inhalation, exhalation, continuous adventitious sound (CAS) and…

Sound · Computer Science 2021-07-12 Fu-Shun Hsu , Shang-Ran Huang , Chien-Wen Huang , Chun-Chieh Chen , Yuan-Ren Cheng , Feipei Lai

This study explores the design and application of Complex-Valued Convolutional Neural Networks (CVCNNs) in audio signal processing, with a focus on preserving and utilizing phase information often neglected in real-valued networks. We begin…

Machine Learning · Computer Science 2025-10-14 Naman Agrawal