English
Related papers

Related papers: CNN self-attention voice activity detector

200 papers

In this paper, we propose a Convolutional Neural Network (CNN) based speaker recognition model for extracting robust speaker embeddings. The embedding can be extracted efficiently with linear activation in the embedding layer. To understand…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-13 Suwon Shon , Hao Tang , James Glass

Scene recognition is currently one of the top-challenging research fields in computer vision. This may be due to the ambiguity between classes: images of several scene classes may share similar objects, which causes confusion among them.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Alejandro López-Cifuentes , Marcos Escudero-Viñolo , Jesús Bescós , Álvaro García-Martín

In this work, we propose novel decoding algorithms to enable streaming automatic speech recognition (ASR) on unsegmented long-form recordings without voice activity detection (VAD), based on monotonic chunkwise attention (MoChA) with an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-16 Hirofumi Inaguma , Tatsuya Kawahara

Self-attention has been successfully applied to video representation learning due to the effectiveness of modeling long range dependencies. Existing approaches build the dependencies merely by computing the pairwise correlations along…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Xudong Guo , Xun Guo , Yan Lu

Speech activity detection (SAD), which often rests on the fact that the noise is "more" stationary than speech, is particularly challenging in non-stationary environments, because the time variance of the acoustic scene makes it difficult…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-29 Jens Heitkaemper , Joerg Schmalenstroeer , Reinhold Haeb-Umbach

Attention-based beamformers have recently been shown to be effective for multi-channel speech recognition. However, they are less capable at capturing local information. In this work, we propose a 2D Conv-Attention module which combines…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Bhargav Pulugundla , Yang Gao , Brian King , Gokce Keskin , Harish Mallidi , Minhua Wu , Jasha Droppo , Roland Maas

This paper demonstrates the potential of convolutional neural networks (CNN) for detecting and classifying prosodic events on words, specifically pitch accents and phrase boundary tones, from frame-based acoustic features. Typical…

Computation and Language · Computer Science 2017-06-05 Sabrina Stehwien , Ngoc Thang Vu

Multi-organ segmentation is one of most successful applications of deep learning in medical image analysis. Deep convolutional neural nets (CNNs) have shown great promise in achieving clinically applicable image segmentation performance on…

Image and Video Processing · Electrical Eng. & Systems 2020-12-18 Hao Tang , Xingwei Liu , Kun Han , Shanlin Sun , Narisu Bai , Xuming Chen , Huang Qian , Yong Liu , Xiaohui Xie

In this paper, adaptive mechanisms are applied in deep neural network (DNN) training for x-vector-based text-independent speaker verification. First, adaptive convolutional neural networks (ACNNs) are employed in frame-level embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-18 Bin Gu , Wu Guo , Lirong Dai , Jun Du

This paper presents a novel framework for Speech Activity Detection (SAD). Inspired by the recent success of multi-task learning approaches in the speech processing domain, we propose a novel joint learning framework for SAD. We utilise…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-06 Tharindu Fernando , Sridha Sridharan , Mitchell McLaren , Darshana Priyasad , Simon Denman , Clinton Fookes

Music source separation has been a popular topic in signal processing for decades, not only because of its technical difficulty, but also due to its importance to many commercial applications, such as automatic karoake and remixing. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-23 Yuzhou Liu , Balaji Thoshkahna , Ali Milani , Trausti Kristjansson

This paper proposes a Sub-band Convolutional Neural Network for spoken term classification. Convolutional neural networks (CNNs) have proven to be very effective in acoustic applications such as spoken term classification, keyword spotting,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-03 Chieh-Chi Kao , Ming Sun , Yixin Gao , Shiv Vitaladevuni , Chao Wang

We propose supervised systems for speech activity detection (SAD) and speaker identification (SID) tasks in Fearless Steps Challenge Phase-2. The proposed systems for both the tasks share a common convolutional neural network (CNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Karthik Pandia D S , Cosimo Spera

Recent advances in Visual Anomaly Detection (VAD) have introduced sophisticated algorithms leveraging embeddings generated by pre-trained feature extractors. Inspired by these developments, we investigate the adaptation of such algorithms…

Audio classification is considered as a challenging problem in pattern recognition. Recently, many algorithms have been proposed using deep neural networks. In this paper, we introduce a new attention-based neural network architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 Haoye Lu , Haolong Zhang , Amit Nayak

Deep learning approaches have been widely used in Automatic Speech Recognition (ASR) and they have achieved a significant accuracy improvement. Especially, Convolutional Neural Networks (CNNs) have been revisited in ASR recently. However,…

Computation and Language · Computer Science 2017-02-28 Yisen Wang , Xuejiao Deng , Songbai Pu , Zhiheng Huang

In this paper, a novel method using 3D Convolutional Neural Network (3D-CNN) architecture has been proposed for speaker verification in the text-independent setting. One of the main challenges is the creation of the speaker models. Most of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Amirsina Torfi , Jeremy Dawson , Nasser M. Nasrabadi

Virtual sensing (VS) technology enables active noise control (ANC) systems to attenuate noise at virtual locations distant from the physical error microphones. Appropriate auxiliary filters (AF) can significantly enhance the effectiveness…

Signal Processing · Electrical Eng. & Systems 2024-09-10 Boxiang Wang , Dongyuan Shi , Zhengding Luo , Xiaoyi Shen , Junwei Ji , Woon-Seng Gan

The recognition of actions from video sequences has many applications in health monitoring, assisted living, surveillance, and smart homes. Despite advances in sensing, in particular related to 3D video, the methodologies to process the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-03 Rui Zhao , Haider Ali , Patrick van der Smagt

A patch-based convolutional neural network (CNN) model presented in this paper for vocal melody extraction in polyphonic music is inspired from object detection in image processing. The input of the model is a novel time-frequency…

Sound · Computer Science 2018-04-26 Li Su