English
Related papers

Related papers: Lip-reading with Densely Connected Temporal Convol…

200 papers

Majority of the recent approaches for text-independent speaker recognition apply attention or similar techniques for aggregation of frame-level feature descriptors generated by a deep neural network (DNN) front-end. In this paper, we…

Sound · Computer Science 2019-10-22 Sarthak Yadav , Atul Rai

The success of deep learning often derives from well-chosen operational building blocks. In this work, we revise the temporal convolution operation in CNNs to better adapt it to text processing. Instead of concatenating word…

Computation and Language · Computer Science 2015-08-19 Tao Lei , Regina Barzilay , Tommi Jaakkola

The success of self-attention in NLP has led to recent applications in end-to-end encoder-decoder architectures for speech recognition. Separately, connectionist temporal classification (CTC) has matured as an alignment-free,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Julian Salazar , Katrin Kirchhoff , Zhiheng Huang

Porting state of the art deep learning algorithms to resource constrained compute platforms (e.g. VR, AR, wearables) is extremely challenging. We propose a fast, compact, and accurate model for convolutional neural networks that enables…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Hessam Bagherinezhad , Mohammad Rastegari , Ali Farhadi

Deep learning approaches have been widely used in Automatic Speech Recognition (ASR) and they have achieved a significant accuracy improvement. Especially, Convolutional Neural Networks (CNNs) have been revisited in ASR recently. However,…

Computation and Language · Computer Science 2017-02-28 Yisen Wang , Xuejiao Deng , Songbai Pu , Zhiheng Huang

Deep learning based single-channel speech enhancement tries to train a neural network model for the prediction of clean speech signal. There are a variety of popular network structures for single-channel speech enhancement, such as TCNN,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-04 Xupeng Jia , Dongmei Li

Recurrent neural nets (RNN) and convolutional neural nets (CNN) are widely used on NLP tasks to capture the long-term and local dependencies, respectively. Attention mechanisms have recently attracted enormous interest due to their highly…

Computation and Language · Computer Science 2017-11-22 Tao Shen , Tianyi Zhou , Guodong Long , Jing Jiang , Shirui Pan , Chengqi Zhang

Reading text in the wild is a challenging task in the field of computer vision. Existing approaches mainly adopted Connectionist Temporal Classification (CTC) or Attention models based on Recurrent Neural Network (RNN), which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yunze Gao , Yingying Chen , Jinqiao Wang , Hanqing Lu

Formant tracking is one of the most fundamental problems in speech processing. Traditionally, formants are estimated using signal processing methods. Recent studies showed that generic convolutional architectures can outperform recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Wang Dai , Jinsong Zhang , Yingming Gao , Wei Wei , Dengfeng Ke , Binghuai Lin , Yanlu Xie

This paper proposes a novel framework for lung sound event detection, segmenting continuous lung sound recordings into discrete events and performing recognition on each event. Exploiting the lightweight nature of Temporal Convolution…

Sentence classification is one of the basic tasks of natural language processing. Convolution neural network (CNN) has the ability to extract n-grams features through convolutional filters and capture local correlations between consecutive…

Computation and Language · Computer Science 2023-12-12 Shandong Yuan

Speech enhancement has benefited from the success of deep learning in terms of intelligibility and perceptual quality. Conventional time-frequency (TF) domain methods focus on predicting TF-masks or speech spectrum, via a naive convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-24 Yanxin Hu , Yun Liu , Shubo Lv , Mengtao Xing , Shimin Zhang , Yihui Fu , Jian Wu , Bihong Zhang , Lei Xie

In this paper, we present a time-contrastive learning (TCL) based bottleneck (BN)feature extraction method for speech signals with an application to text-dependent (TD) speaker verification (SV). It is well-known that speech signals exhibit…

Sound · Computer Science 2019-05-14 Achintya Kr. Sarkar , Zheng-Hua Tan

In recent years, deep learning based machine lipreading has gained prominence. To this end, several architectures such as LipNet, LCANet and others have been proposed which perform extremely well compared to traditional lipreading DNN-HMM…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Dilip Kumar Margam , Rohith Aralikatti , Tanay Sharma , Abhinav Thanda , Pujitha A K , Sharad Roy , Shankar M Venkatesan

This paper explores the use of convolution LSTMs to simultaneously learn spatial- and temporal-information in videos. A deep network of convolutional LSTMs allows the model to access the entire range of temporal information at all spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Logan Courtney , Ramavarapu Sreenivas

There are a number of studies about extraction of bottleneck (BN) features from deep neural networks (DNNs)trained to discriminate speakers, pass-phrases and triphone states for improving the performance of text-dependent speaker…

Sound · Computer Science 2019-05-14 Achintya kr. Sarkar , Zheng-Hua Tan , Hao Tang , Suwon Shon , James Glass

Speech enhancement algorithms based on deep learning have been improved in terms of speech intelligibility and perceptual quality greatly. Many methods focus on enhancing the amplitude spectrum while reconstructing speech using the mixture…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-10 Qinglong Li , Fei Gao , Haixin Guan , Kaichi Ma

We develop a Deep-Text Recurrent Network (DTRN) that regards scene text reading as a sequence labelling problem. We leverage recent advances of deep convolutional neural networks to generate an ordered high-level sequence from a whole word…

Computer Vision and Pattern Recognition · Computer Science 2015-12-22 Pan He , Weilin Huang , Yu Qiao , Chen Change Loy , Xiaoou Tang

In this paper, we propose a novel deep learning architecture to improving word-level lip-reading. On the one hand, we first introduce the multi-scale processing into the spatial feature extraction for lip-reading. Specially, we proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hang Chen , Jun Du , Yu Hu , Li-Rong Dai , Chin-Hui Lee , Bao-Cai Yin

Deep dilated temporal convolutional networks (TCN) have been proved to be very effective in sequence modeling. In this paper we propose several improvements of TCN for end-to-end approach to monaural speech separation, which consists of 1)…

Sound · Computer Science 2023-06-27 Liwen Zhang , Ziqiang Shi , Jiqing Han , Anyan Shi , Ding Ma