中文
相关论文

相关论文: Conformer: Convolution-augmented Transformer for S…

200 篇论文

Recently, several types of end-to-end speech recognition methods named transformer-transducer were introduced. According to those kinds of methods, transcription networks are generally modeled by transformer-based neural networks, while…

机器学习 · 计算机科学 2020-11-03 Jae-Jin Jeon , Eesung Kim

This paper introduces a convolutional recurrent network with attention for speech command recognition. Attention models are powerful tools to improve performance on natural language, image captioning and speech tasks. The proposed model…

音频与语音处理 · 电气工程与系统科学 2018-08-28 Douglas Coimbra de Andrade , Sabato Leo , Martin Loesener Da Silva Viana , Christoph Bernkopf

This paper proposes a Sub-band Convolutional Neural Network for spoken term classification. Convolutional neural networks (CNNs) have proven to be very effective in acoustic applications such as spoken term classification, keyword spotting,…

音频与语音处理 · 电气工程与系统科学 2019-07-03 Chieh-Chi Kao , Ming Sun , Yixin Gao , Shiv Vitaladevuni , Chao Wang

End-to-end models are favored in automatic speech recognition (ASR) because of their simplified system structure and superior performance. Among these models, Transformer and Conformer have achieved state-of-the-art recognition accuracy in…

声音 · 计算机科学 2021-06-18 Xiong Wang , Sining Sun , Lei Xie , Long Ma

Automatic speech recognition systems have been largely improved in the past few decades and current systems are mainly hybrid-based and end-to-end-based. The recently proposed CTC-CRF framework inherits the data-efficiency of the hybrid…

音频与语音处理 · 电气工程与系统科学 2021-07-09 Huahuan Zheng , Wenjie Peng , Zhijian Ou , Jinsong Zhang

Modeling unit and model architecture are two key factors of Recurrent Neural Network Transducer (RNN-T) in end-to-end speech recognition. To improve the performance of RNN-T for Mandarin speech recognition task, a novel transformer…

音频与语音处理 · 电气工程与系统科学 2020-04-29 Li Fu , Xiaoxiao Li , Libo Zi

General-purpose pretrained sentence encoders such as BERT are not ideal for real-world conversational AI applications; they are computationally heavy, slow, and expensive to train. We propose ConveRT (Conversational Representations from…

计算与语言 · 计算机科学 2020-04-30 Matthew Henderson , Iñigo Casanueva , Nikola Mrkšić , Pei-Hao Su , Tsung-Hsien Wen , Ivan Vulić

Automatic Speech Recognition (ASR) in conversational settings presents unique challenges, including extracting relevant contextual information from previous conversational turns. Due to irrelevant content, error propagation, and redundancy,…

声音 · 计算机科学 2024-04-30 Kun Wei , Bei Li , Hang Lv , Quan Lu , Ning Jiang , Lei Xie

End-to-end automatic speech recognition (ASR) models with a single neural network have recently demonstrated state-of-the-art results compared to conventional hybrid speech recognizers. Specifically, recurrent neural network transducer…

计算与语言 · 计算机科学 2020-11-10 Chunxi Liu , Frank Zhang , Duc Le , Suyoun Kim , Yatharth Saraf , Geoffrey Zweig

Recognizing emotions from speech using machine learning has become an active research area due to its importance in building human-centered applications. However, while many studies have been conducted in English, German, and other European…

计算与语言 · 计算机科学 2026-04-10 Youcef Soufiane Gheffari , Oussama Mustapha Benouddane , Samiya Silarbi

In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model. Our results demonstrate that transformer…

音频与语音处理 · 电气工程与系统科学 2020-05-06 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed H Tewfik

We study transfer learning in convolutional network architectures applied to the task of recognizing audio, such as environmental sound events and speech commands. Our key finding is that not only is it possible to transfer representations…

声音 · 计算机科学 2017-10-24 Brian McMahan , Delip Rao

Although convolutional neural networks (CNNs) have achieved remarkable progress in weakly supervised semantic segmentation (WSSS), the effective receptive field of CNN is insufficient to capture global context information, leading to…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Chunmeng Liu , Enze Xie , Wenjia Wang , Wenhai Wang , Guangyao Li , Ping Luo

In this paper, a novel method using 3D Convolutional Neural Network (3D-CNN) architecture has been proposed for speaker verification in the text-independent setting. One of the main challenges is the creation of the speaker models. Most of…

计算机视觉与模式识别 · 计算机科学 2018-06-08 Amirsina Torfi , Jeremy Dawson , Nasser M. Nasrabadi

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

机器学习 · 计算机科学 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Context cues carry information which can improve multi-turn interactions in automatic speech recognition (ASR) systems. In this paper, we introduce a novel mechanism inspired by hyper-prompting to fuse textual context with acoustic…

Auditory models are commonly used as feature extractors for automatic speech-recognition systems or as front-ends for robotics, machine-hearing and hearing-aid applications. Although auditory models can capture the biophysical and nonlinear…

音频与语音处理 · 电气工程与系统科学 2021-02-09 Deepak Baby , Arthur Van Den Broucke , Sarah Verhulst

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

Recurrent Neural Networks (RNNs) have long been the dominant architecture in sequence-to-sequence learning. RNNs, however, are inherently sequential models that do not allow parallelization of their computations. Transformers are emerging…

音频与语音处理 · 电气工程与系统科学 2021-03-10 Cem Subakan , Mirco Ravanelli , Samuele Cornell , Mirko Bronzi , Jianyuan Zhong