English
Related papers

Related papers: Knowledge Distillation from BERT Transformer to Sp…

200 papers

Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior…

Computation and Language · Computer Science 2020-08-11 Won Ik Cho , Donghyun Kwak , Ji Won Yoon , Nam Soo Kim

Recently, the advance in deep learning has brought a considerable improvement in the end-to-end speech recognition field, simplifying the traditional pipeline while producing promising results. Among the end-to-end models, the connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-29 Ji Won Yoon , Beom Jun Woo , Sunghwan Ahn , Hyeonseung Lee , Nam Soo Kim

Although large foundation models pre-trained by self-supervised learning have achieved state-of-the-art performance in many tasks including automatic speech recognition (ASR), knowledge distillation (KD) is often required in practice to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Xiaoyu Yang , Qiujia Li , Chao Zhang , Philip C. Woodland

Knowledge distillation is an approach to transfer information on representations from a teacher to a student by reducing their difference. A challenge of this approach is to reduce the flexibility of the student's representations inducing…

Computation and Language · Computer Science 2024-10-28 Hee-Jun Jung , Doyeon Kim , Seung-Hoon Na , Kangil Kim

Pre-trained contextual language models are ubiquitously employed for language understanding tasks, but are unsuitable for resource-constrained systems. Noncontextual word embeddings are an efficient alternative in these settings. Such…

Computation and Language · Computer Science 2023-04-24 Anik Saha , Alex Gittens , Bulent Yener

Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation…

Computation and Language · Computer Science 2024-04-24 Jingxuan Wei , Linzhuang Sun , Yichong Leng , Xu Tan , Bihui Yu , Ruifeng Guo

Speech emotion recognition (SER) is the task of recognising human's emotional states from speech. SER is extremely prevalent in helping dialogue systems to truly understand our emotions and become a trustworthy human conversational partner.…

Sound · Computer Science 2022-10-27 Zhao Ren , Thanh Tam Nguyen , Yi Chang , Björn W. Schuller

This paper describes a novel knowledge distillation framework that leverages acoustically qualified speech data included in an existing training data pool as privileged information. In our proposed framework, a student network is trained…

Sound · Computer Science 2021-12-17 Tohru Nagano , Takashi Fukuda , Gakuto Kurata

Recently, various intermediate layer distillation (ILD) objectives have been shown to improve compression of BERT models via Knowledge Distillation (KD). However, a comprehensive evaluation of the objectives in both task-specific and…

Computation and Language · Computer Science 2023-05-25 Xinpeng Wang , Leonie Weissweiler , Hinrich Schütze , Barbara Plank

Most End-to-End SLU methods depend on the pretrained ASR or language model features for intent prediction. However, other essential information in speech, such as prosody, is often ignored. Recent research has shown improved results in…

Computation and Language · Computer Science 2023-05-16 Shangeth Rajaa

In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Li Fu , Xiaoxiao Li , Libo Zi , Zhengchen Zhang , Youzheng Wu , Xiaodong He , Bowen Zhou

End-to-end speech recognition is a promising technology for enabling compact automatic speech recognition (ASR) systems since it can unify the acoustic and language model into a single neural network. However, as a drawback, training of…

Computation and Language · Computer Science 2022-02-17 Yotaro Kubo , Shigeki Karita , Michiel Bacchiani

Pre-trained language models such as BERT have proven to be highly effective for natural language processing (NLP) tasks. However, the high demand for computing resources in training such models hinders their application in practice. In…

Computation and Language · Computer Science 2019-08-27 Siqi Sun , Yu Cheng , Zhe Gan , Jingjing Liu

Deep language models such as BERT pre-trained on large corpus have given a huge performance boost to the state-of-the-art information retrieval ranking systems. Knowledge embedded in such models allows them to pick up complex matching…

Information Retrieval · Computer Science 2020-07-23 Luyu Gao , Zhuyun Dai , Jamie Callan

In this paper, we propose Stochastic Knowledge Distillation (SKD) to obtain compact BERT-style language model dubbed SKDBERT. In each iteration, SKD samples a teacher model from a pre-defined teacher ensemble, which consists of multiple…

Computation and Language · Computer Science 2022-11-30 Zixiang Ding , Guoqing Jiang , Shuai Zhang , Lin Guo , Wei Lin

While large audio language models excel at tasks like ASR and emotion recognition, they still struggle with complex reasoning due to the modality gap between audio and text as well as the lack of structured intermediate supervision. To…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Runyan Yang , Yuke Si , Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Multilingual speech data often suffer from long-tailed language distribution, resulting in performance degradation. However, multilingual text data is much easier to obtain, yielding a more useful general language model. Hence, we are…

Computation and Language · Computer Science 2022-06-28 Kwanghee Choi , Hyung-Min Park

This work focuses on the efficiency of the knowledge distillation approach in generating a lightweight yet powerful BERT based model for natural language processing applications. After the model creation, we applied the resulting model,…

Computation and Language · Computer Science 2024-11-04 Ahmed Akib Jawad Karim , Kazi Hafiz Md. Asad , Md. Golam Rabiul Alam

Knowledge distillation is an effective machine learning technique to transfer knowledge from a teacher model to a smaller student model, especially with unlabeled data. In this paper, we focus on knowledge distillation for the RNN-T model,…

Machine Learning · Computer Science 2022-11-01 Dongseong Hwang , Khe Chai Sim , Yu Zhang , Trevor Strohman

This paper studies compressing pre-trained language models, like BERT (Devlin et al.,2019), via teacher-student knowledge distillation. Previous works usually force the student model to strictly mimic the smoothed labels predicted by the…

Computation and Language · Computer Science 2020-05-11 Xing Wu , Yibing Liu , Xiangyang Zhou , Dianhai Yu