English
Related papers

Related papers: Knowledge Distillation from BERT Transformer to Sp…

200 papers

Learning on a massive amount of speech corpus leads to the recent success of many self-supervised speech models. With knowledge distillation, these models may also benefit from the knowledge encoded by language models that are pre-trained…

Computation and Language · Computer Science 2023-03-08 Jinjie Ni , Yukun Ma , Wen Wang , Qian Chen , Dianwen Ng , Han Lei , Trung Hieu Nguyen , Chong Zhang , Bin Ma , Erik Cambria

Recently, attention-based transformers have become a de facto standard in many deep learning applications including natural language processing, computer vision, signal processing, etc.. In this paper, we propose a transformer-based…

Sound · Computer Science 2024-09-04 Tathagata Bandyopadhyay

We present a novel large-context end-to-end automatic speech recognition (E2E-ASR) model and its effective training method based on knowledge distillation. Common E2E-ASR models have mainly focused on utterance-level processing in which…

Computation and Language · Computer Science 2021-02-17 Ryo Masumura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi

Many recent works on knowledge distillation have provided ways to transfer the knowledge of a trained network for improving the learning process of a new one, but finding a good technique for knowledge distillation is still an open problem.…

Machine Learning · Computer Science 2018-12-17 Byeongho Heo , Minsik Lee , Sangdoo Yun , Jin Young Choi

As Transfer Learning from large-scale pre-trained models becomes more prevalent in Natural Language Processing (NLP), operating these large models in on-the-edge and/or under constrained computational training or inference budgets remains…

Computation and Language · Computer Science 2020-03-03 Victor Sanh , Lysandre Debut , Julien Chaumond , Thomas Wolf

This work explores optimizing transformer-based language models by integrating model compression techniques with inhibitor attention, a novel alternative attention mechanism. Inhibitor attention employs Manhattan distances and ReLU…

Computation and Language · Computer Science 2025-03-21 Tony Zhang , Rickard Brännvall

Audio token modeling has become a powerful framework for speech synthesis, with two-stage approaches employing semantic tokens remaining prevalent. In this paper, we aim to simplify this process by introducing a semantic knowledge…

Sound · Computer Science 2024-09-18 Gerard I. Gállego , Roy Fejgin , Chunghsin Yeh , Xiaoyu Liu , Gautam Bhattacharya

Large language models having hundreds of millions, and even billions, of parameters have performed extremely well on a variety of natural language processing (NLP) tasks. Their widespread use and adoption, however, is hindered by the lack…

Computation and Language · Computer Science 2022-12-23 Dan DeGenaro , Jugal Kalita

We propose a novel knowledge distillation approach to facilitate the transfer of dark knowledge from a teacher to a student. Contrary to most of the existing methods that rely on effective training of student models given pretrained…

Machine Learning · Computer Science 2022-01-25 Dae Young Park , Moon-Hyun Cha , Changwook Jeong , Dae Sin Kim , Bohyung Han

Relevance has significant impact on user experience and business profit for e-commerce search platform. In this work, we propose a data-driven framework for search relevance prediction, by distilling knowledge from BERT and related…

Machine Learning · Computer Science 2020-10-21 Yunjiang Jiang , Yue Shang , Ziyang Liu , Hongwei Shen , Yun Xiao , Wei Xiong , Sulong Xu , Weipeng Yan , Di Jin

Recently, large pre-trained models have significantly improved the performance of various Natural LanguageProcessing (NLP) tasks but they are expensive to serve due to long serving latency and large memory usage. To compress these models,…

Machine Learning · Computer Science 2022-01-24 Xiaofan Zhang , Zongwei Zhou , Deming Chen , Yu Emma Wang

Audio-visual representation learning is crucial for advancing multimodal speech processing tasks, such as lipreading and audio-visual speech recognition. Recently, speech foundation models (SFMs) have shown remarkable generalization…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-11 Jing-Xuan Zhang , Genshun Wan , Jianqing Gao , Zhen-Hua Ling

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

Computation and Language · Computer Science 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

Generated hateful and toxic content by a portion of users in social media is a rising phenomenon that motivated researchers to dedicate substantial efforts to the challenging direction of hateful content identification. We not only need an…

Social and Information Networks · Computer Science 2019-10-29 Marzieh Mozafari , Reza Farahbakhsh , Noel Crespi

The emergence of Large Audio-Language Models (LALMs) has advanced Speech Emotion Recognition (SER), but their size limits deployment in resource-constrained environments. While Knowledge Distillation is effective for LALM compression,…

While various end-to-end models for spoken language understanding tasks have been explored recently, this paper is probably the first known attempt to challenge the very difficult task of end-to-end spoken question answering (SQA). Learning…

Computation and Language · Computer Science 2020-08-12 Yung-Sung Chuang , Chi-Liang Liu , Hung-Yi Lee , Lin-shan Lee

Massively multilingual Transformers (MMTs), such as mBERT and XLM-R, are widely used for cross-lingual transfer learning. While these are pretrained to represent hundreds of languages, end users of NLP systems are often interested only in…

Computation and Language · Computer Science 2023-06-05 Alan Ansell , Edoardo Maria Ponti , Anna Korhonen , Ivan Vulić

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

Sound · Computer Science 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

This paper presents an end-to-end high-quality singing voice synthesis (SVS) system that uses bidirectional encoder representation from Transformers (BERT) derived semantic embeddings to improve the expressiveness of the synthesized singing…

Sound · Computer Science 2023-09-01 Shaohuan Zhou , Shun Lei , Weiya You , Deyi Tuo , Yuren You , Zhiyong Wu , Shiyin Kang , Helen Meng