English
Related papers

Related papers: Towards domain generalisation in ASR with elitist …

200 papers

Compressing deep neural network (DNN) models becomes a very important and necessary technique for real-world applications, such as deploying those models on mobile devices. Knowledge distillation is one of the most popular methods for model…

Machine Learning · Computer Science 2020-03-02 Makoto Takamoto , Yusuke Morishita , Hitoshi Imaoka

We present a systematic study of domain generalization (DG) for tiny neural networks. This problem is critical to on-device machine learning applications but has been overlooked in the literature where research has been merely focused on…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Kaiyang Zhou , Yuanhan Zhang , Yuhang Zang , Jingkang Yang , Chen Change Loy , Ziwei Liu

Second-pass rescoring is employed in most state-of-the-art speech recognition systems. Recently, BERT based models have gained popularity for re-ranking the n-best hypothesis by exploiting the knowledge from masked language model…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Yile Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko

Knowledge distillation is a potential solution for model compression. The idea is to make a small student network imitate the target of a large teacher network, then the student network can be competitive to the teacher one. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2017-10-24 Chong Wang , Xipeng Lan , Yangang Zhang

Continued self-supervised (SSL) pre-training for adapting existing SSL models to the target domain has shown to be extremely effective for low-resource Automatic Speech Recognition (ASR). This paper proposes Stable Distillation, a simple…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-21 Ashish Seth , Sreyan Ghosh , S. Umesh , Dinesh Manocha

Logit-based knowledge distillation (KD) for classification is cost-efficient compared to feature-based KD but often subject to inferior performance. Recently, it was shown that the performance of logit-based KD can be improved by…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Hyungkeun Park , Jong-Seok Lee

We propose a method for unsupervised domain adaptation that trains a shared embedding to align the joint distributions of inputs (domain) and outputs (classes), making any classifier agnostic to the domain. Joint alignment ensures that not…

Machine Learning · Computer Science 2019-05-28 Safa Cicek , Stefano Soatto

Deep learning models for verification systems often fail to generalize to new users and new environments, even though they learn highly discriminative features. To address this problem, we propose a few-shot domain generalization framework…

Sound · Computer Science 2022-06-29 Seunghan Yang , Debasmit Das , Janghoon Cho , Hyoungwoo Park , Sungrack Yun

Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor…

Computation and Language · Computer Science 2020-12-29 Peyman Passban , Yimeng Wu , Mehdi Rezagholizadeh , Qun Liu

In recent years, there has been a great deal of research in developing end-to-end speech recognition models, which enable simplifying the traditional pipeline and achieving promising results. Despite their remarkable performance…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-20 Ji Won Yoon , Hyeonseung Lee , Hyung Yong Kim , Won Ik Cho , Nam Soo Kim

Tiny, causal models are crucial for embedded audio machine learning applications. Model compression can be achieved via distilling knowledge from a large teacher into a smaller student model. In this work, we propose a novel two-step…

Sound · Computer Science 2023-09-18 Rayan Daod Nathoo , Mikolaj Kegler , Marko Stamenovic

Over the past year, the emergence of transfer learning with large-scale language models (LM) has led to dramatic performance improvements across a broad range of natural language understanding tasks. However, the size and memory footprint…

Computation and Language · Computer Science 2020-02-04 Luke Melas-Kyriazi , George Han , Celine Liang

Model-based RL is a promising approach for real-world robotics due to its improved sample efficiency and generalization capabilities compared to model-free RL. However, effective model-based RL solutions for vision-based real-world…

Robotics · Computer Science 2023-11-08 Jun Yamada , Marc Rigter , Jack Collins , Ingmar Posner

Deep and large pre-trained language models are the state-of-the-art for various natural language processing tasks. However, the huge size of these models could be a deterrent to use them in practice. Some recent and concurrent works use…

Computation and Language · Computer Science 2020-05-06 Subhabrata Mukherjee , Ahmed Awadallah

We propose a conceptually simple and lightweight framework for improving the robustness of vision models through the combination of knowledge distillation and data augmentation. We address the conjecture that larger models do not make for…

Machine Learning · Computer Science 2024-02-06 Andy Zhou , Jindong Wang , Yu-Xiong Wang , Haohan Wang

Cross-domain few-shot learning presents a formidable challenge, as models must be trained on base classes and then tested on novel classes from various domains with only a few samples at hand. While prior approaches have primarily focused…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yongjin Yang , Taehyeon Kim , Se-Young Yun

Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation…

Computation and Language · Computer Science 2024-04-24 Jingxuan Wei , Linzhuang Sun , Yichong Leng , Xu Tan , Bihui Yu , Ruifeng Guo

This paper explores three novel approaches to improve the performance of speaker verification (SV) systems based on deep neural networks (DNN) using Multi-head Self-Attention (MSA) mechanisms and memory layers. Firstly, we propose the use…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-13 Victoria Mingote , Antonio Miguel , Alfonso Ortega , Eduardo Lleida

Individual differences of Electroencephalogram (EEG) could cause the domain shift which would significantly degrade the performance of cross-subject strategy. The domain adversarial neural networks (DANN), where the classification loss and…

Signal Processing · Electrical Eng. & Systems 2023-05-15 Zhe Wang , Yongxiong Wang , Jiapeng Zhang , Yiheng Tang , Zhiqun Pan

Knowledge distillation is widely used as a means of improving the performance of a relatively simple student model using the predictions from a complex teacher model. Several works have shown that distillation significantly boosts the…

Machine Learning · Computer Science 2021-07-09 Michal Lukasik , Srinadh Bhojanapalli , Aditya Krishna Menon , Sanjiv Kumar