English
Related papers

Related papers: Data-Augmented Quantization-Aware Knowledge Distil…

200 papers

Deep Neural Networks (DNNs) have achieved notable performance in the fields of computer vision and natural language processing with various applications in both academia and industry. However, with recent advancements in DNNs and…

Knowledge Distillation (KD) has emerged as a pivotal technique for neural network compression and performance enhancement. Most KD methods aim to transfer dark knowledge from a cumbersome teacher model to a lightweight student model based…

Machine Learning · Computer Science 2024-10-10 Wenqi Niu , Yingchao Wang , Guohui Cai , Hanpo Hou

Knowledge distillation becomes a de facto standard to improve the performance of small neural networks. Most of the previous works propose to regress the representational features from the teacher to the student in a one-to-one spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Sihao Lin , Hongwei Xie , Bing Wang , Kaicheng Yu , Xiaojun Chang , Xiaodan Liang , Gang Wang

Knowledge distillation (KD), known for its ability to transfer knowledge from a cumbersome network (teacher) to a lightweight one (student) without altering the architecture, has been garnering increasing attention. Two primary categories…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Yaomin Huang , Zaomin Yan , Chaomin Shen , Faming Fang , Guixu Zhang

Knowledge Distillation (KD) has been one of the most popu-lar methods to learn a compact model. However, it still suffers from highdemand in time and computational resources caused by sequential train-ing pipeline. Furthermore, the soft…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Benlin Liu , Yongming Rao , Jiwen Lu , Jie Zhou , Cho-jui Hsieh

Knowledge distillation (KD) is a common approach to compress a teacher model to reduce its inference cost and memory footprint, by training a smaller student model. However, in the context of autoregressive language models (LMs), we…

Computation and Language · Computer Science 2024-06-18 Qihuang Zhong , Liang Ding , Li Shen , Juhua Liu , Bo Du , Dacheng Tao

Dense visual prediction tasks, such as detection and segmentation, are crucial for time-critical applications (e.g., autonomous driving and video surveillance). While deep models achieve strong performance, their efficiency remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Qizhen Lan , Qing Tian

Autonomous driving (AD) datasets have progressively grown in size in the past few years to enable better deep representation learning. Active learning (AL) has re-gained attention recently to address reduction of annotation costs and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Ngoc Phuong Anh Duong , Alexandre Almin , Léo Lemarié , B Ravi Kiran

Knowledge distillation is a popular machine learning technique that aims to transfer knowledge from a large 'teacher' network to a smaller 'student' network and improve the student's performance by training it to emulate the teacher. In…

Machine Learning · Computer Science 2022-10-19 Sushil Thapa

Generalization Performance of Deep Learning models trained using Empirical Risk Minimization can be improved significantly by using Data Augmentation strategies such as simple transformations, or using Mixed Samples. We attempt to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Deepan Das , Haley Massa , Abhimanyu Kulkarni , Theodoros Rekatsinas

With numerous medical tasks, the performance of deep models has recently experienced considerable improvements. These models are often adept learners. Yet, their intricate architectural design and high computational complexity make…

Image and Video Processing · Electrical Eng. & Systems 2023-03-17 Eddardaa Ben Loussaief , Hatem Rashwan , Mohammed Ayad , Mohammed Zakaria Hassan , Domenec Puig

Large-scale language models have recently demonstrated impressive empirical performance. Nevertheless, the improved results are attained at the price of bigger models, more power consumption, and slower inference, which hinder their…

Computation and Language · Computer Science 2021-03-18 Kevin J Liang , Weituo Hao , Dinghan Shen , Yufan Zhou , Weizhu Chen , Changyou Chen , Lawrence Carin

Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor…

Computation and Language · Computer Science 2020-12-29 Peyman Passban , Yimeng Wu , Mehdi Rezagholizadeh , Qun Liu

A recent trend in Natural Language Processing is the exponential growth in Language Model (LM) size, which prevents research groups without a necessary hardware infrastructure from participating in the development process. This study…

Computation and Language · Computer Science 2023-01-31 Jan Philip Wahle

Quantization Aware Training (QAT) is a neural network quantization technique that compresses model size and improves operational efficiency while effectively maintaining model performance. The paradigm of QAT is to introduce fake…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Wenqiang Zhou , Zhendong Yu , Xinyu Liu , Jiaming Yang , Rong Xiao , Tao Wang , Chenwei Tang , Jiancheng Lv

Knowledge distillation (KD) is an effective method for model compression and transferring knowledge between models. However, its effect on model's robustness against spurious correlations that degrade performance on out-of-distribution data…

Machine Learning · Computer Science 2025-10-31 Jiali Cheng , Chirag Agarwal , Hadi Amiri

In the past few years, transformer-based pre-trained language models have achieved astounding success in both industry and academia. However, the large model size and high run-time latency are serious impediments to applying them in…

Computation and Language · Computer Science 2022-07-13 Chengqiang Lu , Jianwei Zhang , Yunfei Chu , Zhengyu Chen , Jingren Zhou , Fei Wu , Haiqing Chen , Hongxia Yang

Knowledge distillation (KD) is a technique used to transfer knowledge from an overparameterized teacher network to a less-parameterized student network, thereby minimizing the incurred performance loss. KD methods can be categorized into…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jaeyeon Jang , Young-Ik Kim , Jisu Lim , Hyeonseong Lee

Knowledge Distillation (KD) has emerged as a crucial technique for compressing Large Language Models (LLMs). Although existing cross-tokenizer KD methods have made notable progress, their effectiveness remains constrained by suboptimal…

Computation and Language · Computer Science 2026-02-26 Duc Trung Vu , Pham Khanh Chi , Dat Phi Van , Linh Ngo Van , Sang Dinh , Trung Le

Knowledge distillation (KD) is a model compression technique that transfers knowledge from a large teacher model to a smaller student model to enhance its performance. Existing methods often assume that the student model is inherently…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Jianhua Zhang , Yi Gao , Ruyu Liu , Xu Cheng , Houxiang Zhang , Shengyong Chen