English
Related papers

Related papers: Recursive Meta-Distillation: An Axiomatic Framewor…

200 papers

Distilling reasoning traces from strong large language models into smaller ones is a promising route to improve intelligence in resource-constrained settings. Existing approaches face a fundamental trade-off: offline distillation from…

Computation and Language · Computer Science 2026-05-15 Yumeng Zhang , Zhengbang Yang , Yevin Nikhel Goonatilake , Zhuangdi Zhu

Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human preferences. Due to the difficulty of obtaining high-quality human preference annotations, distilling preferences from generative LLMs has emerged…

Computation and Language · Computer Science 2026-01-21 Hongli Zhou , Hui Huang , Wei Liu , Chenglong Wang , Xingyuan Bu , Lvyuan Han , Fuhai Song , Muyun Yang , Wenhao Jiang , Hailong Cao , Tiejun Zhao

Knowledge distillation (KD) is a core component in the training and deployment of modern generative models, particularly large language models (LLMs). While its empirical benefits are well documented -- enabling smaller student models to…

Machine Learning · Computer Science 2026-01-16 Sungmin Cha , Kyunghyun Cho

Knowledge distillation is a popular approach for enhancing the performance of ''student'' models, with lower representational capacity, by taking advantage of more powerful ''teacher'' models. Despite its apparent simplicity and widespread…

Machine Learning · Computer Science 2023-12-12 Mher Safaryan , Alexandra Peste , Dan Alistarh

Large language models have recently enabled a generative paradigm for query expansion, but their high inference cost makes direct deployment difficult in practical retrieval systems. To address this issue, a retrieval-feedback-driven…

Information Retrieval · Computer Science 2026-03-17 Minghan Li , Guodong Zhou

Knowledge distillation, aimed at transferring the knowledge from a heavy teacher network to a lightweight student network, has emerged as a promising technique for compressing neural networks. However, due to the capacity gap between the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Xuewei Li , Songyuan Li , Bourahla Omar , Fei Wu , Xi Li

Dataset distillation aims to distill the knowledge of a large-scale real dataset into small yet informative synthetic data such that a model trained on it performs as well as a model trained on the full dataset. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ahmad Sajedi , Samir Khaki , Lucy Z. Liu , Ehsan Amjadian , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Knowledge Distillation (KD) aims to transfer knowledge from a large teacher model to a smaller student model. While contrastive learning has shown promise in self-supervised learning by creating discriminative representations, its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Nikolaos Giakoumoglou , Tania Stathaki

Incremental learning methods can learn new classes continually by distilling knowledge from the last model (as a teacher model) to the current model (as a student model) in the sequentially learning process. However, these methods cannot…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Longhui Yu , Zhenyu Weng , Yuqing Wang , Yuesheng Zhu

Knowledge distillation conducts an effective model compression method while holding some limitations:(1) the feature based distillation methods only focus on distilling the feature map but are lack of transferring the relation of data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Muzhou Yu , Sia Huat Tan , Kailu Wu , Runpei Dong , Linfeng Zhang , Kaisheng Ma

Depth estimation and scene segmentation are two important tasks in intelligent transportation systems. A joint modeling of these two tasks will reduce the requirement for both the storage and training efforts. This work explores how the…

Machine Learning · Computer Science 2025-05-16 Tiancong Cheng , Ying Zhang , Yuxuan Liang , Roger Zimmermann , Zhiwen Yu , Bin Guo

Knowledge distillation (KD) is one of the prominent techniques for model compression. In this method, the knowledge of a large network (teacher) is distilled into a model (student) with usually significantly fewer parameters. KD tries to…

Machine Learning · Computer Science 2023-01-31 Aref Jafari , Mehdi Rezagholizadeh , Ali Ghodsi

Dataset distillation, a training-aware data compression technique, has recently attracted increasing attention as an effective tool for mitigating costs of optimization and data storage. However, progress remains largely empirical.…

Machine Learning · Computer Science 2026-03-31 Yuri Kinoshita , Naoki Nishikawa , Taro Toyoizumi

Knowledge distillation, transferring knowledge from a teacher model to a student model, has emerged as a powerful technique in neural machine translation for compressing models or simplifying training targets. Knowledge distillation…

Computation and Language · Computer Science 2024-04-24 Jingxuan Wei , Linzhuang Sun , Yichong Leng , Xu Tan , Bihui Yu , Ruifeng Guo

Leveraging knowledge from multiple tasks through introducing a small number of task specific parameters into each transformer layer, also known as adapters, receives much attention recently. However, adding an extra fusion layer to…

Machine Learning · Computer Science 2023-12-29 Junjie Wang , Yicheng Chen , Wangshu Zhang , Sen Hu , Teng Xu , Jing Zheng

Real-world object detection models should be cheap and accurate. Knowledge distillation (KD) can boost the accuracy of a small, cheap detection model by leveraging useful information from a larger teacher model. However, a key challenge is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chenhongyi Yang , Mateusz Ochal , Amos Storkey , Elliot J. Crowley

Knowledge distillation (KD) has received much attention due to its success in compressing networks to allow for their deployment in resource-constrained systems. While the problem of adversarial robustness has been studied before in the KD…

Machine Learning · Computer Science 2023-08-14 Tom A. Lamb , Rudy Brunel , Krishnamurthy DJ Dvijotham , M. Pawan Kumar , Philip H. S. Torr , Francisco Eiras

Generative models offer a promising paradigm for the final stage reranking in multi-stage recommender systems, with the ability to capture inter-item dependencies within reranked lists. However, their practical deployment still faces two…

Information Retrieval · Computer Science 2026-03-10 Kai Cheng , Hao Wang , Wei Guo , Weiwen Liu , Yong Liu , Yawen Li , Enhong Chen

Knowledge distillation (KD) improves the performance of a low-complexity student model with the help of a more powerful teacher. The teacher in KD is a black-box model, imparting knowledge to the student only through its predictions. This…

Machine Learning · Computer Science 2023-10-05 Sayantan Chowdhury , Ben Liang , Ali Tizghadam , Ilijc Albanese

Retrieval-augmented generation framework can address the limitations of large language models by enabling real-time knowledge updates for more accurate answers. An efficient way in the training phase of retrieval-augmented models is…

Computation and Language · Computer Science 2024-02-20 Zizhong Li , Haopeng Zhang , Jiawei Zhang