English
Related papers

Related papers: torchdistill: A Modular, Configuration-Driven Fram…

200 papers

In recent years, the growing size of neural networks has led to a vast amount of research concerning compression techniques to mitigate the drawbacks of such large sizes. Most of these research works can be categorized into three broad…

Machine Learning · Computer Science 2020-12-01 Het Shah , Avishree Khare , Neelay Shah , Khizir Siddiqui

Today's LLM (pre-) training and research workflows typically allocate a significant amount of compute to large-scale ablation studies. Despite the substantial compute costs of these ablations, existing open-source frameworks provide limited…

Recent advances in deep learning has lead to rapid developments in the field of image retrieval. However, the best performing architectures incur significant computational cost. Recent approaches tackle this issue using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zakaria Laskar , Juho Kannala

Multimodal Deep Learning has garnered much interest, and transformers have triggered novel approaches, thanks to the cross-attention mechanism. Here we propose an approach to deal with two key existing challenges: the high computational…

Machine Learning · Computer Science 2021-10-20 Dhruv Agarwal , Tanay Agrawal , Laura M. Ferrari , François Bremond

We introduce PyText - a deep learning based NLP modeling framework built on PyTorch. PyText addresses the often-conflicting requirements of enabling rapid experimentation and of serving models at scale. It achieves this by providing simple…

Knowledge distillation field delicately designs various types of knowledge to shrink the performance gap between compact student and large-scale teacher. These existing distillation approaches simply focus on the improvement of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Xuanyang Zhang , Xiangyu Zhang , Jian Sun

Recent work in probability-domain knowledge distillation has established axiomatic frameworks for temperature scaling, multi-teacher aggregation, and bias-variance trade-offs in single-stage settings. However, the mathematical behavior of…

Machine Learning · Computer Science 2026-01-21 Aaron R. Flouro , Shawn P. Chadwick

Transformer-based detectors (DETRs) are becoming popular for their simple framework, but the large model size and heavy time consumption hinder their deployment in the real world. While knowledge distillation (KD) can be an appealing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Jiahao Chang , Shuo Wang , Haiming Xu , Zehui Chen , Chenhongyi Yang , Feng Zhao

Modern time series analysis demands frameworks that are flexible, efficient, and extensible. However, many existing Python libraries exhibit limitations in modularity and in their native support for irregular, multi-source, or sparse data.…

Machine Learning · Computer Science 2025-08-27 Zhijin Wang , Senzhen Wu , Yue Hu , Xiufeng Liu

This paper presents the design, implementation, and evaluation of the PyTorch distributed data parallel module. PyTorch is a widely-adopted scientific computing package used in deep learning research and applications. Recent advances in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-30 Shen Li , Yanli Zhao , Rohan Varma , Omkar Salpekar , Pieter Noordhuis , Teng Li , Adam Paszke , Jeff Smith , Brian Vaughan , Pritam Damania , Soumith Chintala

Deep neural networks can capture the intricate interaction history information between queries and documents, because of their many complicated nonlinear units, allowing them to provide correct search recommendations. However, service…

Information Retrieval · Computer Science 2022-08-25 Zhitao Zhu , Shijing Si , Jianzong Wang , Yaodong Yang , Jing Xiao

The impressive performance of proprietary LLMs like GPT4 in code generation has led to a trend to replicate these capabilities in open-source models through knowledge distillation (e.g. Code Evol-Instruct). However, these efforts often…

Computation and Language · Computer Science 2024-10-02 Ziyang Luo , Xin Li , Hongzhan Lin , Jing Ma , Lidong Bing

Despite the popularity and efficacy of knowledge distillation, there is limited understanding of why it helps. In order to study the generalization behavior of a distilled student, we propose a new theoretical framework that leverages…

Machine Learning · Computer Science 2023-01-31 Hrayr Harutyunyan , Ankit Singh Rawat , Aditya Krishna Menon , Seungyeon Kim , Sanjiv Kumar

Knowledge distillation is a technique used to train a small student network using the output generated by a large teacher network, and has many empirical advantages~\citep{Hinton2015DistillingTK}. While the standard one-shot approach to…

Machine Learning · Computer Science 2025-03-25 Shivam Gupta , Sushrut Karmalkar

Convolutional neural networks have been widely deployed in various application scenarios. In order to extend the applications' boundaries to some accuracy-crucial domains, researchers have been investigating approaches to boost accuracy…

Machine Learning · Computer Science 2019-05-21 Linfeng Zhang , Jiebo Song , Anni Gao , Jingwei Chen , Chenglong Bao , Kaisheng Ma

PyTorch \texttt{2.x} introduces a compiler designed to accelerate deep learning programs. However, for machine learning researchers, adapting to the PyTorch compiler to full potential can be challenging. The compiler operates at the Python…

Machine Learning · Computer Science 2024-03-22 Kaichao You , Runsheng Bai , Meng Cao , Jianmin Wang , Ion Stoica , Mingsheng Long

News recommender systems are devised to alleviate the information overload, attracting more and more researchers' attention in recent years. The lack of a dedicated learner-oriented news recommendation toolkit hinders the advancement of…

Information Retrieval · Computer Science 2026-04-17 Rongyao Wang , Veronica Liesaputra , Zhiyi Huang

Knowledge distillation is a powerful technique for transferring knowledge from a pre-trained teacher model to a student model. However, the true potential of knowledge transfer has not been fully explored. Existing approaches primarily…

Machine Learning · Computer Science 2023-06-23 Shuoxi Zhang , Hanpeng Liu , Kun He

We propose the task of knowledge distillation detection, which aims to determine whether a student model has been distilled from a given teacher, under a practical setting where only the student's weights and the teacher's API are…

Machine Learning · Computer Science 2025-10-03 Qin Shi , Amber Yijia Zheng , Qifan Song , Raymond A. Yeh

This paper aims to provide a selective survey about knowledge distillation(KD) framework for researchers and practitioners to take advantage of it for developing new optimized models in the deep neural network field. To this end, we give a…

Machine Learning · Computer Science 2020-12-01 Jeong-Hoe Ku , JiHun Oh , YoungYoon Lee , Gaurav Pooniwala , SangJeong Lee