English
Related papers

Related papers: VLM-KD: Knowledge Distillation from VLM for Long-T…

200 papers

Autonomous execution of long-horizon, contact-rich manipulation tasks traditionally requires extensive real-world data and expert engineering, posing significant cost and scalability challenges. This paper proposes a novel framework…

Robotics · Computer Science 2025-11-11 Jiayu Zhou , Qiwei Wu , Jian Li , Zhe Chen , Xiaogang Xiong , Renjing Xu

Knowledge distillation is used, in generative language modeling, to train a smaller student model using the help of a larger teacher model, resulting in improved capabilities for the student model. In this paper, we formulate a more general…

Computation and Language · Computer Science 2025-02-26 Guanlin Liu , Anand Ramachandran , Tanmay Gangwani , Yan Fu , Abhinav Sethy

Integrating multimodal knowledge into large language models (LLMs) represents a significant advancement in dialogue generation capabilities. However, the effective incorporation of such knowledge in zero-resource scenarios remains a…

Computation and Language · Computer Science 2025-02-06 Bo Zhang , Hui Ma , Jian Ding , Jian Wang , Bo Xu , Hongfei Lin

Self-supervised learning has achieved remarkable success in learning visual representations from clean data, yet remains challenging when clean observations are sparse or not available at all. In this paper, we demonstrate that pretrained…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Konstantinos Alexis , Giorgos Giannopoulos , Dimitrios Gunopulos

Open-vocabulary object detection aims to detect novel object categories beyond the training set. The advanced open-vocabulary two-stage detectors employ instance-level visual-to-visual knowledge distillation to align the visual space of the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Zongyang Ma , Guan Luo , Jin Gao , Liang Li , Yuxin Chen , Shaoru Wang , Congxuan Zhang , Weiming Hu

Knowledge distillation offers a promising path to transfer reasoning capabilities from large teacher models to efficient student models; however, existing token-level on-policy distillation methods require token-level alignment between the…

Computation and Language · Computer Science 2026-01-30 Jing Xiong , Hui Shen , Shansan Gong , Yuxin Cheng , Jianghan Shen , Chaofan Tao , Haochen Tan , Haoli Bai , Lifeng Shang , Ngai Wong

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Lu Qi , Jason Kuen , Jiuxiang Gu , Zhe Lin , Yi Wang , Yukang Chen , Yanwei Li , Jiaya Jia

Large Language Models (LLMs) face significant challenges at inference time due to their high computational demands. To address this, we present Performance-Guided Knowledge Distillation (PGKD), a cost-effective and high-throughput solution…

Computation and Language · Computer Science 2024-11-11 Flavio Di Palo , Prateek Singhi , Bilal Fadlallah

Given the exceptional performance of proprietary large language models (LLMs) like GPT-4, recent research has increasingly focused on boosting the capabilities of smaller models through knowledge distillation (KD) from these powerful yet…

Computation and Language · Computer Science 2024-11-12 Hongzhan Chen , Ruijun Chen , Yuqi Yi , Xiaojun Quan , Chenliang Li , Ming Yan , Ji Zhang

Knowledge Distillation (KD) aims at improving the performance of a low-capacity student model by inheriting knowledge from a high-capacity teacher model. Previous KD methods typically train a student by minimizing a task-related loss and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Mengya Gao , Yujun Shen , Quanquan Li , Junjie Yan , Liang Wan , Dahua Lin , Chen Change Loy , Xiaoou Tang

Recent advances in deep learning has lead to rapid developments in the field of image retrieval. However, the best performing architectures incur significant computational cost. Recent approaches tackle this issue using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zakaria Laskar , Juho Kannala

Large language models (LLMs) are known to memorize parts of their training data, raising important concerns around privacy and security. While previous research has focused on studying memorization in pre-trained models, much less is known…

Machine Learning · Computer Science 2025-08-19 Simardeep Singh

Transformer-based architectures have become the de-facto standard models for diverse vision tasks owing to their superior performance. As the size of the models continues to scale up, model distillation becomes extremely important in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Cheng Han , Qifan Wang , Sohail A. Dianat , Majid Rabbani , Raghuveer M. Rao , Yi Fang , Qiang Guan , Lifu Huang , Dongfang Liu

Knowledge distillation (KD) compresses deep neural networks by transferring task-related knowledge from cumbersome pre-trained teacher models to compact student models. However, current KD methods for super-resolution (SR) networks overlook…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yun Zhang , Wei Li , Simiao Li , Hanting Chen , Zhijun Tu , Wenjia Wang , Bingyi Jing , Shaohui Lin , Jie Hu

Complex deep learning models now achieve state of the art performance for many document retrieval tasks. The best models process the query or claim jointly with the document. However for fast scalable search it is desirable to have document…

Information Retrieval · Computer Science 2019-11-26 Siamak Shakeri , Abhinav Sethy , Cheng Cheng

Existing techniques often attempt to make knowledge transfer from a powerful machine translation (MT) to speech translation (ST) model with some elaborate techniques, which often requires transcription as extra input during training.…

Computation and Language · Computer Science 2023-04-21 Hao Zhang , Nianwen Si , Yaqi Chen , Wenlin Zhang , Xukui Yang , Dan Qu , Zhen Li

Knowledge Distillation (KD) aims to distill the knowledge of a cumbersome teacher model into a lightweight student model. Its success is generally attributed to the privileged information on similarities among categories provided by the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Li Yuan , Francis E. H. Tay , Guilin Li , Tao Wang , Jiashi Feng

Knowledge Distillation (KD) is a well-known training paradigm in deep neural networks where knowledge acquired by a large teacher model is transferred to a small student. KD has proven to be an effective technique to significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Philip de Rijk , Lukas Schneider , Marius Cordts , Dariu M. Gavrila

In the field of large language models (LLMs), Knowledge Distillation (KD) is a critical technique for transferring capabilities from teacher models to student models. However, existing KD methods face limitations and challenges in…

Computation and Language · Computer Science 2025-04-08 Yixing Li , Yuxian Gu , Li Dong , Dequan Wang , Yu Cheng , Furu Wei

A recent trend in Natural Language Processing is the exponential growth in Language Model (LM) size, which prevents research groups without a necessary hardware infrastructure from participating in the development process. This study…

Computation and Language · Computer Science 2023-01-31 Jan Philip Wahle