English
Related papers

Related papers: Hybrid Distillation with CoT Guidance for Edge-Dro…

200 papers

Knowledge Distillation (KD) uses the teacher's prediction logits as soft labels to guide the student, while self-KD does not need a real teacher to require the soft labels. This work unifies the formulations of the two tasks by decomposing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhendong Yang , Ailing Zeng , Zhe Li , Tianke Zhang , Chun Yuan , Yu Li

Recent studies have focused on leveraging large-scale artificial intelligence (LAI) models to improve semantic representation and compression capabilities. However, the substantial computational demands of LAI models pose significant…

Machine Learning · Computer Science 2025-06-17 Chuanhong Liu , Caili Guo , Yang Yang , Mingzhe Chen , Tony Q. S. Quek

Multimodal dataset distillation aims to synthesize a small set of image-text pairs that enables efficient training of large-scale vision-language models. While dataset distillation has shown promise in unimodal tasks, extending it to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yongmin Lee , Hye Won Chung

Efficient reasoning distillation for long chain-of-thought (CoT) models is increasingly constrained by the assumption of a single oracle teacher, despite the practical availability of multiple candidate teachers and growing CoT corpora. We…

Machine Learning · Computer Science 2025-10-17 Zhanming Shen , Zeyu Qin , Zenan Huang , Hao Chen , Jiaqi Hu , Yihong Zhuang , Guoshan Lu , Gang Chen , Junbo Zhao

Large Language Models (LLMs) have made significant strides in problem-solving by incorporating reasoning processes. However, this enhanced reasoning capability results in an increased number of output tokens during inference, leading to…

Computation and Language · Computer Science 2025-11-05 Jingxian Xu , Mengyu Zhou , Weichang Liu , Hanbing Liu , Shi Han , Dongmei Zhang

With the rapid development of deep learning, large language models have shown strong capabilities in complex reasoning tasks such as mathematical equation solving. However, their substantial computational and storage costs hinder practical…

Machine Learning · Computer Science 2025-11-25 Fengming Yu , Qingyu Meng , Haiwei Pan , Kejia Zhang

Deep learning-based models are at the forefront of most driver observation benchmarks due to their remarkable accuracies but are also associated with high computational costs. This is challenging, as resources are often limited in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Calvin Tanama , Kunyu Peng , Zdravko Marinov , Rainer Stiefelhagen , Alina Roitberg

Advances in large language models (LLMs) significantly enhance reasoning capabilities but their deployment is restricted in resource-constrained scenarios. Knowledge distillation addresses this by transferring knowledge from powerful…

Computation and Language · Computer Science 2025-08-26 Zhenyu Lei , Zhen Tan , Song Wang , Yaochen Zhu , Zihan Chen , Yushun Dong , Jundong Li

Recent research on knowledge distillation has increasingly focused on logit distillation because of its simplicity, effectiveness, and versatility in model compression. In this paper, we introduce Refined Logit Distillation (RLD) to address…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Wujie Sun , Defang Chen , Siwei Lyu , Genlang Chen , Chun Chen , Can Wang

Deploying large language models (LLMs) of several billion parameters can be impractical in most industrial use cases due to constraints such as cost, latency limitations, and hardware accessibility. Knowledge distillation (KD) offers a…

Computation and Language · Computer Science 2025-01-28 Nicolas Boizard , Kevin El Haddad , Céline Hudelot , Pierre Colombo

Deep learning achieved great progress recently, however, it is not easy or efficient to further improve its performance by increasing the size of the model. Multi-modal learning can mitigate this challenge by introducing richer and more…

Artificial Intelligence · Computer Science 2025-10-07 Cairong Zhao , Yufeng Jin , Zifan Song , Haonan Chen , Duoqian Miao , Guosheng Hu

Chain-of-Thought (CoT) prompting often improves classification accuracy, but it introduces a significant throughput penalty with rationale generation (Wei et al., 2022; Cheng and Van Durme, 2024). To resolve this trade-off, we introduce…

Computation and Language · Computer Science 2025-09-30 Jillian Xu , Dylan Zhou , Vinay Shukla , Yang Yang , Junrui Ruan , Shuhuai Lin , Wenfei Zou , Yinxiao Liu , Karthik Lakshmanan

Recent multimodal large language models (MLLMs) have shown strong chain-of-thought (CoT) reasoning ability on vision-language tasks, but their direct deployment in real-world systems is often limited by latency and resource constraints. In…

Computation and Language · Computer Science 2026-05-13 Yuanhao Yue , Chengyu Wang , Yuanjie Lyu , Lei Shen , Jun Huang

Recent advances in diffusion generative models have yielded remarkable progress. While the quality of generated content continues to improve, these models have grown considerably in size and complexity. This increasing computational burden…

Machine Learning · Computer Science 2025-03-13 Reza Shirkavand , Peiran Yu , Shangqian Gao , Gowthami Somepalli , Tom Goldstein , Heng Huang

Large reasoning models achieve strong performance on complex tasks through long chain-of-thought (CoT) trajectories, but directly transferring such reasoning processes to smaller models remains challenging. A key difficulty is that not all…

Computation and Language · Computer Science 2026-04-06 Chaoqun He , Yingfa Chen , Chaojun Xiao , Xu Han , Lijie Wen

Existing chain-of-thought (CoT) distillation methods can effectively transfer reasoning abilities to base models but suffer from two major limitations: excessive verbosity of reasoning traces and inadequate adaptability to problem…

Artificial Intelligence · Computer Science 2025-05-27 Yifan Wu , Jingze Shi , Bingheng Wu , Jiayi Zhang , Xiaotian Lin , Nan Tang , Yuyu Luo

Knowledge Distillation (KD) is a fundamental technique for compressing large language models (LLMs) into compact, efficient student models. However, existing white-box KD methods mainly focus on balancing ground truth and student-generated…

Computation and Language · Computer Science 2025-08-11 Lingyuan Liu , Mengxiang Zhang

Knowledge Distillation (KD) has emerged as a promising technique for model compression but faces critical limitations: (1) sensitivity to hyperparameters requiring extensive manual tuning, (2) capacity gap when distilling from very large…

Machine Learning · Computer Science 2025-12-11 Gustavo Coelho Haase , Paulo Henrique Dourado da Silva

Unmanned Aerial Vehicles (UAVs) have emerged as a key enabler technology for data collection from Internet of Things (IoT) devices. However, effective data collection is challenged by resource constraints and the need for real-time…

Robotics · Computer Science 2026-05-12 Assane Sankara , Daniel Bonilla Licea , Hajar El Hammouti

Knowledge Distillation (KD) has been one of the most popu-lar methods to learn a compact model. However, it still suffers from highdemand in time and computational resources caused by sequential train-ing pipeline. Furthermore, the soft…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Benlin Liu , Yongming Rao , Jiwen Lu , Jie Zhou , Cho-jui Hsieh