English
Related papers

Related papers: Cross-Modal Knowledge Distillation for Speech Larg…

200 papers

Large language models (LLMs) excel on a variety of reasoning benchmarks, but previous studies suggest they sometimes struggle to generalize to unseen questions, potentially due to over-reliance on memorized training examples. However, the…

Computation and Language · Computer Science 2025-04-01 Yihuai Hong , Dian Zhou , Meng Cao , Lei Yu , Zhijing Jin

We introduce Speech-IFeval, an evaluation framework designed to assess instruction-following capabilities and quantify catastrophic forgetting in speech-aware language models (SLMs). Recent SLMs integrate speech perception with large…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-27 Ke-Han Lu , Chun-Yi Kuan , Hung-yi Lee

This paper addresses the limitations of large-scale language models in safety alignment and robustness by proposing a fine-tuning method that combines contrastive distillation with noise-robust training. The method freezes the backbone…

Computation and Language · Computer Science 2025-11-03 Jiasen Zheng , Huajun Zhang , Xu Yan , Ran Hao , Chong Peng

We introduce LLaVA-MoD, a novel framework designed to enable the efficient training of small-scale Multimodal Language Models (s-MLLM) by distilling knowledge from large-scale MLLM (l-MLLM). Our approach tackles two fundamental challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Fangxun Shu , Yue Liao , Le Zhuo , Chenning Xu , Lei Zhang , Guanghao Zhang , Haonan Shi , Long Chen , Tao Zhong , Wanggui He , Siming Fu , Haoyuan Li , Bolin Li , Zhelun Yu , Si Liu , Hongsheng Li , Hao Jiang

As large language models increasingly mediate firm - customer interactions, firms face a tradeoff: the most capable models perform well but are costly and difficult to control at scale. Existing knowledge distillation methods address this…

Computation and Language · Computer Science 2026-02-23 Tong Wang , K. Sudhir

While large language models (LLMs) have demonstrated exceptional performance in recent natural language processing (NLP) tasks, their deployment poses substantial challenges due to high computational and memory demands in real-world…

Computation and Language · Computer Science 2024-02-27 Chenglin Li , Qianglong Chen , Liangyue Li , Caiyu Wang , Yicheng Li , Zulong Chen , Yin Zhang

Native multimodal large language models (MLLMs) restructure a single large language model (LLM) into a spoken language model (SLM) capable of both speech and text generation. Compared to modular and aligned MLLMs, native MLLMs preserve…

Computation and Language · Computer Science 2025-10-28 Hang Shao , Heting Gao , Yunhang Shen , Jiawei Chen , Zuwei Long , Dong Yang , Ke Li , Xing Sun

Large language models (LLMs) have exhibited considerable cross-lingual generalization abilities, whereby they implicitly transfer knowledge across languages. However, the transfer is not equally successful for all languages, especially for…

Computation and Language · Computer Science 2023-12-25 Ningyu Xu , Qi Zhang , Jingting Ye , Menghan Zhang , Xuanjing Huang

Pretrained language models have led to significant performance gains in many NLP tasks. However, the intensive computing resources to train such models remain an issue. Knowledge distillation alleviates this problem by learning a…

Computation and Language · Computer Science 2020-05-04 Linqing Liu , Huan Wang , Jimmy Lin , Richard Socher , Caiming Xiong

Many recent breakthroughs in machine learning have been enabled by the pre-trained foundation models. By scaling up model parameters, training data, and computation resources, foundation models have significantly advanced the…

Artificial Intelligence · Computer Science 2023-10-06 Zhe Zhao , Qingyun Liu , Huan Gui , Bang An , Lichan Hong , Ed H. Chi

Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting-a critical limitation of the static…

Computation and Language · Computer Science 2026-03-16 Hongyang Chen , Zhongwu Sun , Hongfei Ye , Kunchi Li , Xuemin Lin

With the rise of deep learning, large datasets and complex models have become common, requiring significant computing power. To address this, data distillation has emerged as a technique to quickly train models with lower memory and time…

Computation and Language · Computer Science 2023-08-10 Shivam Sahni , Harsh Patel

Large language models (LLMs) have demonstrated remarkable abilities in various natural language processing areas, but they demand high computation resources which limits their deployment in real-world. Distillation is one technique to solve…

Computation and Language · Computer Science 2025-07-31 Zhi Zhou , Sirui Miao , Xiangyu Duan , Hao Yang , Min Zhang

Vision-language models (VLMs) exhibit uneven performance across languages, a problem that is often exacerbated when the model size is reduced. While Knowledge distillation (KD) demonstrates promising results in transferring knowledge from…

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that are vital for effective human-computer interaction. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-08 Jing Peng , Yucheng Wang , Bohan Li , Yiwei Guo , Hankun Wang , Yangui Fang , Yu Xi , Haoyu Li , Xu Li , Ke Zhang , Shuai Wang , Kai Yu

Large language models (LLMs) have demonstrated remarkable performance across a wide range of natural language processing (NLP) tasks. However, these models are often difficult to deploy due to significant computational requirements and…

Computation and Language · Computer Science 2024-12-25 Vijay Goyal , Mustafa Khan , Aprameya Tirupati , Harveer Saini , Michael Lam , Kevin Zhu

Driven by vast and diverse textual data, large language models (LLMs) have demonstrated impressive performance across numerous natural language processing (NLP) tasks. Yet, a critical question persists: does their generalization arise from…

Computation and Language · Computer Science 2025-09-08 Boxiang Ma , Ru Li , Yuanlong Wang , Hongye Tan , Xiaoli Li

Knowledge distillation (KD) has proven highly effective for compressing large models and enhancing the performance of smaller ones. However, its effectiveness diminishes in cross-modal scenarios, such as vision-to-language distillation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Junhong Liu , Yuan Zhang , Tao Huang , Wenchao Xu , Renyu Yang

Knowledge distillation from Large Language Models (LLMs) to smaller models has emerged as a critical technique for deploying efficient AI systems. However, current methods for distillation via synthetic data lack pedagogical awareness,…

Artificial Intelligence · Computer Science 2026-02-13 Bowei He , Yankai Chen , Xiaokun Zhang , Linghe Kong , Philip S. Yu , Xue Liu , Chen Ma

Catastrophic forgetting remains a formidable obstacle to building an omniscient model in large language models (LLMs). Despite the pioneering research on task-level forgetting in LLM fine-tuning, there is scant focus on forgetting during…

Computation and Language · Computer Science 2024-10-23 Chonghua Liao , Ruobing Xie , Xingwu Sun , Haowen Sun , Zhanhui Kang