English
Related papers

Related papers: Evolutionary Contrastive Distillation for Language…

200 papers

Knowledge distillation (KD) is a key technique for compressing large-scale language models (LLMs), yet prevailing logit-based methods typically employ static strategies that are misaligned with the dynamic learning process of student…

Computation and Language · Computer Science 2025-10-14 Xurong Xie , Zhucun Xue , Jiafu Wu , Jian Li , Yabiao Wang , Xiaobin Hu , Yong Liu , Jiangning Zhang

Large multimodal models (LMMs) excel in adhering to human instructions. However, self-contradictory instructions may arise due to the increasing trend of multimodal interaction and context length, which is challenging for language beginners…

Artificial Intelligence · Computer Science 2024-08-06 Jin Gao , Lei Gan , Yuankai Li , Yixin Ye , Dequan Wang

Knowledge distillation typically involves transferring knowledge from a Large Language Model (LLM) to a Smaller Language Model (SLM). However, in tasks such as text matching, fine-tuned smaller models often yield more effective…

Computation and Language · Computer Science 2025-07-09 Mingzhe Li , Jing Xiang , Qishen Zhang , Kaiyang Wan , Xiuying Chen

Knowledge distillation (KD) is a technique for transferring knowledge from complex teacher models to simpler student models, significantly enhancing model efficiency and accuracy. It has demonstrated substantial advancements in various…

Computation and Language · Computer Science 2025-04-21 Junjie Yang , Junhao Song , Xudong Han , Ziqian Bi , Tianyang Wang , Chia Xin Liang , Xinyuan Song , Yichao Zhang , Qian Niu , Benji Peng , Keyu Chen , Ming Liu

Aligning Large Language Models (LLMs) is crucial for enhancing their safety and utility. However, existing methods, primarily based on preference datasets, face challenges such as noisy labels, high annotation costs, and privacy concerns.…

Machine Learning · Computer Science 2025-01-28 Hao Sun , Mihaela van der Schaar

Prior work has shown that, on small amounts of training data, syntactic neural language models learn structurally sensitive generalisations more successfully than sequential language models. However, their computational complexity renders…

Computation and Language · Computer Science 2019-06-18 Adhiguna Kuncoro , Chris Dyer , Laura Rimell , Stephen Clark , Phil Blunsom

Knowledge Distillation (KD) is a critical tool for training Large Language Models (LLMs), yet the majority of research focuses on approaches that rely solely on output logits, neglecting semantic information in the teacher's intermediate…

Computation and Language · Computer Science 2026-05-13 Maxime Guigon , Lucas Dixon , Michaël E. Sander

Contrastive learning has become a popular approach in natural language processing, particularly for the learning of sentence embeddings. However, the discrete nature of natural language makes it difficult to ensure the quality of positive…

Computation and Language · Computer Science 2023-05-23 Qinyuan Cheng , Xiaogui Yang , Tianxiang Sun , Linyang Li , Xipeng Qiu

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

Knowledge Distillation (KD) has proven effective for compressing large teacher models into smaller student models. While it is well known that student models can achieve similar accuracies as the teachers, it has also been shown that they…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Amin Parchami-Araghi , Moritz Böhle , Sukrut Rao , Bernt Schiele

Cross-modality distillation arises as an important topic for data modalities containing limited knowledge such as depth maps and high-quality sketches. Such techniques are of great importance, especially for memory and privacy-restricted…

Machine Learning · Computer Science 2024-05-29 Hangyu Lin , Chen Liu , Chengming Xu , Zhengqi Gao , Yanwei Fu , Yuan Yao

Decoding from the output distributions of large language models to produce high-quality text is a complex challenge in language modeling. Various approaches, such as beam search, sampling with temperature, $k-$sampling, nucleus…

Computation and Language · Computer Science 2024-10-22 Esteban Garces Arias , Julian Rodemann , Meimingwei Li , Christian Heumann , Matthias Aßenmacher

Deploying large language models (LLMs) is challenging because they are memory inefficient and compute-intensive for practical applications. In reaction, researchers train smaller task-specific models by either finetuning with human labels…

Computation and Language · Computer Science 2023-07-06 Cheng-Yu Hsieh , Chun-Liang Li , Chih-Kuan Yeh , Hootan Nakhost , Yasuhisa Fujii , Alexander Ratner , Ranjay Krishna , Chen-Yu Lee , Tomas Pfister

Pre-trained language models (LMs) obtain state-of-the-art performance when adapted to text classification tasks. However, when using such models in real-world applications, efficiency considerations are paramount. In this paper, we study…

Computation and Language · Computer Science 2022-10-24 Laura Aina , Nikos Voskarides , Roi Blanco

Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Anurag Roy , Riddhiman Moulick , Vinay K. Verma , Saptarshi Ghosh , Abir Das

Existing language model compression methods mostly use a simple L2 loss to distill knowledge in the intermediate representations of a large BERT model to a smaller one. Although widely used, this objective by design assumes that all the…

Computation and Language · Computer Science 2020-09-30 Siqi Sun , Zhe Gan , Yu Cheng , Yuwei Fang , Shuohang Wang , Jingjing Liu

General-purpose Large Language Models (LLMs) are frequently fine-tuned through supervised fine-tuning (SFT) to enhance performance in specific domains. Better results can be achieved by distilling the chain-of-thought of a larger model at…

Machine Learning · Computer Science 2026-03-24 Andrey Goncharov , Daniil Vyazhev , Petr Sychev , Edvard Khalafyan , Alexey Zaytsev

Contrastive representation learning is crucial in time series analysis as it alleviates the issue of data noise and incompleteness as well as sparsity of supervision signal. However, existing constrastive learning frameworks usually focus…

Machine Learning · Computer Science 2024-06-26 Haozhi Gao , Qianqian Ren , Jinbao Li

Large Language Models (LLMs) are increasingly embedded in applications, and people can shape model behavior by editing prompt instructions. Yet encoding subtle, domain-specific policies into prompts is challenging. Although this process…

Human-Computer Interaction · Computer Science 2026-03-26 Minjae Lee , Minsuk Kahng

On-policy self-distillation (OPSD) is an emerging LLM post-training paradigm in which the model serves as its own teacher: conditioned on privileged information such as a reference trace or hint, the same policy provides dense token-level…

Machine Learning · Computer Science 2026-05-22 Hongbin Zhang , Chaozheng Wang , Kehai Chen , Youcheng Pan , Yang Xiang , Jinpeng Wang , Min Zhang