English
Related papers

Related papers: Self-Data Distillation for Recovering Quality in P…

200 papers

Despite the effectiveness of data selection for large language models (LLMs) during pretraining and instruction fine-tuning phases, improving data efficiency in supervised fine-tuning (SFT) for specialized domains poses significant…

Computation and Language · Computer Science 2024-12-06 Yu Yang , Siddhartha Mishra , Jeffrey N Chiang , Baharan Mirzasoleiman

Model pruning is a performance optimization technique for large language models like R1 or o3-mini. However, existing pruning methods often lead to significant performance degradation or require extensive retraining and fine-tuning. This…

Computation and Language · Computer Science 2025-05-21 Wei Jiang , Anying Fu , Youling Zhang

Over the past year, the emergence of transfer learning with large-scale language models (LM) has led to dramatic performance improvements across a broad range of natural language understanding tasks. However, the size and memory footprint…

Computation and Language · Computer Science 2020-02-04 Luke Melas-Kyriazi , George Han , Celine Liang

Large language models (LLMs) with one or more fine-tuning phases have become a necessary step to unlock various capabilities, enabling LLMs to follow natural language instructions or align with human preferences. However, it carries the…

Computation and Language · Computer Science 2024-04-30 Tingfeng Hui , Zhenyu Zhang , Shuohuan Wang , Weiran Xu , Yu Sun , Hua Wu

Large language models (LLMs) have shown remarkable effectiveness across various domains, with data augmentation methods utilizing GPT for synthetic data generation becoming prevalent. However, the quality and utility of augmented data…

Computation and Language · Computer Science 2025-01-27 Zeao Tu , Xiangdi Meng , Yu He , Zihan Yao , Tianyu Qi , Jun Liu , Ming Li

Structured pruning of modern large language models (LLMs) has emerged as a way of decreasing their high computational needs. Width pruning reduces the size of projection weight matrices (e.g., by removing attention heads) while maintaining…

Machine Learning · Computer Science 2024-06-25 Bo-Kyeong Kim , Geonmin Kim , Tae-Ho Kim , Thibault Castells , Shinkook Choi , Junho Shin , Hyoung-Kyu Song

In the realm of large language model (LLM), as the size of large models increases, it also brings higher training costs. There is a urgent need to minimize the data size in LLM training. Compared with data selection method, the data…

Computation and Language · Computer Science 2025-04-25 Rong Yao , Hailin Hu , Yifei Fu , Hanting Chen , Wenyi Fang , Fanyi Du , Kai Han , Yunhe Wang

Dataset pruning aims to select a subset of a dataset for efficient model training. While data efficiency in natural language processing has primarily focused on within-corpus scenarios during model pre-training, efficient dataset pruning…

Computation and Language · Computer Science 2025-01-07 Binh-Nguyen Nguyen , Yang He

Large language models (LLMs) have achieved remarkable success across various tasks but face deployment challenges due to their massive computational demands. While post-training pruning methods like SparseGPT and Wanda can effectively…

Artificial Intelligence · Computer Science 2026-04-21 Qiao Xiao , Alan Ansell , Boqian Wu , Lu Yin , Mykola Pechenizkiy , Shiwei Liu , Decebal Constantin Mocanu

Depth pruning improves the deployment efficiency of large language models (LLMs) by identifying and removing redundant layers. A widely accepted standard for this identification process is to measure the similarity between layers using…

Artificial Intelligence · Computer Science 2026-04-22 Yuli Chen , Shuhao Zhang , Fanshen Meng , Bo Cheng , Jiale Han , Qiang Tong , Xiulei Liu

Large Language Models (LLMs) demonstrate exceptional reasoning capabilities, often achieving state-of-the-art performance in various tasks. However, their substantial computational and memory demands, due to billions of parameters, hinder…

Computation and Language · Computer Science 2024-11-25 Xunyu Zhu , Jian Li , Can Ma , Weiping Wang

Much research effort is being applied to the task of compressing the knowledge of self-supervised models, which are powerful, yet large and memory consuming. In this work, we show that the original method of knowledge distillation (and its…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-19 Danilo de Oliveira , Timo Gerkmann

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

Machine Learning · Computer Science 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

Distilling large language models (LLMs) typically involves transferring the teacher model's responses through supervised fine-tuning (SFT). However, this approach neglects the potential to distill both data (output content) and reward…

Computation and Language · Computer Science 2025-02-28 Yudi Zhang , Lu Wang , Meng Fang , Yali Du , Chenghua Huang , Jun Wang , Qingwei Lin , Mykola Pechenizkiy , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

Effective data selection is critical for efficient training of modern Large Language Models (LLMs). This paper introduces Influence Distillation, a novel, mathematically-justified framework for data selection that employs second-order…

Computation and Language · Computer Science 2025-05-27 Mahdi Nikdan , Vincent Cohen-Addad , Dan Alistarh , Vahab Mirrokni

The recent trend in industry-setting Natural Language Processing (NLP) research has been to operate large %scale pretrained language models like BERT under strict computational limits. While most model compression work has focused on…

Computation and Language · Computer Science 2021-04-13 J. S. McCarley , Rishav Chakravarti , Avirup Sil

Large language models (LLMs) encode extensive world knowledge through pre-training on massive datasets, which can then be fine-tuned for the question-answering (QA) task. However, effective strategies for fine-tuning LLMs for the QA task…

Computation and Language · Computer Science 2025-01-22 Junjie Ye , Yuming Yang , Qi Zhang , Tao Gui , Xuanjing Huang , Peng Wang , Zhongchao Shi , Jianping Fan

When using supervised fine-tuning (SFT) to adapt large language models (LLMs) to specific domains, a significant challenge arises: should we use the entire SFT dataset for fine-tuning? Common practice often involves fine-tuning directly on…

Computation and Language · Computer Science 2025-05-26 Xiang Liu , Zhaoxiang Liu , Peng Wang , Kohou Wang , Huan Hu , Kai Wang , Shiguo Lian

We investigate the effects of post-training quantization and quantization-aware training on the generalization of Transformer language models. We present a new method called self-distilled quantization (SDQ) that minimizes accumulative…

Computation and Language · Computer Science 2023-07-13 James O' Neill , Sourav Dutta

R1-style Reinforcement Learning (RL) significantly enhances Large Language Models' reasoning capabilities, yet the mechanism behind rule-based RL remains unclear. We found that small-scale SFT has substantial influence on RL but shows poor…

Machine Learning · Computer Science 2025-08-06 Yutong Chen , Jiandong Gao , Ji Wu
‹ Prev 1 3 4 5 6 7 10 Next ›