English
Related papers

Related papers: Efficient LLM Context Distillation

200 papers

Instruction following is a critical ability for Large Language Models to perform downstream tasks. The standard approach to instruction tuning has relied on a specific phase of supervised fine-tuning over curated instruction datasets,…

Computation and Language · Computer Science 2026-05-01 David Ponce , Thierry Etchegoyhen

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Longitudinal NLP tasks require reasoning over temporally ordered text to detect persistence and change in human behavior and opinions. However, in-context learning with large language models struggles on tasks where models must integrate…

Computation and Language · Computer Science 2026-04-21 Iqra Ali , Talia Tseriotou , Mahmud Elahi Akhter , Yuxiang Zhou , Maria Liakata

In many practical applications, large language models (LLMs) need to acquire new knowledge not present in their pre-training data. Efficiently leveraging this knowledge usually relies on supervised fine-tuning or retrieval-augmented…

Computation and Language · Computer Science 2025-08-08 Kalle Kujanpää , Pekka Marttinen , Harri Valpola , Alexander Ilin

Language models significantly benefit from context tokens, such as prompts or scratchpads. They perform better when prompted with informative instructions, and they acquire new reasoning capabilities by generating a scratch-pad before…

Computation and Language · Computer Science 2022-10-03 Charlie Snell , Dan Klein , Ruiqi Zhong

While Large Language Models (LLMs) have demonstrated significant promise as agents in interactive tasks, their substantial computational requirements and restricted number of calls constrain their practical utility, especially in…

Machine Learning · Computer Science 2024-05-07 Maryam Hashemzadeh , Elias Stengel-Eskin , Sarath Chandar , Marc-Alexandre Cote

Building machine translation (MT) systems for low-resource languages is notably difficult due to the scarcity of high-quality data. Although Large Language Models (LLMs) have improved MT system performance, adapting them to…

Computation and Language · Computer Science 2026-02-05 Luis Frentzen Salim , Esteban Carlin , Alexandre Morinvil , Xi Ai , Lun-Wei Ku

Fine-tuning large language models is becoming ever more impractical due to their rapidly-growing scale. This motivates the use of parameter-efficient adaptation methods such as prompt tuning (PT), which adds a small number of tunable…

Computation and Language · Computer Science 2023-02-23 Simeng Sun , Yang Liu , Dan Iter , Chenguang Zhu , Mohit Iyyer

In-context learning (ICL) empowers large language models (LLMs) to perform diverse tasks in underrepresented languages using only short in-context information, offering a crucial avenue for narrowing the gap between high-resource and…

Computation and Language · Computer Science 2024-06-26 Samuel Cahyawijaya , Holy Lovenia , Pascale Fung

In-Context Learning (ICL) has gained prominence due to its ability to perform tasks without requiring extensive training data and its robustness to noisy labels. A typical ICL workflow involves selecting localized examples relevant to a…

Information Retrieval · Computer Science 2025-05-07 Janak Kapuriya , Manit Kaushik , Debasis Ganguly , Sumit Bhatia

In-Context Learning (ICL) enables large language models (LLMs) to achieve rapid task adaptation by learning from demonstrations. With the increase in available context length of LLMs, recent experiments have shown that the performance of…

Computation and Language · Computer Science 2024-08-27 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

Conversational Search (CS) involves retrieving relevant documents from a corpus while considering the conversational context, integrating retrieval with context modeling. Recent advancements in Large Language Models (LLMs) have…

Information Retrieval · Computer Science 2025-05-19 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of natural language processing tasks. However, their enormous parameter size and extremely high requirements for compute power pose challenges for…

Computation and Language · Computer Science 2024-03-26 Bohao Yang , Chen Tang , Kun Zhao , Chenghao Xiao , Chenghua Lin

Large language models (LLMs) enable in-context learning (ICL) by conditioning on a few labeled training examples as a text-based prompt, eliminating the need for parameter updates and achieving competitive performance. In this paper, we…

Computation and Language · Computer Science 2024-04-02 Jianing Wang , Chengyu Wang , Chuanqi Tan , Jun Huang , Ming Gao

Transferring the reasoning capability from stronger large language models (LLMs) to smaller ones has been quite appealing, as smaller LLMs are more flexible to deploy with less expense. Among the existing solutions, knowledge distillation…

Computation and Language · Computer Science 2024-11-26 Yijun Tian , Yikun Han , Xiusi Chen , Wei Wang , Nitesh V. Chawla

Large Language Models (LLMs) have demonstrated impressive performance on a wide range of natural language processing (NLP) tasks, primarily through in-context learning (ICL). In ICL, the LLM is provided with examples that represent a given…

Computation and Language · Computer Science 2025-02-19 Abdellah El Mekki , Muhammad Abdul-Mageed

In-context learning (ICL) allows large language models (LLMs) to adapt to new tasks directly from the given demonstrations without requiring gradient updates. While recent advances have expanded context windows to accommodate more…

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

Computation and Language · Computer Science 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

In the past year, distillation has seen a renewed prominence in large language model (LLM) pretraining, exemplified by the Llama-3.2 and Gemma model families. While distillation has historically been shown to improve statistical modeling,…

Machine Learning · Computer Science 2025-09-03 Sachin Goyal , David Lopez-Paz , Kartik Ahuja

Owing to the capability of in-context learning, large language models (LLMs) have shown impressive performance across diverse mathematical reasoning benchmarks. However, we find that few-shot demonstrations can sometimes bring negative…

Computation and Language · Computer Science 2024-12-18 Jiayu Liu , Zhenya Huang , Chaokun Wang , Xunpeng Huang , Chengxiang Zhai , Enhong Chen