English
Related papers

Related papers: Brewing Knowledge in Context: Distillation Perspec…

200 papers

In-context learning (ICL) can significantly enhance the complex reasoning capabilities of large language models (LLMs), with the key lying in the selection and ordering of demonstration examples. Previous methods typically relied on simple…

Computation and Language · Computer Science 2026-01-06 Xuetao Ma , Wenbin Jiang , Hua Huang

In-Context Learning (ICL) has significantly expanded the general-purpose nature of large language models, allowing them to adapt to novel tasks using merely the inputted context. This has motivated a series of papers that analyze tractable…

Machine Learning · Computer Science 2025-05-05 Core Francisco Park , Ekdeep Singh Lubana , Itamar Pres , Hidenori Tanaka

Pre-trained large language models have demonstrated a strong ability to learn from context, known as in-context learning (ICL). Despite a surge of recent applications that leverage such capabilities, it is by no means clear, at least…

Artificial Intelligence · Computer Science 2025-10-28 Bingqing Song , Jiaxiang Li , Rong Wang , Songtao Lu , Mingyi Hong

Sequential recommender systems have achieved significant success in modeling temporal user behavior but remain limited in capturing rich user semantics beyond interaction patterns. Large Language Models (LLMs) present opportunities to…

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

Transformers have demonstrated remarkable in-context learning (ICL) capabilities, adapting to new tasks by simply conditioning on demonstrations without parameter updates. Compelling empirical and theoretical evidence suggests that ICL, as…

Machine Learning · Computer Science 2025-10-28 Taejong Joo , Diego Klabjan

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

Machine Learning · Computer Science 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

Transformer models exhibit in-context learning: the ability to accurately predict the response to a novel query based on illustrative examples in the input sequence. In-context learning contrasts with traditional in-weights learning of…

Machine Learning · Computer Science 2023-12-07 Gautam Reddy

In this work, we explore the mechanism of in-context learning (ICL) on out-of-distribution (OOD) tasks that were not encountered during training. To achieve this, we conduct synthetic experiments where the objective is to learn OOD…

Machine Learning · Computer Science 2024-12-05 Qixun Wang , Yifei Wang , Yisen Wang , Xianghua Ying

In-Context Learning (ICL) has been a powerful emergent property of large language models that has attracted increasing attention in recent years. In contrast to regular gradient-based learning, ICL is highly interpretable and does not…

Machine Learning · Computer Science 2024-06-07 Brian K Chen , Tianyang Hu , Hui Jin , Hwee Kuan Lee , Kenji Kawaguchi

Large language models (LLMs) have achieved promising results in sentiment analysis through the in-context learning (ICL) paradigm. However, their ability to distinguish subtle sentiments still remains a challenge. Inspired by the human…

Computation and Language · Computer Science 2024-06-06 Hongling Xu , Qianlong Wang , Yice Zhang , Min Yang , Xi Zeng , Bing Qin , Ruifeng Xu

Recent advancements in large language models (LLMs) have raised concerns about inference costs, increasing the need for research into model compression. While knowledge distillation (KD) is a prominent method for this, research on KD for…

Computation and Language · Computer Science 2024-09-30 Gyeongman Kim , Doohyuk Jang , Eunho Yang

Knowledge Distillation (KD) has been considered as a key solution in model compression and acceleration in recent years. In KD, a small student model is generally trained from a large teacher model by minimizing the divergence between the…

Machine Learning · Computer Science 2021-11-16 Raed Alharbi , Minh N. Vu , My T. Thai

In-context learning (ICL) is an effective approach to help large language models (LLMs) adapt to various tasks by providing demonstrations of the target task. Considering the high cost of labeling demonstrations, many methods propose…

Computation and Language · Computer Science 2024-11-04 Dingzirui Wang , Xuanliang Zhang , Qiguang Chen , Longxu Dou , Xiao Xu , Rongyu Cao , Yingwei Ma , Qingfu Zhu , Wanxiang Che , Binhua Li , Fei Huang , Yongbin Li

Large language models (LLMs) can adapt to new tasks via in-context learning (ICL) without parameter updates, making them powerful learning engines for fast adaptation. While extensive research has examined ICL as a few-shot learner, whether…

Machine Learning · Computer Science 2025-09-30 Liuwang Kang , Fan Wang , Shaoshan Liu , Hung-Chyun Chou , Chuan Lin , Ning Ding

Language models significantly benefit from context tokens, such as prompts or scratchpads. They perform better when prompted with informative instructions, and they acquire new reasoning capabilities by generating a scratch-pad before…

Computation and Language · Computer Science 2022-10-03 Charlie Snell , Dan Klein , Ruiqi Zhong

In the past year, distillation has seen a renewed prominence in large language model (LLM) pretraining, exemplified by the Llama-3.2 and Gemma model families. While distillation has historically been shown to improve statistical modeling,…

Machine Learning · Computer Science 2025-09-03 Sachin Goyal , David Lopez-Paz , Kartik Ahuja

In-context learning (ICL) has emerged as a powerful paradigm for adapting large language models (LLMs) to new and data-scarce tasks using only a few carefully selected task-specific examples presented in the prompt. However, given the…

Machine Learning · Computer Science 2025-09-22 Vaibhav Singh , Soumya Suvra Ghosal , Kapu Nirmal Joshua , Soumyabrata Pal , Sayak Ray Chowdhury

Large language models (LLMs) have shown impressive few-shot generalization on many tasks via in-context learning (ICL). Despite their success in showing such emergent abilities, the scale and complexity of larger models also lead to…

Computation and Language · Computer Science 2025-06-03 Chengwei Qin , Wenhan Xia , Fangkai Jiao , Chen Chen , Yuchen Hu , Bosheng Ding , Ruirui Chen , Shafiq Joty

Scaling large language models (LLMs) leads to an emergent capacity to learn in-context from example demonstrations. Despite progress, theoretical understanding of this phenomenon remains limited. We argue that in-context learning relies on…

Computation and Language · Computer Science 2023-03-15 Michael Hahn , Navin Goyal