English
Related papers

Related papers: Context-Scaling versus Task-Scaling in In-Context …

200 papers

A striking property of transformers is their ability to perform in-context learning (ICL), a machine learning framework in which the learner is presented with a novel context during inference implicitly through some data, and tasked with…

Machine Learning · Computer Science 2024-05-29 Liam Collins , Advait Parulekar , Aryan Mokhtari , Sujay Sanghavi , Sanjay Shakkottai

In-context learning (ICL) refers to the ability of a model to learn new tasks from examples in its input without any parameter updates. In contrast to previous theories of ICL relying on toy models and data settings, recently it has been…

Machine Learning · Computer Science 2025-12-15 Francesco Innocenti , El Mehdi Achour

Transformer-based language models excel at in-context learning (ICL), where they can adapt to new tasks based on contextual examples, without parameter updates. In a specific form of ICL, which we refer to as \textit{contextual recall},…

Machine Learning · Computer Science 2026-03-24 Bhavya Vasudeva , Puneesh Deora , Alberto Bietti , Vatsal Sharan , Christos Thrampoulidis

In-Context Learning (ICL) enhances the performance of large language models (LLMs) with demonstrations. However, obtaining these demonstrations primarily relies on manual effort. In most real-world scenarios, users are often unwilling or…

Computation and Language · Computer Science 2025-06-02 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bing Qin , Ting Liu

Pre-trained large language models based on Transformers have demonstrated remarkable in-context learning (ICL) abilities. With just a few demonstration examples, the models can implement new tasks without any parameter updates. However, it…

Machine Learning · Computer Science 2024-11-04 Ruifeng Ren , Yong Liu

Large Language Models (LLMs) have transformed NLP with their remarkable In-context Learning (ICL) capabilities. Automated assistants based on LLMs are gaining popularity; however, adapting them to novel tasks is still challenging. While…

Computation and Language · Computer Science 2024-06-13 Anwoy Chatterjee , Eshaan Tanwar , Subhabrata Dutta , Tanmoy Chakraborty

In-context learning (ICL) has emerged as a powerful capability of large pretrained transformers, enabling them to solve new tasks implicit in example input-output pairs without any gradient updates. Despite its practical success, the…

Machine Learning · Computer Science 2025-07-15 Joshua Hill , Benjamin Eyre , Elliot Creager

In-context learning (ICL) refers to the ability of a model to condition on a few in-context demonstrations (input-output examples of the underlying task) to generate the answer for a new query input, without updating parameters. Despite the…

Machine Learning · Computer Science 2023-12-01 Yongqiang Chen , Binghui Xie , Kaiwen Zhou , Bo Han , Yatao Bian , James Cheng

In-context learning (ICL) is a type of prompting where a transformer model operates on a sequence of (input, output) examples and performs inference on-the-fly. In this work, we formalize in-context learning as an algorithm learning problem…

Machine Learning · Computer Science 2023-02-07 Yingcong Li , M. Emrullah Ildiz , Dimitris Papailiopoulos , Samet Oymak

Recent work has demonstrated that transformers and linear attention models can perform in-context learning (ICL) on simple function classes, such as linear regression. In this paper, we empirically study how these two attention mechanisms…

Machine Learning · Computer Science 2026-02-20 Ayush Goel , Arjun Kohli , Sarvagya Somvanshi

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

We perform in-depth evaluations of in-context learning (ICL) on state-of-the-art transformer, state-space, and hybrid large language models over two categories of knowledge-based ICL tasks. Using a combination of behavioral probing and…

Computation and Language · Computer Science 2026-03-02 Shenran Wang , Timothy Tin-Long Tse , Jian Zhu

In-context learning (ICL) adapts LLMs by providing demonstrations without fine-tuning the model parameters; however, it does not differentiate between demonstrations and quadratically increases the complexity of Transformer LLMs, exhausting…

Computation and Language · Computer Science 2024-11-06 Giwon Hong , Emile van Krieken , Edoardo Ponti , Nikolay Malkin , Pasquale Minervini

Although transformers have demonstrated impressive capabilities for in-context learning (ICL) in practice, theoretical understanding of the underlying mechanism that allows transformers to perform ICL is still in its infancy. This work aims…

Machine Learning · Computer Science 2025-05-30 Wei Shen , Ruida Zhou , Jing Yang , Cong Shen

Large Language Models (LLMs) have proven effective at In-Context Learning (ICL), an ability that allows them to create predictors from labeled examples. Few studies have explored the interplay between ICL and specific properties of…

Machine Learning · Computer Science 2023-11-23 David Oniani , Yanshan Wang

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

In-context learning (ICL) has garnered significant attention for its ability to grasp functions/tasks from demonstrations. Recent studies suggest the presence of a latent task/function vector in LLMs during ICL. Merullo et al. (2024) showed…

Machine Learning · Computer Science 2025-08-14 Dake Bu , Wei Huang , Andi Han , Atsushi Nitanda , Qingfu Zhang , Hau-San Wong , Taiji Suzuki

Language models have the ability to perform in-context learning (ICL), allowing them to flexibly adapt their behavior based on context. This contrasts with in-weights learning (IWL), where memorized information is encoded in model…

Computation and Language · Computer Science 2025-03-04 Suraj Anand , Michael A. Lepori , Jack Merullo , Ellie Pavlick

Large language models (LLMs) like transformers demonstrate impressive in-context learning (ICL) capabilities, allowing them to make predictions for new tasks based on prompt exemplars without parameter updates. While existing ICL theories…

Machine Learning · Computer Science 2024-11-12 Kevin Christian Wibisono , Yixin Wang

In-context Learning (ICL) empowers large language models (LLMs) to swiftly adapt to unseen tasks at inference-time by prefixing a few demonstration examples before queries. Despite its versatility, ICL incurs substantial computational and…

Machine Learning · Computer Science 2025-02-26 Zhuowei Li , Zihao Xu , Ligong Han , Yunhe Gao , Song Wen , Di Liu , Hao Wang , Dimitris N. Metaxas