English
Related papers

Related papers: Probing In-Context Learning: Impact of Task Comple…

200 papers

This paper investigates context stickiness in in-context learning (ICL), a phenomenon where earlier examples in a prompt interfere with a transformer's ability to adapt to later tasks. Using synthetic regression tasks over linear and…

Machine Learning · Computer Science 2026-04-28 Hanna Rød , Dagny Streit , Nils Valseth Selte , Justin Li

As model context lengths continue to increase, the number of demonstrations that can be provided in-context approaches the size of entire training datasets. We study the behavior of in-context learning (ICL) at this extreme scale on…

Computation and Language · Computer Science 2025-03-05 Amanda Bertsch , Maor Ivgi , Emily Xiao , Uri Alon , Jonathan Berant , Matthew R. Gormley , Graham Neubig

The intriguing in-context learning (ICL) abilities of deep Transformer models have lately garnered significant attention. By studying in-context linear regression on unimodal Gaussian data, recent empirical and theoretical works have argued…

Machine Learning · Computer Science 2024-10-30 Khashayar Gatmiry , Nikunj Saunshi , Sashank J. Reddi , Stefanie Jegelka , Sanjiv Kumar

The transformer architecture, which processes sequences of input tokens to produce outputs for query tokens, has revolutionized numerous areas of machine learning. A defining feature of transformers is their ability to perform previously…

Machine Learning · Computer Science 2025-10-02 Hongbo Li , Lingjie Duan , Yingbin Liang

We provide causal mechanistic validation that in-context learning (ICL) decomposes into two separable mechanisms: Task Schema (abstract task type recognition) and Binding (specific input-output associations). Through activation patching…

Machine Learning · Computer Science 2025-12-22 Chaeha Kim

In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks…

Computation and Language · Computer Science 2024-07-24 Quanyu Long , Yin Wu , Wenya Wang , Sinno Jialin Pan

In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, is often assumed to be a unique hallmark of Transformer models. By examining commonly employed synthetic ICL tasks, we demonstrate that multi-layer…

Machine Learning · Computer Science 2025-02-26 William L. Tong , Cengiz Pehlevan

Pre-trained large language models have demonstrated a strong ability to learn from context, known as in-context learning (ICL). Despite a surge of recent applications that leverage such capabilities, it is by no means clear, at least…

Artificial Intelligence · Computer Science 2025-10-28 Bingqing Song , Jiaxiang Li , Rong Wang , Songtao Lu , Mingyi Hong

Transformer-based multimodal large language models often exhibit in-context learning (ICL) abilities. Motivated by this phenomenon, we ask: how do transformers learn to associate information across modalities from in-context examples? We…

Computation and Language · Computer Science 2026-05-27 Yiran Huang , Karsten Roth , Quentin Bouniot , Wenjia Xu , Zeynep Akata

Pretrained Transformers demonstrate remarkable in-context learning (ICL) capabilities, enabling them to adapt to new tasks from demonstrations without parameter updates. However, theoretical studies often rely on simplified architectures…

Machine Learning · Statistics 2026-02-06 Samet Demir , Zafer Dogan

Large language models (LLMs) have demonstrated remarkable proficiency in in-context learning (ICL), where models adapt to new tasks through example-based prompts without requiring parameter updates. However, understanding how tasks are…

Computation and Language · Computer Science 2025-11-11 Baturay Saglam , Xinyang Hu , Zhuoran Yang , Dionysis Kalogerias , Amin Karbasi

In-context learning (ICL) has emerged as a powerful capability for large language models (LLMs) to adapt to downstream tasks by leveraging a few (demonstration) examples. Despite its effectiveness, the mechanism behind ICL remains…

Machine Learning · Computer Science 2025-06-03 Pengfei He , Yingqian Cui , Han Xu , Hui Liu , Makoto Yamada , Jiliang Tang , Yue Xing

Pre-trained large language models based on Transformers have demonstrated remarkable in-context learning (ICL) abilities. With just a few demonstration examples, the models can implement new tasks without any parameter updates. However, it…

Machine Learning · Computer Science 2024-11-04 Ruifeng Ren , Yong Liu

A striking property of transformers is their ability to perform in-context learning (ICL), a machine learning framework in which the learner is presented with a novel context during inference implicitly through some data, and tasked with…

Machine Learning · Computer Science 2024-05-29 Liam Collins , Advait Parulekar , Aryan Mokhtari , Sujay Sanghavi , Sanjay Shakkottai

In-context learning (ICL) enables Large Language Models (LLMs) to learn tasks from demonstration examples without parameter updates. Although it has been extensively studied in LLMs, its effectiveness in Vision-Language Models (VLMs)…

Machine Learning · Computer Science 2025-10-29 Gabriel O. dos Santos , Esther Colombini , Sandra Avila

In-Context Learning (ICL) enables large language models (LLMs) to achieve rapid task adaptation by learning from demonstrations. With the increase in available context length of LLMs, recent experiments have shown that the performance of…

Computation and Language · Computer Science 2024-08-27 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

In-context learning (ICL) is a cornerstone of large language model (LLM) functionality, yet its theoretical foundations remain elusive due to the complexity of transformer architectures. In particular, most existing work only theoretically…

Machine Learning · Computer Science 2024-09-18 Siyu Chen , Heejune Sheen , Tianhao Wang , Zhuoran Yang

While in-context learning (ICL) has achieved remarkable success in natural language and vision domains, its theoretical understanding-particularly in the context of structured geometric data-remains unexplored. This paper initiates a…

Machine Learning · Computer Science 2026-05-19 Zhaiming Shen , Alexander Hsu , Rongjie Lai , Wenjing Liao

In-context learning (ICL) allows transformer-based language models that are pre-trained on general text to quickly learn a specific task with a few "task demonstrations" without updating their parameters, significantly boosting their…

Computation and Language · Computer Science 2024-12-17 Zijian Zhou , Xiaoqiang Lin , Xinyi Xu , Alok Prakash , Daniela Rus , Bryan Kian Hsiang Low

Transformer structure has achieved great success in multiple applied machine learning communities, such as natural language processing (NLP), computer vision (CV) and information retrieval (IR). Transformer architecture's core mechanism\,…

Information Retrieval · Computer Science 2026-01-06 Zhichao Xu