English
Related papers

Related papers: Do pretrained Transformers Learn In-Context by Gra…

200 papers

In-context learning (ICL) is a new paradigm for natural language processing (NLP), where a large language model (LLM) observes a small number of demonstrations and a test instance as its input, and directly makes predictions without…

Computation and Language · Computer Science 2024-12-12 Fei Zhao , Taotian Pang , Zhen Wu , Zheng Ma , Shujian Huang , Xinyu Dai

Many recent language models (LMs) are capable of in-context learning (ICL), manifested in the LMs' ability to perform a new task solely from natural-language instruction. Previous work curating in-context learners assumes that ICL emerges…

Computation and Language · Computer Science 2024-07-01 Michal Štefánik , Marek Kadlčík , Petr Sojka

In-context learning (ICL) -- the capacity of a model to infer and apply abstract patterns from examples provided within its input -- has been extensively studied in large language models trained for next-token prediction on human text. In…

Machine Learning · Computer Science 2026-03-19 Nathan Breslow , Aayush Mishra , Mahler Revsine , Michael C. Schatz , Anqi Liu , Daniel Khashabi

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

We perform in-depth evaluations of in-context learning (ICL) on state-of-the-art transformer, state-space, and hybrid large language models over two categories of knowledge-based ICL tasks. Using a combination of behavioral probing and…

Computation and Language · Computer Science 2026-03-02 Shenran Wang , Timothy Tin-Long Tse , Jian Zhu

Transformer models, notably large language models (LLMs), have the remarkable ability to perform in-context learning (ICL) -- to perform new tasks when prompted with unseen input-output examples without any explicit model training. In this…

Machine Learning · Computer Science 2023-11-03 Steve Yadlowsky , Lyric Doshi , Nilesh Tripuraneni

The intriguing in-context learning (ICL) abilities of deep Transformer models have lately garnered significant attention. By studying in-context linear regression on unimodal Gaussian data, recent empirical and theoretical works have argued…

Machine Learning · Computer Science 2024-10-30 Khashayar Gatmiry , Nikunj Saunshi , Sashank J. Reddi , Stefanie Jegelka , Sanjiv Kumar

Large pretrained language models (LLMs) have shown surprising In-Context Learning (ICL) ability. An important application in deploying large language models is to augment LLMs with a private database for some specific task. The main problem…

Cryptography and Security · Computer Science 2024-05-09 Chunyan Zheng , Keke Sun , Wenhao Zhao , Haibo Zhou , Lixin Jiang , Shaoyang Song , Chunlai Zhou

Transformers have demonstrated a strong ability for in-context learning (ICL), enabling models to solve previously unseen tasks using only example input output pairs provided at inference time. While prior theoretical work has established…

Machine Learning · Computer Science 2026-05-19 Rushil Chandrupatla , Leo Bangayan , Sebastian Leng

In-context learning (ICL) operates by showing language models (LMs) examples of input-output pairs for a given task, i.e., demonstrations. The standard approach for ICL is to prompt the LM with concatenated demonstrations followed by the…

Computation and Language · Computer Science 2023-08-22 Muhammad Khalifa , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Lu Wang

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed a limit on the number of examples that can be shown, making…

Computation and Language · Computer Science 2025-05-29 Jinheon Baek , Sun Jae Lee , Prakhar Gupta , Geunseob Oh , Siddharth Dalmia , Prateek Kolhar

Neural sequence models based on the transformer architecture have demonstrated remarkable \emph{in-context learning} (ICL) abilities, where they can perform new tasks when prompted with training and test examples, without any parameter…

Machine Learning · Computer Science 2023-07-07 Yu Bai , Fan Chen , Huan Wang , Caiming Xiong , Song Mei

We examine the pre-training dynamics of language models, focusing on their ability to copy text from preceding context--a fundamental skill for various LLM applications, including in-context learning (ICL) and retrieval-augmented generation…

Computation and Language · Computer Science 2025-02-07 Ang Lv , Ruobing Xie , Xingwu Sun , Zhanhui Kang , Rui Yan

It has recently been demonstrated empirically that in-context learning emerges in transformers when certain distributional properties are present in the training data, but this ability can also diminish upon further training. We provide a…

Machine Learning · Computer Science 2025-04-29 Bryan Chan , Xinyi Chen , András György , Dale Schuurmans

Large autoregressive models like Transformers can solve tasks through in-context learning (ICL) without learning new weights, suggesting avenues for efficiently solving new tasks. For many tasks, e.g., linear regression, the data…

Machine Learning · Computer Science 2025-06-17 Sarthak Mittal , Eric Elmoznino , Leo Gagnon , Sangnie Bhardwaj , Tom Marty , Dhanya Sridhar , Guillaume Lajoie

While in-context learning (ICL) has achieved remarkable success in natural language and vision domains, its theoretical understanding-particularly in the context of structured geometric data-remains unexplored. This paper initiates a…

Machine Learning · Computer Science 2026-05-19 Zhaiming Shen , Alexander Hsu , Rongjie Lai , Wenjing Liao

What is the relationship between model architecture and the ability to perform in-context learning? In this empirical study, we take the first steps toward answering this question. We evaluate thirteen model architectures capable of causal…

Machine Learning · Computer Science 2024-04-03 Ivan Lee , Nan Jiang , Taylor Berg-Kirkpatrick

In-Context Learning (ICL) has emerged as a pivotal capability of auto-regressive large language models, yet it is hindered by a notable sensitivity to the ordering of context examples regardless of their mutual independence. To address this…

Computation and Language · Computer Science 2025-05-09 Lizhe Fang , Yifei Wang , Khashayar Gatmiry , Lei Fang , Yisen Wang

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Large language models (LLMs) exhibit impressive in-context learning (ICL) capability, enabling them to perform new tasks using only a few demonstrations in the prompt. Two different mechanisms have been proposed to explain ICL: induction…

Machine Learning · Computer Science 2025-05-05 Kayo Yin , Jacob Steinhardt