English
Related papers

Related papers: Unifying Attention Heads and Task Vectors via Hidd…

200 papers

Pre-trained large language models based on Transformers have demonstrated remarkable in-context learning (ICL) abilities. With just a few demonstration examples, the models can implement new tasks without any parameter updates. However, it…

Machine Learning · Computer Science 2024-11-04 Ruifeng Ren , Yong Liu

In-context learning (ICL) emerges as a promising capability of large language models (LLMs) by providing them with demonstration examples to perform diverse tasks. However, the underlying mechanism of how LLMs learn from the provided…

Computation and Language · Computer Science 2023-12-20 Lean Wang , Lei Li , Damai Dai , Deli Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Autoregressive transformers exhibit adaptive learning through in-context learning (ICL), which begs the question of how. Prior works have shown that transformers represent the ICL tasks as vectors in their representations. In this paper, we…

Computation and Language · Computer Science 2025-06-03 Seungwook Han , Jinyeop Song , Jeff Gore , Pulkit Agrawal

In-context learning (ICL) enables large language models (LLMs) to acquire new behaviors from the input sequence alone without any parameter updates. Recent studies have shown that ICL can surpass the original meaning learned in pretraining…

Machine Learning · Computer Science 2025-07-31 Yongyi Yang , Hidenori Tanaka , Wei Hu

Large language models (LLMs) have shown remarkable capacity for in-context learning (ICL), where learning a new task from just a few training examples is done without being explicitly pre-trained. However, despite the success of LLMs, there…

Computation and Language · Computer Science 2023-08-02 Xindi Wang , Yufei Wang , Can Xu , Xiubo Geng , Bowen Zhang , Chongyang Tao , Frank Rudzicz , Robert E. Mercer , Daxin Jiang

In-context learning (ICL) refers to a remarkable capability of pretrained large language models, which can learn a new task given a few examples during inference. However, theoretical understanding of ICL is largely under-explored,…

Machine Learning · Computer Science 2024-09-27 Tong Yang , Yu Huang , Yingbin Liang , Yuejie Chi

In-Context Learning (ICL) has emerged as a pivotal capability of auto-regressive large language models, yet it is hindered by a notable sensitivity to the ordering of context examples regardless of their mutual independence. To address this…

Computation and Language · Computer Science 2025-05-09 Lizhe Fang , Yifei Wang , Khashayar Gatmiry , Lei Fang , Yisen Wang

Large pretrained language models have shown surprising in-context learning (ICL) ability. With a few demonstration input-label pairs, they can predict the label for an unseen input without parameter updates. Despite the great success in…

Computation and Language · Computer Science 2023-05-16 Damai Dai , Yutao Sun , Li Dong , Yaru Hao , Shuming Ma , Zhifang Sui , Furu Wei

Recent research has shown that Transformers with linear attention are capable of in-context learning (ICL) by implementing a linear estimator through gradient descent steps. However, the existing results on the optimization landscape apply…

Machine Learning · Computer Science 2024-07-16 Yingcong Li , Ankit Singh Rawat , Samet Oymak

In-context learning (ICL) has emerged as a powerful paradigm for easily adapting Large Language Models (LLMs) to various tasks. However, our understanding of how ICL works remains limited. We explore a simple model of ICL in a controlled…

Machine Learning · Computer Science 2025-09-03 Omar Naim , Guilhem Fouilhé , Nicholas Asher

In-context learning (ICL) allows transformer-based language models that are pre-trained on general text to quickly learn a specific task with a few "task demonstrations" without updating their parameters, significantly boosting their…

Computation and Language · Computer Science 2024-12-17 Zijian Zhou , Xiaoqiang Lin , Xinyi Xu , Alok Prakash , Daniela Rus , Bryan Kian Hsiang Low

In-context learning (ICL) enables Large Language Models (LLMs) to adapt to new tasks using few examples, with task vectors - specific hidden state activations - hypothesized to encode task information. Existing studies are limited by…

Computation and Language · Computer Science 2025-06-02 Pavel Tikhonov , Ivan Oseledets , Elena Tutubalina

This thesis investigates two key phenomena in large language models (LLMs): in-context learning (ICL) and model collapse. We study ICL in a linear transformer with tied weights trained on linear regression tasks, and show that minimising…

Artificial Intelligence · Computer Science 2026-01-06 Josef Ott

In-context learning (ICL) improves language models' performance on a variety of NLP tasks by simply demonstrating a handful of examples at inference time. It is not well understood why ICL ability emerges, as the model has never been…

Computation and Language · Computer Science 2023-06-28 Xiaochuang Han , Daniel Simig , Todor Mihaylov , Yulia Tsvetkov , Asli Celikyilmaz , Tianlu Wang

Large language models (LLMs) are powerful models that can learn concepts at the inference stage via in-context learning (ICL). While theoretical studies, e.g., \cite{zhang2023trained}, attempt to explain the mechanism of ICL, they assume…

Machine Learning · Computer Science 2024-06-19 Yue Xing , Xiaofeng Lin , Chenheng Xu , Namjoon Suh , Qifan Song , Guang Cheng

The transformer architecture, which processes sequences of input tokens to produce outputs for query tokens, has revolutionized numerous areas of machine learning. A defining feature of transformers is their ability to perform previously…

Machine Learning · Computer Science 2025-10-02 Hongbo Li , Lingjie Duan , Yingbin Liang

In-context learning (ICL) with dynamically selected demonstrations combines the flexibility of prompting large language models (LLMs) with the ability to leverage training data to improve performance. While ICL has been highly successful…

Computation and Language · Computer Science 2025-06-17 Shivanshu Gupta , Sameer Singh , Ashish Sabharwal , Tushar Khot , Ben Bogin

In-context learning (ICL) has shown impressive results in few-shot learning tasks, yet its underlying mechanism is still not fully understood. A recent line of work suggests that ICL performs gradient descent (GD)-based optimization…

Computation and Language · Computer Science 2024-04-02 Gilad Deutch , Nadav Magar , Tomer Bar Natan , Guy Dar

Large Language Models (LLMs) have exhibited an impressive ability to perform In-Context Learning (ICL) from only a few examples. Recent works have indicated that the functions learned by ICL can be represented through compressed vectors…

Computation and Language · Computer Science 2024-07-08 Dongfang Li , Zhenyu Liu , Xinshuo Hu , Zetian Sun , Baotian Hu , Min Zhang

Despite the advancements in in-context learning (ICL) for large language models (LLMs), current research centers on specific prompt engineering, such as demonstration selection, with the expectation that a single iteration of demonstrations…

Computation and Language · Computer Science 2024-06-05 Jiaxi Yang , Binyuan Hui , Min Yang , Bailin Wang , Bowen Li , Binhua Li , Fei Huang , Yongbin Li