English
Related papers

Related papers: Understanding Contextual Recall in Transformers: H…

200 papers

We investigate training strategies that co-develop in-context learning (ICL) and in-weights learning (IWL), and the ability to switch between them based on context relevance. Although current LLMs exhibit both modes, standard task-specific…

Machine Learning · Computer Science 2026-04-03 Deeptanshu Malu , Deevyanshu Malu , Aditya Nemiwal , Sunita Sarawagi

In-context learning (ICL) is an important paradigm for adapting large language models (LLMs) to new tasks, but the generalization behavior of ICL remains poorly understood. We investigate the inductive biases of ICL from the perspective of…

Computation and Language · Computer Science 2023-05-23 Chenglei Si , Dan Friedman , Nitish Joshi , Shi Feng , Danqi Chen , He He

Human listeners readily adjust to unfamiliar speakers and language varieties through exposure, but do these adaptation benefits extend to state-of-the-art spoken language models? We introduce a scalable framework that allows for in-context…

Computation and Language · Computer Science 2025-05-22 Nathan Roll , Calbert Graham , Yuka Tatsumi , Kim Tien Nguyen , Meghan Sumner , Dan Jurafsky

What is the relationship between model architecture and the ability to perform in-context learning? In this empirical study, we take the first steps toward answering this question. We evaluate thirteen model architectures capable of causal…

Machine Learning · Computer Science 2024-04-03 Ivan Lee , Nan Jiang , Taylor Berg-Kirkpatrick

Although transformers have demonstrated impressive capabilities for in-context learning (ICL) in practice, theoretical understanding of the underlying mechanism that allows transformers to perform ICL is still in its infancy. This work aims…

Machine Learning · Computer Science 2025-05-30 Wei Shen , Ruida Zhou , Jing Yang , Cong Shen

Recent work has demonstrated that transformers and linear attention models can perform in-context learning (ICL) on simple function classes, such as linear regression. In this paper, we empirically study how these two attention mechanisms…

Machine Learning · Computer Science 2026-02-20 Ayush Goel , Arjun Kohli , Sarvagya Somvanshi

In-context learning (ICL) is a valuable capability exhibited by Transformers pretrained on diverse sequence tasks. However, previous studies have observed that ICL often conflicts with the model's inherent in-weight learning (IWL) ability.…

Machine Learning · Computer Science 2026-03-17 Guanyu Chen , Ruichen Wang , Tianren Zhang , Feng Chen

Large language models (LLMs) like transformers demonstrate impressive in-context learning (ICL) capabilities, allowing them to make predictions for new tasks based on prompt exemplars without parameter updates. While existing ICL theories…

Machine Learning · Computer Science 2024-11-12 Kevin Christian Wibisono , Yixin Wang

Many real-world tasks require language models (LMs) to reason over complex contexts that exceed their parametric knowledge. This calls for context learning, where LMs directly learn relevant knowledge from the given context. An intuitive…

In-context learning (ICL) is an effective approach to help large language models (LLMs) adapt to various tasks by providing demonstrations of the target task. Considering the high cost of labeling demonstrations, many methods propose…

Computation and Language · Computer Science 2024-11-04 Dingzirui Wang , Xuanliang Zhang , Qiguang Chen , Longxu Dou , Xiao Xu , Rongyu Cao , Yingwei Ma , Qingfu Zhu , Wanxiang Che , Binhua Li , Fei Huang , Yongbin Li

Can in-context learning (ICL) override pre-trained label semantics, or does it merely refine an existing semantic backbone? We address this question by treating LLMs as prompt-induced classifiers and contrasting their behavior under…

Computation and Language · Computer Science 2025-11-27 Anantha Padmanaban Krishna Kumar

In-context learning (ICL) is now a common method for teaching large language models (LLMs) new tasks: given labeled examples in the input context, the LLM learns to perform the task without weight updates. Do models guided via ICL infer the…

Computation and Language · Computer Science 2024-04-11 Aaron Mueller , Albert Webson , Jackson Petty , Tal Linzen

In-context learning (ICL) allows large language models (LLMs) to solve novel tasks without weight updates. Despite its empirical success, the mechanism behind ICL remains poorly understood, limiting our ability to interpret, improve, and…

Machine Learning · Computer Science 2025-06-16 Chengye Li , Haiyun Liu , Yuanxi Li

Large language models (LLMs) have demonstrated remarkable in-context learning (ICL) abilities. However, existing theoretical analysis of ICL primarily exhibits two limitations: (a) Limited i.i.d. Setting. Most studies focus on supervised…

Computation and Language · Computer Science 2025-02-25 Zixuan Gong , Xiaolin Hu , Huayi Tang , Yong Liu

Fine-tuning large language models is becoming ever more impractical due to their rapidly-growing scale. This motivates the use of parameter-efficient adaptation methods such as prompt tuning (PT), which adds a small number of tunable…

Computation and Language · Computer Science 2023-02-23 Simeng Sun , Yang Liu , Dan Iter , Chenguang Zhu , Mohit Iyyer

Large pretrained language models (LLMs) can be rapidly adapted to a wide variety of tasks via a text-to-text approach, where the instruction and input are fed to the model in natural language. Combined with in-context learning (ICL), this…

Computation and Language · Computer Science 2023-12-13 Marc-Etienne Brunet , Ashton Anderson , Richard Zemel

When large language models (LLMs) use in-context learning (ICL) to solve a new task, they must infer latent concepts from demonstration examples. This raises the question of whether and how transformers represent latent structures as part…

Machine Learning · Computer Science 2025-09-29 Guan Zhe Hong , Bhavya Vasudeva , Vatsal Sharan , Cyrus Rashtchian , Prabhakar Raghavan , Rina Panigrahy

In-context learning (ICL) has revolutionized the capabilities of transformer models in NLP. In our project, we extend the understanding of the mechanisms underpinning ICL by exploring whether transformers can learn from sequential,…

Machine Learning · Computer Science 2023-12-22 Ryan Campbell , Emma Guo , Evan Hu , Reya Vir , Ethan Hsiao

In this work, we explore the mechanism of in-context learning (ICL) on out-of-distribution (OOD) tasks that were not encountered during training. To achieve this, we conduct synthetic experiments where the objective is to learn OOD…

Machine Learning · Computer Science 2024-12-05 Qixun Wang , Yifei Wang , Yisen Wang , Xianghua Ying

Transformer models exhibit in-context learning: the ability to accurately predict the response to a novel query based on illustrative examples in the input sequence. In-context learning contrasts with traditional in-weights learning of…

Machine Learning · Computer Science 2023-12-07 Gautam Reddy