English
Related papers

Related papers: Implicit Statistical Inference in Transformers: Ap…

200 papers

By allowing models to predict without task-specific training, in-context learning (ICL) with pretrained LLMs has enormous potential in NLP. However, a number of problems persist in ICL. In particular, its performance is sensitive to the…

Computation and Language · Computer Science 2024-02-20 Zhichao Xu , Daniel Cohen , Bei Wang , Vivek Srikumar

We investigate the transformer's capability to simulate the training process of deep models via in-context learning (ICL), i.e., in-context deep learning. Our key contribution is providing a positive example of using a transformer to train…

Machine Learning · Computer Science 2025-04-15 Weimin Wu , Maojiang Su , Jerry Yao-Chieh Hu , Zhao Song , Han Liu

In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, is often assumed to be a unique hallmark of Transformer models. By examining commonly employed synthetic ICL tasks, we demonstrate that multi-layer…

Machine Learning · Computer Science 2025-02-26 William L. Tong , Cengiz Pehlevan

Regression models often fail to generalize effectively in regions characterized by highly imbalanced label distributions. Previous methods for deep imbalanced regression rely on gradient-based weight updates, which tend to overfit in…

Machine Learning · Computer Science 2024-11-21 Ismail Nejjar , Faez Ahmed , Olga Fink

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

Computation and Language · Computer Science 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

Large language models (LLMs) exhibit remarkable flexibility: they can adapt to novel tasks from in-context examples without any parameter updates, a capability known as in-context learning (ICL). Prior work on synthetic tasks has shown that…

Computation and Language · Computer Science 2026-05-29 Hua-Dong Xiong , Li Ji-An , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Transformer architectures can solve unseen tasks based on input-output pairs in a given prompt due to in-context learning (ICL). Existing theoretical studies on ICL have mainly focused on linear regression tasks, often with i.i.d. inputs.…

Machine Learning · Computer Science 2025-11-19 Yanna Ding , Songtao Lu , Yingdong Lu , Tomasz Nowicki , Jianxi Gao

In-context learning (ICL) -- the capacity of a model to infer and apply abstract patterns from examples provided within its input -- has been extensively studied in large language models trained for next-token prediction on human text. In…

Machine Learning · Computer Science 2026-03-19 Nathan Breslow , Aayush Mishra , Mahler Revsine , Michael C. Schatz , Anqi Liu , Daniel Khashabi

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

Computation and Language · Computer Science 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi

The emergent ability of Large Language Models to use a small number of examples to learn to perform in novel domains and tasks, also called in-context learning (ICL). In this work, we show that a much smaller model can be trained to perform…

Computation and Language · Computer Science 2023-09-18 Raphael Reinauer , Patrick Simianer , Kaden Uhlig , Johannes E. M. Mosig , Joern Wuebker

Large language models are capable of in-context learning, the ability to perform new tasks at test time using a handful of input-output examples, without parameter updates. We develop a universal approximation theory to elucidate how…

Machine Learning · Computer Science 2025-08-29 Gen Li , Yuchen Jiao , Yu Huang , Yuting Wei , Yuxin Chen

In this work, we introduce a novel paradigm for generalized In-Context Learning (ICL), termed Indirect In-Context Learning. In Indirect ICL, we explore demonstration selection strategies tailored for two distinct real-world scenarios:…

Machine Learning · Computer Science 2025-10-03 Hadi Askari , Shivanshu Gupta , Terry Tong , Fei Wang , Anshuman Chhabra , Muhao Chen

Transformers excel at in-context learning (ICL) -- learning from demonstrations without parameter updates -- but how they do so remains a mystery. Recent work suggests that Transformers may internally run Gradient Descent (GD), a…

Machine Learning · Computer Science 2024-11-19 Deqing Fu , Tian-Qi Chen , Robin Jia , Vatsal Sharan

Large language models (LLMs) like GPT-4 and LLaMA-3 utilize the powerful in-context learning (ICL) capability of Transformer architecture to learn on the fly from limited examples. While ICL underpins many LLM applications, its full…

Machine Learning · Computer Science 2025-03-21 Xingxuan Zhang , Haoran Wang , Jiansheng Li , Yuan Xue , Shikai Guan , Renzhe Xu , Hao Zou , Han Yu , Peng Cui

Recent research has shown that Transformers with linear attention are capable of in-context learning (ICL) by implementing a linear estimator through gradient descent steps. However, the existing results on the optimization landscape apply…

Machine Learning · Computer Science 2024-07-16 Yingcong Li , Ankit Singh Rawat , Samet Oymak

While in-context learning (ICL) has achieved remarkable success in natural language and vision domains, its theoretical understanding-particularly in the context of structured geometric data-remains unexplored. This paper initiates a…

Machine Learning · Computer Science 2026-05-19 Zhaiming Shen , Alexander Hsu , Rongjie Lai , Wenjing Liao

In-Context Learning (ICL) has emerged as a pivotal capability of auto-regressive large language models, yet it is hindered by a notable sensitivity to the ordering of context examples regardless of their mutual independence. To address this…

Computation and Language · Computer Science 2025-05-09 Lizhe Fang , Yifei Wang , Khashayar Gatmiry , Lei Fang , Yisen Wang

In-context learning (ICL) with dynamically selected demonstrations combines the flexibility of prompting large language models (LLMs) with the ability to leverage training data to improve performance. While ICL has been highly successful…

Computation and Language · Computer Science 2025-06-17 Shivanshu Gupta , Sameer Singh , Ashish Sabharwal , Tushar Khot , Ben Bogin

In-context learning (ICL) is a central capability of Transformer models, but the structures in data that enable its emergence and govern its robustness remain poorly understood. In this work, we study how the structure of pretraining tasks…

Machine Learning · Statistics 2025-10-01 Mary I. Letey , Jacob A. Zavatone-Veth , Yue M. Lu , Cengiz Pehlevan

In-context learning (ICL) is a powerful paradigm emerged from large language models (LLMs). Despite its promises, ICL performance is known to be highly sensitive to input examples. In this work, we use $\textit{in-context influences}$ to…

Computation and Language · Computer Science 2023-06-06 Tai Nguyen , Eric Wong