English
Related papers

Related papers: LLMs Are In-Context Bandit Reinforcement Learners

200 papers

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

Computation and Language · Computer Science 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

In-context learning (ICL) has emerged as a powerful capability for large language models (LLMs) to adapt to downstream tasks by leveraging a few (demonstration) examples. Despite its effectiveness, the mechanism behind ICL remains…

Machine Learning · Computer Science 2025-06-03 Pengfei He , Yingqian Cui , Han Xu , Hui Liu , Makoto Yamada , Jiliang Tang , Yue Xing

Accurate uncertainty quantification is crucial for the safe deployment of machine learning models, and prior research has demonstrated improvements in the calibration of modern language models (LMs). We study in-context learning (ICL), a…

Computation and Language · Computer Science 2024-03-29 Hanlin Zhang , Yi-Fan Zhang , Yaodong Yu , Dhruv Madeka , Dean Foster , Eric Xing , Himabindu Lakkaraju , Sham Kakade

We study the in-context learning dynamics of large language models (LLMs) using three instrumental learning tasks adapted from cognitive psychology. We find that LLMs update their beliefs in an asymmetric manner and learn more from…

Machine Learning · Computer Science 2024-02-07 Johannes A. Schubert , Akshay K. Jagadish , Marcel Binz , Eric Schulz

Large language models have shown tremendous performance in a variety of tasks. In-context learning -- the ability to improve at a task after being provided with a number of demonstrations -- is seen as one of the main contributors to their…

Computation and Language · Computer Science 2023-05-23 Julian Coda-Forno , Marcel Binz , Zeynep Akata , Matthew Botvinick , Jane X. Wang , Eric Schulz

In-context learning (ICL) is a key building block of modern large language models, yet its theoretical mechanisms remain poorly understood. It is particularly mysterious how ICL operates in real-world applications where tasks have a common…

Disordered Systems and Neural Networks · Physics 2026-04-24 Kaito Takanami , Takashi Takahashi , Yoshiyuki Kabashima

We present substantial evidence demonstrating the benefits of integrating Large Language Models (LLMs) with a Contextual Multi-Armed Bandit framework. Contextual bandits have been widely used in recommendation systems to generate…

Machine Learning · Computer Science 2024-10-30 Parand A. Alamdari , Yanshuai Cao , Kevin H. Wilson

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

Large language models (LLMs) demonstrate emergent in-context learning capabilities, where they adapt to new tasks based on example demonstrations. However, in-context learning has seen limited effectiveness in many settings, is difficult to…

Machine Learning · Computer Science 2024-02-15 Sheng Liu , Haotian Ye , Lei Xing , James Zou

In-context learning (ICL) allows some autoregressive models to solve tasks via next-token prediction and without needing further training. This has led to claims about these model's ability to solve (learn) unseen tasks with only a few…

Computation and Language · Computer Science 2026-02-12 Adrian de Wynter

Large language models (LLMs) have shown remarkable in-context learning (ICL) capabilities, yet their potential for sequential decision-making remains underexplored. In this paper, we study the ICL capabilities of LLMs in sequential…

Machine Learning · Computer Science 2026-05-12 Minmin Zhang , Sina Aghaei , Soroush Saghafian

Large vision-language models (LVLMs) employ multi-modal in-context learning (MM-ICL) to adapt to new tasks by leveraging demonstration examples. While increasing the number of demonstrations boosts performance, they incur significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Shin'ya Yamaguchi , Daiki Chijiwa , Tamao Sakao , Taku Hasegawa

The ability to learn from context with novel concepts, and deliver appropriate responses are essential in human conversations. Despite current Multimodal Large Language Models (MLLMs) and Large Language Models (LLMs) being trained on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yan Tai , Weichen Fan , Zhao Zhang , Feng Zhu , Rui Zhao , Ziwei Liu

Large language models (LLMs) like GPT-4 and LLaMA-3 utilize the powerful in-context learning (ICL) capability of Transformer architecture to learn on the fly from limited examples. While ICL underpins many LLM applications, its full…

Machine Learning · Computer Science 2025-03-21 Xingxuan Zhang , Haoran Wang , Jiansheng Li , Yuan Xue , Shikai Guan , Renzhe Xu , Hao Zou , Han Yu , Peng Cui

In-Context Learning (ICL) has emerged as an important new paradigm in natural language processing and large language model (LLM) applications. However, the theoretical understanding of the ICL mechanism remains limited. This paper aims to…

Information Theory · Computer Science 2025-10-17 Huaze Tang , Tianren Peng , Shao-lun Huang

The quality of output from large language models (LLMs), particularly in machine translation (MT), is closely tied to the quality of in-context examples (ICEs) provided along with the query, i.e., the text to translate. The effectiveness of…

Computation and Language · Computer Science 2024-09-19 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

In everyday conversations, humans can take on different roles and adapt their vocabulary to their chosen roles. We explore whether LLMs can take on, that is impersonate, different roles when they generate text in-context. We ask LLMs to…

Artificial Intelligence · Computer Science 2023-11-28 Leonard Salewski , Stephan Alaniz , Isabel Rio-Torto , Eric Schulz , Zeynep Akata

Auditory Large Language Models (LLMs) have demonstrated strong performance across a wide range of speech and audio understanding tasks. Nevertheless, they often struggle when applied to low-resource tasks. In case in-domain labeled data are…

Sound · Computer Science 2026-05-27 Haolong Zheng , Siyin Wang , Zengrui Jin , Mark Hasegawa-Johnson

In-context learning (ICL) unfolds as large language models become capable of inferring test labels conditioned on a few labeled samples without any gradient update. ICL-enabled large language models provide a promising step forward toward…

Computation and Language · Computer Science 2023-06-27 Eshaan Tanwar , Subhabrata Dutta , Manish Borthakur , Tanmoy Chakraborty

In-context learning (ICL) enables Large Language Models (LLMs) to adapt to new tasks with only a small set of examples at inference time, thereby avoiding task-specific fine-tuning. However, in-context examples may contain privacy-sensitive…

Machine Learning · Computer Science 2026-02-06 Rob Romijnders , Mohammad Mahdi Derakhshani , Jonathan Petit , Max Welling , Christos Louizos , Yuki M. Asano