English
Related papers

Related papers: Metric-Based In-context Learning: A Case Study in …

200 papers

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

Computation and Language · Computer Science 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

In-context learning (ICL) enables large language models (LLMs) to perform new tasks by prompting them with a sequence of training examples. However, it is known that ICL is very sensitive to the choice of training examples: randomly…

Computation and Language · Computer Science 2023-09-13 Ting-Yun Chang , Robin Jia

In-context learning (ICL) is an effective approach to help large language models (LLMs) adapt to various tasks by providing demonstrations of the target task. Considering the high cost of labeling demonstrations, many methods propose…

Computation and Language · Computer Science 2024-11-04 Dingzirui Wang , Xuanliang Zhang , Qiguang Chen , Longxu Dou , Xiao Xu , Rongyu Cao , Yingwei Ma , Qingfu Zhu , Wanxiang Che , Binhua Li , Fei Huang , Yongbin Li

This thesis investigates two key phenomena in large language models (LLMs): in-context learning (ICL) and model collapse. We study ICL in a linear transformer with tied weights trained on linear regression tasks, and show that minimising…

Artificial Intelligence · Computer Science 2026-01-06 Josef Ott

Multilingual large language models (MLLMs) are able to leverage in-context learning (ICL) to achieve high performance by leveraging cross-lingual knowledge transfer without parameter updates. However, their effectiveness is highly sensitive…

Computation and Language · Computer Science 2025-02-18 Masahiro Kaneko , Alham Fikri Aji , Timothy Baldwin

Large Language Models (LLMs) have the impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is…

Computation and Language · Computer Science 2023-10-27 Harvey Yiyun Fu , Qinyuan Ye , Albert Xu , Xiang Ren , Robin Jia

In-context learning (ICL) allows large language models (LLMs) to adapt to new tasks from a few examples, making it promising for languages underrepresented in pre-training. Recent work on many-shot ICL suggests that modern LLMs can further…

Computation and Language · Computer Science 2026-04-07 Yinhan Lu , Gaganpreet Jhajj , Chen Zhang , Anietie Andy , David Ifeoluwa Adelani

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

Machine Learning · Computer Science 2026-03-13 Faris Chaudhry , Siddhant Gadkari

Language models are aligned to the collective voice of many, resulting in generic outputs that do not align with specific users' styles. In this work, we present Trial-Error-Explain In-Context Learning (TICL), a tuning-free method that…

Computation and Language · Computer Science 2025-04-08 Hyundong Cho , Karishma Sharma , Nicolaas Jedema , Leonardo F. R. Ribeiro , Alessandro Moschitti , Ravi Krishnan , Jonathan May

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

Large language models (LLMs) have shown impressive capabilities across various tasks, but their performance on domain-specific tasks remains limited. While methods like retrieval augmented generation and fine-tuning can help to address…

Computation and Language · Computer Science 2024-12-23 M. Mehdi Mojarradi , Lingyi Yang , Robert McCraith , Adam Mahdi

Large language models (LLMs) have been widely explored for embedding generation. While recent studies show that in-context learning (ICL) effectively enhances the representational capability of LLMs by prepending a few task-related…

Computation and Language · Computer Science 2026-05-05 Ailiang Lin , Zhuoyun Li , Keyu Mao , Kotaro Funakoshi , Manabu Okumura

Large Language Models (LLMs) have succeeded considerably in In-Context-Learning (ICL) based summarization. However, saliency is subject to the users' specific preference histories. Hence, we need reliable In-Context Personalization Learning…

Computation and Language · Computer Science 2024-10-02 Divya Patel , Pathik Patel , Ankush Chander , Sourish Dasgupta , Tanmoy Chakraborty

Large language models (LLMs) such as GPT-3 and GPT-4 are powerful but their weights are often publicly unavailable and their immense sizes make the models difficult to be tuned with common hardware. As a result, effectively tuning these…

Computation and Language · Computer Science 2023-05-16 Canwen Xu , Yichong Xu , Shuohang Wang , Yang Liu , Chenguang Zhu , Julian McAuley

Large language models (LLMs) operate in two fundamental learning modes - fine-tuning (FT) and in-context learning (ICL) - raising key questions about which mode yields greater language proficiency and whether they differ in their inductive…

Computation and Language · Computer Science 2026-05-19 Bishwamittra Ghosh , Soumi Das , Till Speicher , Qinyuan Wu , Mohammad Aflah Khan , Deepak Garg , Krishna P. Gummadi , Evimaria Terzi

Large pretrained language models (LLMs) can be rapidly adapted to a wide variety of tasks via a text-to-text approach, where the instruction and input are fed to the model in natural language. Combined with in-context learning (ICL), this…

Computation and Language · Computer Science 2023-12-13 Marc-Etienne Brunet , Ashton Anderson , Richard Zemel

In-context learning (ICL) is now a common method for teaching large language models (LLMs) new tasks: given labeled examples in the input context, the LLM learns to perform the task without weight updates. Do models guided via ICL infer the…

Computation and Language · Computer Science 2024-04-11 Aaron Mueller , Albert Webson , Jackson Petty , Tal Linzen

In-context learning (ICL) is an astonishing emergent ability of large language models (LLMs). By presenting a prompt that includes multiple input-output pairs as examples and introducing a new query input, models can generate the…

Machine Learning · Computer Science 2023-10-06 Timothy Chu , Zhao Song , Chiwun Yang

In-Context Learning (ICL) enables large language models (LLMs) to achieve rapid task adaptation by learning from demonstrations. With the increase in available context length of LLMs, recent experiments have shown that the performance of…

Computation and Language · Computer Science 2024-08-27 Peiwen Yuan , Shaoxiong Feng , Yiwei Li , Xinglin Wang , Yueqi Zhang , Chuyi Tan , Boyuan Pan , Heda Wang , Yao Hu , Kan Li

As model context lengths continue to increase, the number of demonstrations that can be provided in-context approaches the size of entire training datasets. We study the behavior of in-context learning (ICL) at this extreme scale on…

Computation and Language · Computer Science 2025-03-05 Amanda Bertsch , Maor Ivgi , Emily Xiao , Uri Alon , Jonathan Berant , Matthew R. Gormley , Graham Neubig