English
Related papers

Related papers: Mechanism of Task-oriented Information Removal in …

200 papers

Fine-tuning Large Language Models (LLMs) typically involves updating at least a few billions of parameters. A more parameter-efficient approach is Prompt Tuning (PT), which updates only a few learnable tokens, and differently, In-Context…

Computation and Language · Computer Science 2024-10-23 Tsachi Blau , Moshe Kimhi , Yonatan Belinkov , Alexander Bronstein , Chaim Baskin

In-context learning (ICL) is a powerful paradigm emerged from large language models (LLMs). Despite its promises, ICL performance is known to be highly sensitive to input examples. In this work, we use $\textit{in-context influences}$ to…

Computation and Language · Computer Science 2023-06-06 Tai Nguyen , Eric Wong

While many-shot ICL achieves remarkable performance, prior studies of its scaling behavior have mainly focused on non-reasoning tasks. In this work, we study many-shot ICL on reasoning tasks, with a particular focus on many-shot…

Computation and Language · Computer Science 2026-05-29 Tsz Ting Chung , Lemao Liu , Mo Yu , Dit-Yan Yeung

In-context learning (ICL) exhibits dual operating modes: task learning, i.e., acquiring a new skill from in-context samples, and task retrieval, i.e., locating and activating a relevant pretrained skill. Recent theoretical work investigates…

Machine Learning · Computer Science 2024-08-05 Ziqian Lin , Kangwook Lee

We introduce MetaICL (Meta-training for In-Context Learning), a new meta-training framework for few-shot learning where a pretrained language model is tuned to do in-context learning on a large set of training tasks. This meta-training…

Computation and Language · Computer Science 2022-05-04 Sewon Min , Mike Lewis , Luke Zettlemoyer , Hannaneh Hajishirzi

Despite the surprising few-shot performance of in-context learning (ICL), it is still a common practice to randomly sample examples to serve as context. This paper advocates a new principle for ICL: self-adaptive in-context learning. The…

Computation and Language · Computer Science 2023-05-04 Zhiyong Wu , Yaoxiang Wang , Jiacheng Ye , Lingpeng Kong

Large Language Models (LLMs) have demonstrated remarkable abilities, one of the most important being in-context learning (ICL). With ICL, LLMs can derive the underlying rule from a few demonstrations and provide answers that comply with the…

Computation and Language · Computer Science 2025-12-23 Bowen Zheng , Ming Ma , Zhongqiao Lin , Tianming Yang

We study the phenomenon of \textit{in-context learning} (ICL) exhibited by large language models, where they can adapt to a new learning task, given a handful of labeled examples, without any explicit parameter optimization. Our goal is to…

Machine Learning · Computer Science 2023-05-29 Jacob Abernethy , Alekh Agarwal , Teodor V. Marinov , Manfred K. Warmuth

Shortcut learning refers to the phenomenon where models employ simple, non-robust decision rules in practical tasks, which hinders their generalization and robustness. With the rapid development of large language models (LLMs) in recent…

Computation and Language · Computer Science 2024-12-02 Rui Song , Yingji Li , Lida Shi , Fausto Giunchiglia , Hao Xu

Large language models (LLMs) can perform a new task by merely conditioning on task instructions and a few input-output examples, without optimizing any parameters. This is called In-Context Learning (ICL). In-context Information Extraction…

Computation and Language · Computer Science 2025-07-14 Chaoxu Pang , Yixuan Cao , Qiang Ding , Ping Luo

In-context learning (ICL) enables Large Vision-Language Models (LVLMs) to adapt to new tasks without parameter updates, using a few demonstrations from a large support set. However, selecting informative demonstrations leads to high…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Huiyi Chen , Jiawei Peng , Kaihua Tang , Xin Geng , Xu Yang

In this work, we introduce a novel paradigm for generalized In-Context Learning (ICL), termed Indirect In-Context Learning. In Indirect ICL, we explore demonstration selection strategies tailored for two distinct real-world scenarios:…

Machine Learning · Computer Science 2025-10-03 Hadi Askari , Shivanshu Gupta , Terry Tong , Fei Wang , Anshuman Chhabra , Muhao Chen

In-context learning (ICL) refers to a remarkable capability of pretrained large language models, which can learn a new task given a few examples during inference. However, theoretical understanding of ICL is largely under-explored,…

Machine Learning · Computer Science 2024-09-27 Tong Yang , Yu Huang , Yingbin Liang , Yuejie Chi

Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of tasks by understanding input information and predicting corresponding outputs. However, the internal mechanisms by which LLMs comprehend input and…

Computation and Language · Computer Science 2025-01-07 Zhou Yang , Zhengyu Qi , Zhaochun Ren , Zhikai Jia , Haizhou Sun , Xiaofei Zhu , Xiangwen Liao

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

Large Multimodal Models (LMMs) often rely on in-context learning (ICL) to perform new visual question answering (VQA) tasks with minimal supervision. However, ICL performance, especially in smaller LMMs, does not always improve…

Artificial Intelligence · Computer Science 2026-03-03 Akash Gupta , Amos Storkey , Mirella Lapata

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

In-Context Learning (ICL) is an intriguing ability of large language models (LLMs). Despite a substantial amount of work on its behavioral aspects and how it emerges in miniature setups, it remains unclear which mechanism assembles task…

Computation and Language · Computer Science 2025-09-18 Aleksandra Bakalova , Yana Veitsman , Xinting Huang , Michael Hahn

In-context learning (ICL) enables efficient few-shot learning in large language models (LLMs) without training, but suffers from the quadratic input complexity of transformers, limiting the maximum number of exemplars. While various…

Computation and Language · Computer Science 2025-10-10 Shaoyi Zheng , Canyu Zhang , Tianyi Zhou , Shengjie Wang