English
Related papers

Related papers: One Task Vector is not Enough: A Large-Scale Study…

200 papers

Recent advancements in artificial intelligence have led to the creation of highly capable large language models (LLMs) that can perform tasks in a human-like manner. However, LLMs exhibit only infant-level cognitive abilities in certain…

Computation and Language · Computer Science 2024-09-25 Pengrui Han , Peiyang Song , Haofei Yu , Jiaxuan You

In-context learning refers to the emerging ability of large language models (LLMs) to perform a target task without additional training, utilizing demonstrations of the task. Recent studies aim to enhance in-context learning performance by…

Computation and Language · Computer Science 2024-12-02 Junyong Kang , Donghyun Son , Hwanjun Song , Buru Chang

The rapid evolution of wireless communication technologies, particularly massive multiple-input multiple-output (mMIMO) and millimeter-wave (mmWave), introduces significant network complexity and computational demands. Significant research…

Signal Processing · Electrical Eng. & Systems 2026-01-13 Yuxuan Wen , Xiaoming Chen , Maojun Zhang , Zhaohui Yang , Chongwen Huang , Zhaoyang Zhang

In-context learning (ICL) is a cornerstone of large language model (LLM) functionality, yet its theoretical foundations remain elusive due to the complexity of transformer architectures. In particular, most existing work only theoretically…

Machine Learning · Computer Science 2024-09-18 Siyu Chen , Heejune Sheen , Tianhao Wang , Zhuoran Yang

This paper develops a finite-sample statistical theory for in-context learning (ICL), analyzed within a meta-learning framework that accommodates mixtures of diverse task types. We introduce a principled risk decomposition that separates…

Machine Learning · Statistics 2025-12-09 Tomoya Wakayama , Taiji Suzuki

Relation extraction (RE) is an important task that aims to identify the relationships between entities in texts. While large language models (LLMs) have revealed remarkable in-context learning (ICL) capability for general zero and few-shot…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Jiajun Liu , Yikai Guo , Ke Ji , Ziyu Shang , Zijie Xu

In this work, we introduce a novel paradigm for generalized In-Context Learning (ICL), termed Indirect In-Context Learning. In Indirect ICL, we explore demonstration selection strategies tailored for two distinct real-world scenarios:…

Machine Learning · Computer Science 2025-10-03 Hadi Askari , Shivanshu Gupta , Terry Tong , Fei Wang , Anshuman Chhabra , Muhao Chen

In-Context Learning (ICL) has gained prominence due to its ability to perform tasks without requiring extensive training data and its robustness to noisy labels. A typical ICL workflow involves selecting localized examples relevant to a…

Information Retrieval · Computer Science 2025-05-07 Janak Kapuriya , Manit Kaushik , Debasis Ganguly , Sumit Bhatia

In-context learning (ICL), a predominant trend in instruction learning, aims at enhancing the performance of large language models by providing clear task guidance and examples, improving their capability in task understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Cheng Chen , Yunpeng Zhai , Yifan Zhao , Jinyang Gao , Bolin Ding , Jia Li

Despite the advancements in in-context learning (ICL) for large language models (LLMs), current research centers on specific prompt engineering, such as demonstration selection, with the expectation that a single iteration of demonstrations…

Computation and Language · Computer Science 2024-06-05 Jiaxi Yang , Binyuan Hui , Min Yang , Bailin Wang , Bowen Li , Binhua Li , Fei Huang , Yongbin Li

In-context learning (ICL) using large language models for tasks with many labels is challenging due to the limited context window, which makes it difficult to fit a sufficient number of examples in the prompt. In this paper, we use a…

Computation and Language · Computer Science 2023-12-07 Aristides Milios , Siva Reddy , Dzmitry Bahdanau

In-context learning (ICL) improves language models' performance on a variety of NLP tasks by simply demonstrating a handful of examples at inference time. It is not well understood why ICL ability emerges, as the model has never been…

Computation and Language · Computer Science 2023-06-28 Xiaochuang Han , Daniel Simig , Todor Mihaylov , Yulia Tsvetkov , Asli Celikyilmaz , Tianlu Wang

The evolution from Large Language Models (LLMs) to Multimodal Large Language Models (MLLMs) has spurred research into extending In-Context Learning (ICL) to its multimodal counterpart. Existing such studies have primarily concentrated on…

Machine Learning · Computer Science 2024-07-23 Yuchen Zeng , Wonjun Kang , Yicong Chen , Hyung Il Koo , Kangwook Lee

With the increasing ability of large language models (LLMs), in-context learning (ICL) has evolved as a new paradigm for natural language processing (NLP), where instead of fine-tuning the parameters of an LLM specific to a downstream task…

Information Retrieval · Computer Science 2024-05-03 Andrew Parry , Debasis Ganguly , Manish Chandra

Scaling laws have transformed our understanding of large language models by linking upstream metrics like cross-entropy loss to design factors such as model size, training data, and compute. However, these conventional laws fail to capture…

Computation and Language · Computer Science 2025-10-17 Kyle Montgomery , David Park , Jianhong Tu , Michael Bendersky , Beliz Gunel , Dawn Song , Chenguang Wang

Large language models (LLMs) with decoder-only architectures demonstrate remarkable in-context learning (ICL) capabilities. This feature enables them to effectively handle both familiar and novel tasks by utilizing examples provided within…

Information Retrieval · Computer Science 2024-09-25 Chaofan Li , MingHao Qin , Shitao Xiao , Jianlyu Chen , Kun Luo , Yingxia Shao , Defu Lian , Zheng Liu

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attributed a large portion of the success of ICL to the way these…

Computation and Language · Computer Science 2025-10-10 Ioana Marinescu , Kyunghyun Cho , Eric Karl Oermann

In-context Learning (ICL) has emerged as a powerful paradigm for performing natural language tasks with Large Language Models (LLM) without updating the models' parameters, in contrast to the traditional gradient-based finetuning. The…

Computation and Language · Computer Science 2025-08-11 Georgios Chochlakis , Alexandros Potamianos , Kristina Lerman , Shrikanth Narayanan

In-Context Learning (ICL) is an important paradigm for adapting Large Language Models (LLMs) to downstream tasks through a few demonstrations. Despite the great success of ICL, the limitation of the demonstration number may lead to…

Computation and Language · Computer Science 2024-01-10 Caoyun Fan , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

This paper studies in-context learning by decomposing the output of large language models into the individual contributions of attention heads and MLPs (components). We observe curious components: good-performing ones that individually do…

Computation and Language · Computer Science 2024-10-08 Ting-Yun Chang , Jesse Thomason , Robin Jia