English
Related papers

Related papers: Link-Context Learning for Multimodal LLMs

200 papers

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

Despite the rapid recent progress in creating accurate and compact in-context learners, most recent work focuses on in-context learning (ICL) for tasks in English. However, the ability to interact with users of languages outside English…

Computation and Language · Computer Science 2023-04-05 Michal Štefánik , Marek Kadlčík , Piotr Gramacki , Petr Sojka

In-Context Learning (ICL) has significantly expanded the general-purpose nature of large language models, allowing them to adapt to novel tasks using merely the inputted context. This has motivated a series of papers that analyze tractable…

Machine Learning · Computer Science 2025-05-05 Core Francisco Park , Ekdeep Singh Lubana , Itamar Pres , Hidenori Tanaka

In-context learning (ICL) is a powerful technique for getting language models to perform complex tasks with no training updates. Prior work has established strong correlations between the number of in-context examples provided and the…

Computation and Language · Computer Science 2025-09-23 Aryaman Arora , Dan Jurafsky , Christopher Potts , Noah D. Goodman

The remarkable capability of large language models (LLMs) for in-context learning (ICL) needs to be activated by demonstration examples. Prior work has extensively explored the selection of examples for ICL, predominantly following the…

Computation and Language · Computer Science 2024-06-07 Haoyu Liu , Jianfeng Liu , Shaohan Huang , Yuefeng Zhan , Hao Sun , Weiwei Deng , Furu Wei , Qi Zhang

In-context learning (ICL) allows large language models (LLMs) to adapt to new tasks from a few examples, making it promising for languages underrepresented in pre-training. Recent work on many-shot ICL suggests that modern LLMs can further…

Computation and Language · Computer Science 2026-04-07 Yinhan Lu , Gaganpreet Jhajj , Chen Zhang , Anietie Andy , David Ifeoluwa Adelani

Advancements in large language models (LLMs) have shown their effectiveness in multiple complicated natural language reasoning tasks. A key challenge remains in adapting these models efficiently to new or unfamiliar tasks. In-context…

Computation and Language · Computer Science 2024-08-02 Siqi Liang , Sumyeong Ahn , Jiayu Zhou

In-context learning (ICL) has emerged as an effective solution for few-shot learning with large language models (LLMs). However, how LLMs leverage demonstrations to specify a task and learn a corresponding computational function through ICL…

Computation and Language · Computer Science 2025-11-17 Yu Bai , Heyan Huang , Cesare Spinoso-Di Piano , Marc-Antoine Rondeau , Sanxing Chen , Yang Gao , Jackie Chi Kit Cheung

Large language models (LLMs) excel at a range of tasks through in-context learning (ICL), where only a few task examples guide their predictions. However, prior research highlights that LLMs often overlook input-label mapping information in…

Computation and Language · Computer Science 2025-06-10 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Yancheng Yuan , Dacheng Tao

The remarkable ability of transformers to learn new concepts solely by reading examples within the input prompt, termed in-context learning (ICL), is a crucial aspect of intelligent behavior. Here, we focus on understanding the learning…

Machine Learning · Computer Science 2025-10-14 Sara Dragutinović , Andrew M. Saxe , Aaditya K. Singh

Can in-context learning (ICL) override pre-trained label semantics, or does it merely refine an existing semantic backbone? We address this question by treating LLMs as prompt-induced classifiers and contrasting their behavior under…

Computation and Language · Computer Science 2025-11-27 Anantha Padmanaban Krishna Kumar

In-Context Learning (ICL) is a significant paradigm for Large Multimodal Models (LMMs), using a few in-context demonstrations (ICDs) for new task adaptation. However, its performance is sensitive to demonstration configurations and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Xiaoyu Li , Yuhang Liu , Xuanshuo Kang , Zheng Luo , Fangqi Lou , Xiaohua Wu , Zihan Xiong

Despite the growing video understanding capabilities of recent Multimodal Large Language Models (MLLMs), existing video benchmarks primarily assess understanding based on models' static, internal knowledge, rather than their ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yuhao Dong , Shulin Tian , Shuai Liu , Shuangrui Ding , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Jiaqi Wang , Ziwei Liu

In-context learning refers to the emerging ability of large language models (LLMs) to perform a target task without additional training, utilizing demonstrations of the task. Recent studies aim to enhance in-context learning performance by…

Computation and Language · Computer Science 2024-12-02 Junyong Kang , Donghyun Son , Hwanjun Song , Buru Chang

In-context learning (ICL) enables large language models (LLMs) to perform new tasks using only a few demonstrations. However, in Named Entity Recognition (NER), existing ICL methods typically rely on task-agnostic semantic similarity for…

Computation and Language · Computer Science 2025-10-30 Fan Bai , Hamid Hassanzadeh , Ardavan Saeedi , Mark Dredze

Rapid and accurate situational awareness is essential for effective response during natural disasters, where delays in analysis can significantly hinder decision-making. Training task-specific models for post-disaster assessment is often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Armin Zarbaft , Ehsan Karimi , Nhut Le , Maryam Rahnemoonfar

In recent years, the rise of large language models (LLMs) has made it possible to directly achieve named entity recognition (NER) without any demonstration samples or only using a few samples through in-context learning (ICL). However,…

Computation and Language · Computer Science 2024-06-18 Guochao Jiang , Zepeng Ding , Yuchen Shi , Deqing Yang

In-Context Learning (ICL) in Large Language Models (LLM) has emerged as the dominant technique for performing natural language tasks, as it does not require updating the model parameters with gradient-based methods. ICL promises to "adapt"…

Computation and Language · Computer Science 2025-03-05 Georgios Chochlakis , Niyantha Maruthu Pandiyan , Kristina Lerman , Shrikanth Narayanan

Large Language Models (LLMs) have demonstrated remarkable proficiency across diverse tasks, exhibiting emergent properties such as semantic prompt comprehension, In-Context Learning (ICL), and Chain-of-Thought (CoT) reasoning. Despite their…

Computation and Language · Computer Science 2026-03-13 Yuling Jiao , Yanming Lai , Huazhen Lin , Wensen Ma , Houduo Qi , Defeng Sun

Large language models (LLMs) have shown impressive in-context learning (ICL) ability in code generation. LLMs take a prompt consisting of requirement-code examples and a new requirement as input, and output new programs. Existing studies…

Software Engineering · Computer Science 2023-10-17 Jia Li , Ge Li , Chongyang Tao , Jia Li , Huangzhao Zhang , Fang Liu , Zhi Jin