English
Related papers

Related papers: Incomplete In-context Learning

200 papers

In multiple instance multiple label learning, each sample, a bag, consists of multiple instances. To alleviate labeling complexity, each sample is associated with a set of bag-level labels leaving instances within the bag unlabeled. This…

Machine Learning · Computer Science 2021-07-28 Tam Nguyen , Raviv Raich

Generative Large Language Models (LLMs) are capable of being in-context learners. However, the underlying mechanism of in-context learning (ICL) is still a major research question, and experimental research results about how models exploit…

Computation and Language · Computer Science 2025-02-11 Aliakbar Nafar , Kristen Brent Venable , Parisa Kordjamshidi

Large language models (LLMs) famously exhibit emergent in-context learning (ICL) -- the ability to rapidly adapt to new tasks using few-shot examples provided as a prompt, without updating the model's weights. Built on top of LLMs, vision…

Machine Learning · Computer Science 2025-04-02 Yongshuo Zong , Ondrej Bohdal , Timothy Hospedales

Instance-level recognition (ILR) concerns distinguishing individual instances from one another, with person re-identification as a prominent example. Despite the impressive visual perception capabilities of modern VLMs, we find their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Liang Shi , Wei Li , Kevin M Beussman , Lin Chen , Yun Fu

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

Computation and Language · Computer Science 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

As language models continue to scale, Large Language Models (LLMs) have exhibited emerging capabilities in In-Context Learning (ICL), enabling them to solve language tasks by prefixing a few in-context demonstrations (ICDs) as context.…

Computation and Language · Computer Science 2024-11-01 Yingzhe Peng , Chenduo Hao , Xu Yang , Jiawei Peng , Xinting Hu , Xin Geng

Multimodal in-context learning (ICL) has emerged as a key capability of Large Vision-Language Models (LVLMs), driven by their increasing scale and applicability. Despite its promise, effective ICL in the multimodal setting remains…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yanshu Li

Vision-based quality assessment in additive manufacturing often requires dedicated machine learning models and application-specific datasets. However, data collection and model training can be expensive and time-consuming. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

Computation and Language · Computer Science 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

Computation and Language · Computer Science 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

In-context learning (ICL), a predominant trend in instruction learning, aims at enhancing the performance of large language models by providing clear task guidance and examples, improving their capability in task understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Cheng Chen , Yunpeng Zhai , Yifan Zhao , Jinyang Gao , Bolin Ding , Jia Li

In-context learning (ICL) has emerged as a powerful capability for large language models (LLMs) to adapt to downstream tasks by leveraging a few (demonstration) examples. Despite its effectiveness, the mechanism behind ICL remains…

Machine Learning · Computer Science 2025-06-03 Pengfei He , Yingqian Cui , Han Xu , Hui Liu , Makoto Yamada , Jiliang Tang , Yue Xing

Language models, especially pre-trained large language models, have showcased remarkable abilities as few-shot in-context learners (ICL), adept at adapting to new tasks with just a few demonstrations in the input context. However, the…

Computation and Language · Computer Science 2024-03-26 Man Luo , Xin Xu , Yue Liu , Panupong Pasupat , Mehran Kazemi

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

In-context learning (ICL) ability has emerged with the increasing scale of large language models (LLMs), enabling them to learn input-label mappings from demonstrations and perform well on downstream tasks. However, under the standard ICL…

Computation and Language · Computer Science 2024-04-19 Yifan Wang , Qingyan Guo , Xinzhe Ni , Chufan Shi , Lemao Liu , Haiyun Jiang , Yujiu Yang

Despite the surprising few-shot performance of in-context learning (ICL), it is still a common practice to randomly sample examples to serve as context. This paper advocates a new principle for ICL: self-adaptive in-context learning. The…

Computation and Language · Computer Science 2023-05-04 Zhiyong Wu , Yaoxiang Wang , Jiacheng Ye , Lingpeng Kong

In-Context Learning (ICL) empowers Large Language Models (LLMs) with the ability to learn from a few examples provided in the prompt, enabling downstream generalization without the requirement for gradient updates. Despite encouragingly…

Computation and Language · Computer Science 2025-01-28 Haitao Mao , Guangliang Liu , Yao Ma , Rongrong Wang , Kristen Johnson , Jiliang Tang

Visual In-Context Learning (VICL) has emerged as a prominent approach for adapting visual foundation models to novel tasks, by effectively exploiting contextual information embedded in in-context examples, which can be formulated as a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Wenxiao Wu , Jing-Hao Xue , Chengming Xu , Chen Liu , Xinwei Sun , Changxin Gao , Nong Sang , Yanwei Fu

Visual in-context learning (VICL) enables visual foundation models to handle multiple tasks by steering them with demonstrative prompts. The choice of such prompts largely influences VICL performance, standing out as a key challenge. Prior…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Tianci Luo , Haohao Pan , Jinpeng Wang , Niu Lian , Xinrui Chen , Bin Chen , Shu-Tao Xia , Chun Yuan

In-context learning (ICL) has been instrumental in adapting Large Language Models (LLMs) to downstream tasks using correct input-output examples. Recent advances have attempted to improve model performance through principles derived from…

Computation and Language · Computer Science 2026-05-26 Hao Sun , Yong Jiang , Bo Wang , Yingyan Hou , Yan Zhang , Pengjun Xie , Fei Huang