English
Related papers

Related papers: Towards Global Optimal Visual In-Context Learning …

200 papers

Large-scale models trained on broad data have recently become the mainstream architecture in computer vision due to their strong generalization performance. In this paper, the main focus is on an emergent ability in large vision models,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Yuanhan Zhang , Kaiyang Zhou , Ziwei Liu

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Visual In-Context Learning (ICL) has emerged as a promising research area due to its capability to accomplish various tasks with limited example pairs through analogical reasoning. However, training-based visual ICL has limitations in its…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zheng Gu , Shiyuan Yang , Jing Liao , Jing Huo , Yang Gao

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks during inference using only a few demonstrations. However, ICL performance is highly dependent on the selection of these demonstrations. Recent work…

Machine Learning · Computer Science 2025-05-27 Zheng Zhang , Shaocheng Lan , Lei Song , Jiang Bian , Yexin Li , Kan Ren

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

Computation and Language · Computer Science 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

Visual In-Context Learning (VICL) aims to complete vision tasks by imitating pixel demonstrations. Recent work pioneered prompt fusion that combines the advantages of various demonstrations, which shows a promising way to extend VICL.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Tianci Luo , Jinpeng Wang , Shiyu Qin , Niu Lian , Yan Feng , Bin Chen , Chun Yuan , Shu-Tao Xia

Large-scale models trained on extensive datasets, have emerged as the preferred approach due to their high generalizability across various tasks. In-context learning (ICL), a popular strategy in natural language processing, uses such models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Jiahao Zhang , Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

Replicating In-Context Learning (ICL) in computer vision remains challenging due to task heterogeneity. We propose \textbf{VIRAL}, a framework that elicits visual reasoning from a pre-trained image editing model by formulating ICL as…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zhiwen Li , Zhongjie Duan , Jinyan Ye , Cen Chen , Daoyuan Chen , Yaliang Li , Yingda Chen

This paper presents the first study on adapting the visual in-context learning (V-ICL) paradigm to optical character recognition tasks, specifically focusing on text removal and segmentation. Most existing V-ICL generalists employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Fei Zhang , Pei Zhang , Baosong Yang , Fei Huang , Yanfeng Wang , Ya Zhang

In-Context Learning (ICL) has gained prominence due to its ability to perform tasks without requiring extensive training data and its robustness to noisy labels. A typical ICL workflow involves selecting localized examples relevant to a…

Information Retrieval · Computer Science 2025-05-07 Janak Kapuriya , Manit Kaushik , Debasis Ganguly , Sumit Bhatia

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

Computation and Language · Computer Science 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

In-context learning (ICL) enables large language models to perform new tasks by conditioning on a sequence of examples. Most prior work reasonably and intuitively assumes that which examples are chosen has a far greater effect on…

Computation and Language · Computer Science 2025-11-14 Warren Li , Yiqian Wang , Zihan Wang , Jingbo Shang

In-Context Learning (ICL) has emerged as a pivotal capability of auto-regressive large language models, yet it is hindered by a notable sensitivity to the ordering of context examples regardless of their mutual independence. To address this…

Computation and Language · Computer Science 2025-05-09 Lizhe Fang , Yifei Wang , Khashayar Gatmiry , Lei Fang , Yisen Wang

In-context learning, where pre-trained language models learn to perform tasks from task examples and instructions in their contexts, has attracted much attention in the NLP community. However, the ability of in-context learning is not fully…

Computation and Language · Computer Science 2023-05-17 Yuxian Gu , Li Dong , Furu Wei , Minlie Huang

The remarkable capability of large language models (LLMs) for in-context learning (ICL) needs to be activated by demonstration examples. Prior work has extensively explored the selection of examples for ICL, predominantly following the…

Computation and Language · Computer Science 2024-06-07 Haoyu Liu , Jianfeng Liu , Shaohan Huang , Yuefeng Zhan , Hao Sun , Weiwei Deng , Furu Wei , Qi Zhang

Most recent self-supervised methods for learning image representations focus on either producing a global feature with invariance properties, or producing a set of local features. The former works best for classification tasks while the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Adrien Bardes , Jean Ponce , Yann LeCun

Recent advancements in language models have demonstrated remarkable in-context learning abilities, prompting the exploration of in-context reinforcement learning (ICRL) to extend the promise to decision domains. Due to involving more…

Artificial Intelligence · Computer Science 2026-02-09 Jinmei Liu , Fuhong Liu , Zhenhong Sun , Jianye Hao , Huaxiong Li , Bo Wang , Daoyi Dong , Chunlin Chen , Zhi Wang

Large pretrained language models (LMs) have shown impressive In-Context Learning (ICL) ability, where the model learns to do an unseen task via a prompt consisting of input-output examples as the demonstration, without any parameter…

Computation and Language · Computer Science 2023-06-21 Jiacheng Ye , Zhiyong Wu , Jiangtao Feng , Tao Yu , Lingpeng Kong

With the increasing ability of large language models (LLMs), in-context learning (ICL) has evolved as a new paradigm for natural language processing (NLP), where instead of fine-tuning the parameters of an LLM specific to a downstream task…

Information Retrieval · Computer Science 2024-05-03 Andrew Parry , Debasis Ganguly , Manish Chandra

Vision-language models (VLMs) have achieved impressive performance across a wide range of multimodal reasoning tasks, but they often struggle to disentangle fine-grained visual attributes and reason about underlying causal relationships.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Guangzhi Xiong , Sanchit Sinha , Zhenghao He , Aidong Zhang