English
Related papers

Related papers: Analogist: Out-of-the-box Visual In-Context Learni…

200 papers

Existing continual learning (CL) methods mainly rely on fine-tuning or adapting large language models (LLMs). They still suffer from catastrophic forgetting (CF). Little work has been done to exploit in-context learning (ICL) to leverage…

Computation and Language · Computer Science 2024-12-23 Saleh Momeni , Sahisnu Mazumder , Zixuan Ke , Bing Liu

Implicit in-context learning (ICL) has newly emerged as a promising paradigm that simulates ICL behaviors in the representation space of Large Language Models (LLMs), aiming to attain few-shot performance at zero-shot cost. However,…

Computation and Language · Computer Science 2025-09-30 Jiaqian Li , Yanshu Li , Ligong Han , Ruixiang Tang , Wenya Wang

Vision-based quality assessment in additive manufacturing often requires dedicated machine learning models and application-specific datasets. However, data collection and model training can be expensive and time-consuming. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang

In-context learning (ICL) is an astonishing emergent ability of large language models (LLMs). By presenting a prompt that includes multiple input-output pairs as examples and introducing a new query input, models can generate the…

Machine Learning · Computer Science 2023-10-06 Timothy Chu , Zhao Song , Chiwun Yang

Visual In-Context Learning (VICL) is a prevailing way to transfer visual foundation models to new tasks by leveraging contextual information contained in in-context examples to enhance learning and prediction of query sample. The…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Chengming Xu , Chen Liu , Yikai Wang , Yuan Yao , Yanwei Fu

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

Transformers have a remarkable ability to learn and execute tasks based on examples provided within the input itself, without explicit prior training. It has been argued that this capability, known as in-context learning (ICL), is a…

Machine Learning · Statistics 2025-10-06 Yue M. Lu , Mary I. Letey , Jacob A. Zavatone-Veth , Anindita Maiti , Cengiz Pehlevan

Unpaired Image Captioning (UIC) has been developed to learn image descriptions from unaligned vision-language sample pairs. Existing works usually tackle this task using adversarial learning and visual concept reward based on reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Peipei Zhu , Xiao Wang , Lin Zhu , Zhenglong Sun , Weishi Zheng , Yaowei Wang , Changwen Chen

The capability of in-context learning (ICL) enables large language models (LLMs) to perform novel tasks without parameter updates by conditioning on a few input-output examples. However, collecting high-quality examples for new or…

Artificial Intelligence · Computer Science 2025-10-29 Zihan Chen , Song Wang , Xingbo Fu , Chengshuai Shi , Zhenyu Lei , Cong Shen , Jundong Li

In-context learning (ICL) refers to a remarkable capability of pretrained large language models, which can learn a new task given a few examples during inference. However, theoretical understanding of ICL is largely under-explored,…

Machine Learning · Computer Science 2024-09-27 Tong Yang , Yu Huang , Yingbin Liang , Yuejie Chi

We investigate whether chemical processes can perform in-context learning (ICL), a mode of computation typically associated with transformer architectures. ICL allows a system to infer task-specific rules from a sequence of examples without…

Disordered Systems and Neural Networks · Physics 2026-01-13 Carlos Floyd , Hector Manuel Lopez Rios , Aaron R. Dinner , Suriyanarayanan Vaikuntanathan

In-Context Learning (ICL) enhances the performance of large language models (LLMs) with demonstrations. However, obtaining these demonstrations primarily relies on manual effort. In most real-world scenarios, users are often unwilling or…

Computation and Language · Computer Science 2025-06-02 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bing Qin , Ting Liu

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

Machine Learning · Computer Science 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang

Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shaotian Cai , Liping Qiu , Xiaojun Chen , Qin Zhang , Longteng Chen

In-context learning (ICL) enables large language models (LLMs) to perform downstream tasks through advanced prompting and high-quality demonstrations. However, traditional ICL paradigms encounter significant limitations in complex reasoning…

Computation and Language · Computer Science 2025-06-03 Jinyang Wu , Mingkuan Feng , Shuai Zhang , Feihu Che , Zengqi Wen , Chonghua Liao , Jianhua Tao

We propose Context Diffusion, a diffusion-based framework that enables image generation models to learn from visual examples presented in context. Recent work tackles such in-context learning for image generation, where a query image is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Ivona Najdenkoska , Animesh Sinha , Abhimanyu Dubey , Dhruv Mahajan , Vignesh Ramanathan , Filip Radenovic

Large Multimodal Models (LMMs) often rely on in-context learning (ICL) to perform new visual question answering (VQA) tasks with minimal supervision. However, ICL performance, especially in smaller LMMs, does not always improve…

Artificial Intelligence · Computer Science 2026-03-03 Akash Gupta , Amos Storkey , Mirella Lapata

In this work, we study the problem of Text-to-Image In-Context Learning (T2I-ICL). While Unified Multimodal LLMs (MLLMs) have advanced rapidly in recent years, they struggle with contextual reasoning in T2I-ICL scenarios. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jiaqi Liao , Zhengyuan Yang , Linjie Li , Dianqi Li , Kevin Lin , Yu Cheng , Lijuan Wang

The application of AI in oncology has been limited by its reliance on large, annotated datasets and the need for retraining models for domain-specific diagnostic tasks. Taking heed of these limitations, we investigated in-context learning…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Mobina Shrestha , Bishwas Mandal , Vishal Mandal , Asis Shrestha

In-context learning (ICL) -- the capacity of a model to infer and apply abstract patterns from examples provided within its input -- has been extensively studied in large language models trained for next-token prediction on human text. In…

Machine Learning · Computer Science 2026-03-19 Nathan Breslow , Aayush Mishra , Mahler Revsine , Michael C. Schatz , Anqi Liu , Daniel Khashabi