English
Related papers

Related papers: StaICC: Standardized Evaluation for Classification…

200 papers

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Modern supervised semantic segmentation methods are usually finetuned based on the supervised or self-supervised models pre-trained on ImageNet. Recent work shows that transferring the knowledge from CLIP to semantic segmentation via prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Chaohui Yu , Qiang Zhou , Zhibin Wang , Fan Wang

In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks…

Computation and Language · Computer Science 2024-07-24 Quanyu Long , Yin Wu , Wenya Wang , Sinno Jialin Pan

Prompting and in-context learning (ICL) have become efficient learning paradigms for large language models (LLMs). However, LLMs suffer from prompt brittleness and various bias factors in the prompt, including but not limited to the…

Computation and Language · Computer Science 2024-12-03 Han Zhou , Xingchen Wan , Lev Proleev , Diana Mincu , Jilin Chen , Katherine Heller , Subhrajit Roy

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed a limit on the number of examples that can be shown, making…

Computation and Language · Computer Science 2025-05-29 Jinheon Baek , Sun Jae Lee , Prakhar Gupta , Geunseob Oh , Siddharth Dalmia , Prateek Kolhar

This paper presents the first study on adapting the visual in-context learning (V-ICL) paradigm to optical character recognition tasks, specifically focusing on text removal and segmentation. Most existing V-ICL generalists employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Fei Zhang , Pei Zhang , Baosong Yang , Fei Huang , Yanfeng Wang , Ya Zhang

In-context learning (ICL), which promotes inference with several demonstrations, has become a widespread paradigm to stimulate LLM capabilities for downstream tasks. Due to context length constraints, it cannot be further improved in spite…

Computation and Language · Computer Science 2024-06-04 Jiahao Li , Quan Wang , Licheng Zhang , Guoqing Jin , Zhendong Mao

Universal models for medical image segmentation, such as interactive and in-context learning (ICL) models, offer strong generalization but require extensive annotations. Interactive models need repeated user prompts for each image, while…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jiesi Hu , Yanwu Yang , Zhiyu Ye , Jinyan Zhou , Jianfeng Cao , Hanyang Peng , Ting Ma

We introduce Lifelong ICL, a problem setting that challenges long-context language models (LMs) to learn a sequence of language tasks through in-context learning (ICL). We further introduce Task Haystack, an evaluation suite dedicated to…

Computation and Language · Computer Science 2024-12-04 Xiaoyue Xu , Qinyuan Ye , Xiang Ren

In-context learning (ICL) has emerged as an effective approach to enhance the performance of large language models (LLMs). However, its effectiveness varies significantly across models and tasks, posing challenges for practitioners to…

Computation and Language · Computer Science 2025-07-15 Dingzriui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

Event Causality Identification (ECI) aims at determining the existence of a causal relation between two events. Although recent prompt learning-based approaches have shown promising improvements on the ECI task, their performance are often…

Information Retrieval · Computer Science 2024-09-30 Chao Liang , Wei Xiang , Bang Wang

Advancements in large language models (LLMs) have shown their effectiveness in multiple complicated natural language reasoning tasks. A key challenge remains in adapting these models efficiently to new or unfamiliar tasks. In-context…

Computation and Language · Computer Science 2024-08-02 Siqi Liang , Sumyeong Ahn , Jiayu Zhou

While standard IR models are mainly designed to optimize relevance, real-world search often needs to balance additional objectives such as diversity and fairness. These objectives depend on inter-document interactions and are commonly…

Information Retrieval · Computer Science 2025-05-26 Nilanjan Sinhababu , Andrew Parry , Debasis Ganguly , Pabitra Mitra

In-context learning provides a new perspective for multi-task modeling for vision and NLP. Under this setting, the model can perceive tasks from prompts and accomplish them without any extra task-specific head predictions or model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Xinshun Wang , Zhongbin Fang , Xia Li , Xiangtai Li , Mengyuan Liu

Recent developments in large pre-trained language models have enabled unprecedented performance on a variety of downstream tasks. Achieving best performance with these models often leverages in-context learning, where a model performs a…

Computation and Language · Computer Science 2024-04-17 Alexander Scarlatos , Andrew Lan

Recent work shows that in-context learning and optimization of in-context examples (ICE) can significantly improve the accuracy of large language models (LLMs) on a wide range of tasks, leading to an apparent consensus that ICE optimization…

Computation and Language · Computer Science 2024-06-07 Pragya Srivastava , Satvik Golechha , Amit Deshpande , Amit Sharma

Large Language Models (LLMs) have the impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is…

Computation and Language · Computer Science 2023-10-27 Harvey Yiyun Fu , Qinyuan Ye , Albert Xu , Xiang Ren , Robin Jia

With the development of Vision Foundation Models (VFMs) in recent years, Visual In-Context Learning (VICL) has become a better choice compared to modifying models in most scenarios. Different from retraining or fine-tuning model, VICL does…

Artificial Intelligence · Computer Science 2025-01-16 Yan Zhu , Huan Ma , Changqing Zhang

In-context learning (ICL) is highly sensitive to which demonstrations appear in the prompt, but selecting them is expensive because the space of possible demonstration contexts and combinations is enormous. We argue that demonstration…

Computation and Language · Computer Science 2026-05-19 Haochun Wang , Chaofen Yang , Jiatong Liu , Jingbo Wang , Zewen Qiang , Sendong Zhao , Bing Qin , Ting Liu

In-Context Learning (ICL) has significantly expanded the general-purpose nature of large language models, allowing them to adapt to novel tasks using merely the inputted context. This has motivated a series of papers that analyze tractable…

Machine Learning · Computer Science 2025-05-05 Core Francisco Park , Ekdeep Singh Lubana , Itamar Pres , Hidenori Tanaka