English
Related papers

Related papers: Many-Shot In-Context Learning in Multimodal Founda…

200 papers

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed a limit on the number of examples that can be shown, making…

Computation and Language · Computer Science 2025-05-29 Jinheon Baek , Sun Jae Lee , Prakhar Gupta , Geunseob Oh , Siddharth Dalmia , Prateek Kolhar

While many-shot ICL achieves remarkable performance, prior studies of its scaling behavior have mainly focused on non-reasoning tasks. In this work, we study many-shot ICL on reasoning tasks, with a particular focus on many-shot…

Computation and Language · Computer Science 2026-05-29 Tsz Ting Chung , Lemao Liu , Mo Yu , Dit-Yan Yeung

Building machine translation (MT) systems for low-resource languages is notably difficult due to the scarcity of high-quality data. Although Large Language Models (LLMs) have improved MT system performance, adapting them to…

Computation and Language · Computer Science 2026-02-05 Luis Frentzen Salim , Esteban Carlin , Alexandre Morinvil , Xi Ai , Lun-Wei Ku

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

Machine Learning · Computer Science 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio

The emergence of Large Language Models (LLMs) and multimodal foundation models (FMs) has generated heightened interest in their applications that integrate vision and language. This paper investigates the capabilities of ChatGPT-4V and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Zhenyuan Yang , Xuhui Lin , Qinyi He , Ziye Huang , Zhengliang Liu , Hanqi Jiang , Peng Shu , Zihao Wu , Yiwei Li , Stephen Law , Gengchen Mai , Tianming Liu , Tao Yang

Large Language Models (LLMs) operating in 0-shot or few-shot settings achieve competitive results in Text Classification tasks. In-Context Learning (ICL) typically achieves better accuracy than the 0-shot setting, but it pays in terms of…

Computation and Language · Computer Science 2024-04-04 Parth Patwa , Simone Filice , Zhiyu Chen , Giuseppe Castellucci , Oleg Rokhlenko , Shervin Malmasi

In-context learning (ICL) has proven to be an effective strategy for improving the performance of large language models (LLMs) with no additional training. However, the exact mechanism behind this performance improvement remains unclear.…

Computation and Language · Computer Science 2025-04-07 Shahriar Golchin , Mihai Surdeanu , Steven Bethard , Eduardo Blanco , Ellen Riloff

Large Language Models (LLMs) have proven effective at In-Context Learning (ICL), an ability that allows them to create predictors from labeled examples. Few studies have explored the interplay between ICL and specific properties of…

Machine Learning · Computer Science 2023-11-23 David Oniani , Yanshan Wang

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Vision-Language Models (VLMs) have rapidly advanced alongside Large Language Models (LLMs). This study evaluates the capabilities of prominent generative VLMs, such as GPT-4.1 and Gemini 2.5 Pro, accessed via APIs, for histopathology image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Samarth Singhal , Sandeep Singhal

In-context Learning (ICL) is the ability of Large Language Models (LLMs) to perform new tasks when conditioned on prompts comprising a few task examples. However, ICL performance can be critically sensitive to the choice of examples. To…

Computation and Language · Computer Science 2024-02-23 Shivanshu Gupta , Clemens Rosenbaum , Ethan R. Elenberg

In-context learning (ICL) refers to the process of adding a small number of localized examples from a training set of labelled data to an LLM's prompt with an objective to effectively control the generative process seeking to improve the…

Computation and Language · Computer Science 2025-01-22 Manish Chandra , Debasis Ganguly , Iadh Ounis

The ability to recognize patterns from examples and apply them to new ones is a primal ability for general intelligence, and is widely studied by psychology and AI researchers. Many benchmarks have been proposed to measure such ability for…

Artificial Intelligence · Computer Science 2025-10-24 Kai Yan , Zhan Ling , Kang Liu , Yifan Yang , Ting-Han Fan , Lingfeng Shen , Zhengyin Du , Jiecao Chen

In-context Learning enables training-free adaptation via demonstrations but remains highly sensitive to example selection and formatting. In unified multimodal models spanning understanding and generation, this sensitivity is exacerbated by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yicheng Xu , Jiangning Zhang , Zhucun Xue , Teng Hu , Ran Yi , Xiaobin Hu , Yong Liu , Dacheng Tao

Recent studies indicate that large multimodal models (LMMs) potentially act as general-purpose assistants and are highly robust against different distributions. Despite this, domain-specific adaptation is still necessary particularly in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Guanglin Zhou , Zhongyi Han , Shiming Chen , Biwei Huang , Liming Zhu , Salman Khan , Xin Gao , Lina Yao

We introduce a few-shot benchmark consisting of 7 different classification tasks native to the Polish language. We conducted an empirical comparison with 0 and 16 shots between fine-tuning, linear probing, SetFit, and in-context learning…

Computation and Language · Computer Science 2024-04-30 Tsimur Hadeliya , Dariusz Kajtoch

Emotion recognition capabilities in multimodal AI systems are crucial for developing culturally responsive educational technologies, yet remain underexplored for Arabic language contexts where culturally appropriate learning tools are…

Computation and Language · Computer Science 2025-09-05 Bushra Asseri , Estabraq Abdelaziz , Maha Al Mogren , Tayef Alhefdhi , Areej Al-Wabil

In-Context Learning (ICL) empowers Large Language Models (LLMs) to tackle diverse tasks by incorporating multiple input-output examples, known as demonstrations, into the input of LLMs. More recently, advancements in the expanded context…

Artificial Intelligence · Computer Science 2025-05-27 Zihan Chen , Song Wang , Zhen Tan , Jundong Li , Cong Shen

Large language models (LLMs) possess broad world knowledge and strong general-purpose reasoning ability, yet they struggle to learn from many in-context examples on standard machine learning (ML) tasks, that is, to leverage many-shot…

Computation and Language · Computer Science 2026-04-14 Haoyu Dong , Pengkun Zhang , Mingzhe Lu , Yanzhen Shen , Guolin Ke

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan