English
Related papers

Related papers: C-ICL: Contrastive In-context Learning for Informa…

200 papers

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

Computation and Language · Computer Science 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi

With the increasing capabilities of large language models (LLMs), in-context learning (ICL) has emerged as a new paradigm for natural language processing (NLP), where LLMs make predictions based on contexts augmented with a few examples. It…

Computation and Language · Computer Science 2024-10-08 Qingxiu Dong , Lei Li , Damai Dai , Ce Zheng , Jingyuan Ma , Rui Li , Heming Xia , Jingjing Xu , Zhiyong Wu , Tianyu Liu , Baobao Chang , Xu Sun , Lei Li , Zhifang Sui

In-context learning (ICL) achieves remarkable performance in various domains such as knowledge acquisition, commonsense reasoning, and semantic understanding. However, its performance significantly deteriorates for emotion detection tasks,…

Machine Learning · Computer Science 2025-10-13 Zhaochun Ren , Zhou Yang , Chenglong Ye , Yufeng Wang , Haizhou Sun , Chao Chen , Xiaofei Zhu , Yunbing Wu , Xiangwen Liao

Large Language models (LLMs) have achieved encouraging results in tabular data generation. However, existing approaches require fine-tuning, which is computationally expensive. This paper explores an alternative: prompting a fixed LLM with…

Machine Learning · Computer Science 2025-02-25 Liancheng Fang , Aiwei Liu , Hengrui Zhang , Henry Peng Zou , Weizhi Zhang , Philip S. Yu

In-context learning (ICL) improves language models' performance on a variety of NLP tasks by simply demonstrating a handful of examples at inference time. It is not well understood why ICL ability emerges, as the model has never been…

Computation and Language · Computer Science 2023-06-28 Xiaochuang Han , Daniel Simig , Todor Mihaylov , Yulia Tsvetkov , Asli Celikyilmaz , Tianlu Wang

The extraction of lung lesion information from clinical and medical imaging reports is crucial for research on and clinical care of lung-related diseases. Large language models (LLMs) can be effective at interpreting unstructured text in…

Computation and Language · Computer Science 2024-11-18 Diya Li , Asim Kadav , Aijing Gao , Rui Li , Richard Bourgon

The linguistic capabilities of Multimodal Large Language Models (MLLMs) are critical for their effective application across diverse tasks. This study aims to evaluate the performance of MLLMs on the VALSE benchmark, focusing on the efficacy…

Computation and Language · Computer Science 2024-07-18 Mustafa Dogan , Ilker Kesen , Iacer Calixto , Aykut Erdem , Erkut Erdem

Large language models (LLMs) have enabled a wide variety of real-world applications in various domains. However, creating a high-performing application with high accuracy remains challenging, particularly for subjective tasks like emotion…

Computation and Language · Computer Science 2025-07-01 Mengqi Wang , Tiantian Feng , Shrikanth Narayanan

Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question answering. Previous…

Computation and Language · Computer Science 2023-06-08 Zixian Huang , Jiaying Zhou , Gengyang Xiao , Gong Cheng

Large Language Models (LLMs) have recently demonstrated impressive few-shot learning capabilities through in-context learning (ICL). However, ICL performance is highly dependent on the choice of few-shot demonstrations, making the selection…

Computation and Language · Computer Science 2025-06-03 Soumya Suvra Ghosal , Soumyabrata Pal , Koyel Mukherjee , Dinesh Manocha

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

Computation and Language · Computer Science 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

In-context learning (ICL) is one of the most powerful and most unexpected capabilities to emerge in recent transformer-based large language models (LLMs). Yet the mechanisms that underlie it are poorly understood. In this paper, we…

In-context learning (ICL), which promotes inference with several demonstrations, has become a widespread paradigm to stimulate LLM capabilities for downstream tasks. Due to context length constraints, it cannot be further improved in spite…

Computation and Language · Computer Science 2024-06-04 Jiahao Li , Quan Wang , Licheng Zhang , Guoqing Jin , Zhendong Mao

Advancements in large language models (LLMs) have shown their effectiveness in multiple complicated natural language reasoning tasks. A key challenge remains in adapting these models efficiently to new or unfamiliar tasks. In-context…

Computation and Language · Computer Science 2024-08-02 Siqi Liang , Sumyeong Ahn , Jiayu Zhou

Vision-Language Models (VLMs) have shown remarkable capabilities in a large number of downstream tasks. Nonetheless, compositional image understanding remains a rather difficult task due to the object bias present in training data. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Matteo Nulli , Anesa Ibrahimi , Avik Pal , Hoshe Lee , Ivona Najdenkoska

This paper proposes a personalization method for speech emotion recognition (SER) through in-context learning (ICL). Since the expression of emotions varies from person to person, speaker-specific adaptation is crucial for improving the SER…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Mana Ihori , Taiga Yamane , Naotaka Kawata , Naoki Makishima , Tomohiro Tanaka , Satoshi Suzuki , Shota Orihashi , Ryo Masumura

Can in-context learning (ICL) override pre-trained label semantics, or does it merely refine an existing semantic backbone? We address this question by treating LLMs as prompt-induced classifiers and contrasting their behavior under…

Computation and Language · Computer Science 2025-11-27 Anantha Padmanaban Krishna Kumar

Large vision-language models (LVLMs) employ multi-modal in-context learning (MM-ICL) to adapt to new tasks by leveraging demonstration examples. While increasing the number of demonstrations boosts performance, they incur significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Shin'ya Yamaguchi , Daiki Chijiwa , Tamao Sakao , Taku Hasegawa

In-context learning (ICL) enables large language models (LLMs) to perform new tasks by prompting them with a sequence of training examples. However, it is known that ICL is very sensitive to the choice of training examples: randomly…

Computation and Language · Computer Science 2023-09-13 Ting-Yun Chang , Robin Jia

Large Language Models (LLMs) have proven effective at In-Context Learning (ICL), an ability that allows them to create predictors from labeled examples. Few studies have explored the interplay between ICL and specific properties of…

Machine Learning · Computer Science 2023-11-23 David Oniani , Yanshan Wang