English
Related papers

Related papers: NICE: To Optimize In-Context Examples or Not?

200 papers

In-Context Learning (ICL) enhances the performance of large language models (LLMs) with demonstrations. However, obtaining these demonstrations primarily relies on manual effort. In most real-world scenarios, users are often unwilling or…

Computation and Language · Computer Science 2025-06-02 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bing Qin , Ting Liu

Large Language Models (LLMs) have demonstrated exceptional abilities across a broad range of language-related tasks, including generating solutions to complex reasoning problems. An effective technique to enhance LLM performance is…

Computation and Language · Computer Science 2024-12-25 Shuzhang Cai , Twumasi Mensah-Boateng , Xander Kuksov , Jing Yuan , Shaojie Tang

Large Language Models (LLMs) have proven effective at In-Context Learning (ICL), an ability that allows them to create predictors from labeled examples. Few studies have explored the interplay between ICL and specific properties of…

Machine Learning · Computer Science 2023-11-23 David Oniani , Yanshan Wang

The predictions of Large Language Models (LLMs) on downstream tasks often improve significantly when including examples of the input--label relationship in the context. However, there is currently no consensus about how this in-context…

Computation and Language · Computer Science 2024-03-14 Jannik Kossen , Yarin Gal , Tom Rainforth

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Large language models (LLMs) can use in-context demonstrations to improve performance on zero-shot tasks. However, selecting the best in-context examples is challenging because model performance can vary widely depending on the selected…

Computation and Language · Computer Science 2023-11-29 Dan Iter , Reid Pryzant , Ruochen Xu , Shuohang Wang , Yang Liu , Yichong Xu , Chenguang Zhu

Large language models (LLMs) can adapt to new tasks through in-context learning (ICL) based on a few examples presented in dialogue history without any model parameter update. Despite such convenience, the performance of ICL heavily depends…

Computation and Language · Computer Science 2024-06-18 Siyin Wang , Chao-Han Huck Yang , Ji Wu , Chao Zhang

Large-scale models trained on broad data have recently become the mainstream architecture in computer vision due to their strong generalization performance. In this paper, the main focus is on an emergent ability in large vision models,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Yuanhan Zhang , Kaiyang Zhou , Ziwei Liu

Preference-based reinforcement learning is an effective way to handle tasks where rewards are hard to specify but can be exceedingly inefficient as preference learning is often tabula rasa. We demonstrate that Large Language Models (LLMs)…

Artificial Intelligence · Computer Science 2025-04-04 Chao Yu , Qixin Tan , Hong Lu , Jiaxuan Gao , Xinting Yang , Yu Wang , Yi Wu , Eugene Vinitsky

In this paper, we introduce the Interpretable Cross-Examination Technique (ICE-T), a novel approach that leverages structured multi-prompt techniques with Large Language Models (LLMs) to improve classification performance over zero-shot and…

Computation and Language · Computer Science 2024-05-14 Goran Muric , Ben Delay , Steven Minton

While standard IR models are mainly designed to optimize relevance, real-world search often needs to balance additional objectives such as diversity and fairness. These objectives depend on inter-document interactions and are commonly…

Information Retrieval · Computer Science 2025-05-26 Nilanjan Sinhababu , Andrew Parry , Debasis Ganguly , Pabitra Mitra

In-context learning can help Large Language Models (LLMs) to adapt new tasks without additional training. However, this performance heavily depends on the quality of the demonstrations, driving research into effective demonstration…

Computation and Language · Computer Science 2024-10-31 Dong Shu , Mengnan Du

There has been increasing interest in exploring the capabilities of advanced large language models (LLMs) in the field of information extraction (IE), specifically focusing on tasks related to named entity recognition (NER) and relation…

Computation and Language · Computer Science 2024-06-25 Ying Mo , Jiahao Liu , Jian Yang , Qifan Wang , Shun Zhang , Jingang Wang , Zhoujun Li

In-Context Learning (ICL) is an emergent capability of Large Language Models (LLMs). Only a few demonstrations enable LLMs to be used as blackbox for new tasks. Previous studies have shown that using LLMs' outputs as labels is effective in…

Computation and Language · Computer Science 2024-04-04 Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Relation extraction (RE) is an important task that aims to identify the relationships between entities in texts. While large language models (LLMs) have revealed remarkable in-context learning (ICL) capability for general zero and few-shot…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Jiajun Liu , Yikai Guo , Ke Ji , Ziyu Shang , Zijie Xu

In-context learning (ICL) is the trending prompting strategy in the era of large language models (LLMs), where a few examples are demonstrated to evoke LLMs' power for a given task. How to select informative examples remains an open issue.…

Computation and Language · Computer Science 2024-05-30 Chenming Tang , Zhixiang Wang , Yunfang Wu

In-context learning (ICL) performs tasks by prompting a large language model (LLM) using an instruction and a small set of annotated examples called demonstrations. Recent work has shown that precise details of the inputs used in the ICL…

Computation and Language · Computer Science 2023-07-18 Anirudh Ajith , Chris Pan , Mengzhou Xia , Ameet Deshpande , Karthik Narasimhan

The remarkable capability of large language models (LLMs) for in-context learning (ICL) needs to be activated by demonstration examples. Prior work has extensively explored the selection of examples for ICL, predominantly following the…

Computation and Language · Computer Science 2024-06-07 Haoyu Liu , Jianfeng Liu , Shaohan Huang , Yuefeng Zhan , Hao Sun , Weiwei Deng , Furu Wei , Qi Zhang

Large language models (LLMs) enable in-context learning (ICL) by conditioning on a few labeled training examples as a text-based prompt, eliminating the need for parameter updates and achieving competitive performance. In this paper, we…

Computation and Language · Computer Science 2024-04-02 Jianing Wang , Chengyu Wang , Chuanqi Tan , Jun Huang , Ming Gao

Large language models (LLMs) have demonstrated remarkable proficiency in in-context learning (ICL), where models adapt to new tasks through example-based prompts without requiring parameter updates. However, understanding how tasks are…

Computation and Language · Computer Science 2025-11-11 Baturay Saglam , Xinyang Hu , Zhuoran Yang , Dionysis Kalogerias , Amin Karbasi