中文
相关论文

相关论文: SCOI: Syntax-augmented Coverage-based In-context E…

200 篇论文

In-Context Learning (ICL) enhances the performance of large language models (LLMs) with demonstrations. However, obtaining these demonstrations primarily relies on manual effort. In most real-world scenarios, users are often unwilling or…

计算与语言 · 计算机科学 2025-06-02 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bing Qin , Ting Liu

Large language models (LLMs) can adapt to new tasks through in-context learning (ICL) based on a few examples presented in dialogue history without any model parameter update. Despite such convenience, the performance of ICL heavily depends…

计算与语言 · 计算机科学 2024-06-18 Siyin Wang , Chao-Han Huck Yang , Ji Wu , Chao Zhang

In-context learning (ICL) is now a common method for teaching large language models (LLMs) new tasks: given labeled examples in the input context, the LLM learns to perform the task without weight updates. Do models guided via ICL infer the…

计算与语言 · 计算机科学 2024-04-11 Aaron Mueller , Albert Webson , Jackson Petty , Tal Linzen

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

机器学习 · 计算机科学 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang

In-context learning (ICL) has emerged as a powerful paradigm for adapting large language models (LLMs) to new and data-scarce tasks using only a few carefully selected task-specific examples presented in the prompt. However, given the…

机器学习 · 计算机科学 2025-09-22 Vaibhav Singh , Soumya Suvra Ghosal , Kapu Nirmal Joshua , Soumyabrata Pal , Sayak Ray Chowdhury

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

计算与语言 · 计算机科学 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

计算与语言 · 计算机科学 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Recent work has shown that, while large language models (LLMs) demonstrate strong word translation or bilingual lexicon induction (BLI) capabilities in few-shot setups, they still cannot match the performance of 'traditional' mapping-based…

计算与语言 · 计算机科学 2024-06-06 Yaoyiran Li , Anna Korhonen , Ivan Vulić

Large language models (LLMs) have shown an impressive ability to perform a wide range of tasks using in-context learning (ICL), where a few examples are used to describe a task to the model. However, the performance of ICL varies…

计算与语言 · 计算机科学 2024-06-25 Keqin Peng , Liang Ding , Yancheng Yuan , Xuebo Liu , Min Zhang , Yuanxin Ouyang , Dacheng Tao

In-context learning (ICL) enables Large Vision-Language Models (LVLMs) to adapt to new tasks without parameter updates, using a few demonstrations from a large support set. However, selecting informative demonstrations leads to high…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Huiyi Chen , Jiawei Peng , Kaihua Tang , Xin Geng , Xu Yang

Large language models (LLMs) can perform a new task by merely conditioning on task instructions and a few input-output examples, without optimizing any parameters. This is called In-Context Learning (ICL). In-context Information Extraction…

计算与语言 · 计算机科学 2025-07-14 Chaoxu Pang , Yixuan Cao , Qiang Ding , Ping Luo

Large pretrained language models (LMs) have shown impressive In-Context Learning (ICL) ability, where the model learns to do an unseen task via a prompt consisting of input-output examples as the demonstration, without any parameter…

计算与语言 · 计算机科学 2023-06-21 Jiacheng Ye , Zhiyong Wu , Jiangtao Feng , Tao Yu , Lingpeng Kong

In-context learning (ICL) is a powerful paradigm where large language models (LLMs) benefit from task demonstrations added to the prompt. Yet, selecting optimal demonstrations is not trivial, especially for complex or multi-modal tasks…

计算与语言 · 计算机科学 2024-10-21 Chuhong Mai , Ro-ee Tal , Thahir Mohamed

In-context learning (ICL), teaching a large language model (LLM) to perform a task with few-shot demonstrations rather than adjusting the model parameters, has emerged as a strong paradigm for using LLMs. While early studies primarily used…

计算与语言 · 计算机科学 2023-05-24 Man Luo , Xin Xu , Zhuyun Dai , Panupong Pasupat , Mehran Kazemi , Chitta Baral , Vaiva Imbrasaite , Vincent Y Zhao

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

计算与语言 · 计算机科学 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

Recently, large language models (LLMs) have made remarkable progress in natural language processing. The most representative ability of LLMs is in-context learning (ICL), which enables LLMs to learn patterns from in-context exemplars…

计算与语言 · 计算机科学 2023-12-20 Jiachen Zhao

In-Context Learning (ICL) allows Large Language Models (LLMs) to adapt to new tasks with just a few examples, but their predictions often suffer from systematic biases, leading to unstable performance in classification. While calibration…

机器学习 · 统计学 2026-03-05 Korel Gundem , Juncheng Dong , Dennis Zhang , Vahid Tarokh , Zhengling Qi

In-context learning (ICL) and supervised fine-tuning (SFT) are two common strategies for improving the performance of modern large language models (LLMs) on specific tasks. Despite their different natures, these strategies often lead to…

计算与语言 · 计算机科学 2024-09-10 Diego Doimo , Alessandro Serra , Alessio Ansuini , Alberto Cazzaniga

In-context learning (ICL) can significantly enhance the complex reasoning capabilities of large language models (LLMs), with the key lying in the selection and ordering of demonstration examples. Previous methods typically relied on simple…

计算与语言 · 计算机科学 2026-01-06 Xuetao Ma , Wenbin Jiang , Hua Huang

In this paper, we introduce InSQuAD, designed to enhance the performance of In-Context Learning (ICL) models through Submodular Mutual Information} (SMI) enforcing Quality and Diversity among in-context exemplars. InSQuAD achieves this…

机器学习 · 计算机科学 2025-08-29 Souradeep Nanda , Anay Majee , Rishabh Iyer