中文
相关论文

相关论文: Guiding In-Context Learning of LLMs through Qualit…

200 篇论文

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

计算与语言 · 计算机科学 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence.…

计算与语言 · 计算机科学 2024-03-19 Zhe Yang , Damai Dai , Peiyi Wang , Zhifang Sui

Large Language Models (LLMs) have demonstrated the ability to solve complex tasks through In-Context Learning (ICL), where models learn from a few input-output pairs without explicit fine-tuning. In this paper, we explore the capacity of…

机器学习 · 计算机科学 2024-11-26 Paimon Goulart , Evangelos E. Papalexakis

The emergence of Large Language Models (LLMs) such as ChatGPT and LLaMA encounter limitations in domain-specific tasks, with these models often lacking depth and accuracy in specialized areas, and exhibiting a decrease in general…

计算与语言 · 计算机科学 2024-01-05 Chen Zheng , Ke Sun , Da Tang , Yukun Ma , Yuyu Zhang , Chenguang Xi , Xun Zhou

Real-world applications of large language models (LLMs) in computational social science (CSS) tasks primarily depend on the effectiveness of instruction tuning (IT) or in-context learning (ICL). While IT has shown highly effective at…

计算与语言 · 计算机科学 2024-09-24 Taihang Wang , Xiaoman Xu , Yimin Wang , Ye Jiang

In-context learning (ICL) can significantly enhance the complex reasoning capabilities of large language models (LLMs), with the key lying in the selection and ordering of demonstration examples. Previous methods typically relied on simple…

计算与语言 · 计算机科学 2026-01-06 Xuetao Ma , Wenbin Jiang , Hua Huang

In-context learning (ICL) has emerged as a particularly remarkable characteristic of Large Language Models (LLM): given a pretrained LLM and an observed dataset, LLMs can make predictions for new data points from the same distribution…

机器学习 · 统计学 2024-06-04 Fabian Falck , Ziyu Wang , Chris Holmes

In-context learning (ICL) unfolds as large language models become capable of inferring test labels conditioned on a few labeled samples without any gradient update. ICL-enabled large language models provide a promising step forward toward…

计算与语言 · 计算机科学 2023-06-27 Eshaan Tanwar , Subhabrata Dutta , Manish Borthakur , Tanmoy Chakraborty

In-context learning (ICL) allows LLMs to learn from examples without changing their weights: this is a particularly promising capability for long-context LLMs that can potentially learn from many examples. Recently, Lin et al. (2024)…

计算与语言 · 计算机科学 2025-04-21 Hao Zhao , Maksym Andriushchenko , Francesco Croce , Nicolas Flammarion

Large language models (LLMs) can adapt to new tasks through in-context learning (ICL) based on a few examples presented in dialogue history without any model parameter update. Despite such convenience, the performance of ICL heavily depends…

计算与语言 · 计算机科学 2024-06-18 Siyin Wang , Chao-Han Huck Yang , Ji Wu , Chao Zhang

With the increasing capabilities of large language models (LLMs), in-context learning (ICL) has emerged as a new paradigm for natural language processing (NLP), where LLMs make predictions based on contexts augmented with a few examples. It…

计算与语言 · 计算机科学 2024-10-08 Qingxiu Dong , Lei Li , Damai Dai , Ce Zheng , Jingyuan Ma , Rui Li , Heming Xia , Jingjing Xu , Zhiyong Wu , Tianyu Liu , Baobao Chang , Xu Sun , Lei Li , Zhifang Sui

In-context learning (ICL) with dynamically selected demonstrations combines the flexibility of prompting large language models (LLMs) with the ability to leverage training data to improve performance. While ICL has been highly successful…

计算与语言 · 计算机科学 2025-06-17 Shivanshu Gupta , Sameer Singh , Ashish Sabharwal , Tushar Khot , Ben Bogin

In-Context Learning (ICL) has emerged as a promising solution to enhance the code generation capabilities of Large Language Models (LLMs), which incorporates code examples inside the prompt to let LLMs learn from demonstrations. However,…

软件工程 · 计算机科学 2025-08-11 Dongze Li , Songqiang Chen , Jialun Cao , Shing-Chi Cheung

Recent work shows that in-context learning and optimization of in-context examples (ICE) can significantly improve the accuracy of large language models (LLMs) on a wide range of tasks, leading to an apparent consensus that ICE optimization…

计算与语言 · 计算机科学 2024-06-07 Pragya Srivastava , Satvik Golechha , Amit Deshpande , Amit Sharma

After pre-training by generating the next word conditional on previous words, the Language Model (LM) acquires the ability of In-Context Learning (ICL) that can learn a new task conditional on the context of the given in-context examples…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Haokun Chen , Xu Yang , Yuhang Huang , Zihan Wu , Jing Wang , Xin Geng

In-context learning (ICL) has emerged as an effective approach to enhance the performance of large language models (LLMs). However, its effectiveness varies significantly across models and tasks, posing challenges for practitioners to…

计算与语言 · 计算机科学 2025-07-15 Dingzriui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

In-context learning (ICL) is an astonishing emergent ability of large language models (LLMs). By presenting a prompt that includes multiple input-output pairs as examples and introducing a new query input, models can generate the…

机器学习 · 计算机科学 2023-10-06 Timothy Chu , Zhao Song , Chiwun Yang

Pre-trained models of source code have gained widespread popularity in many code intelligence tasks. Recently, with the scaling of the model and corpus size, large language models have shown the ability of in-context learning (ICL). ICL…

软件工程 · 计算机科学 2024-01-11 Shuzheng Gao , Xin-Cheng Wen , Cuiyun Gao , Wenxuan Wang , Hongyu Zhang , Michael R. Lyu

Large language models (LLMs) exhibit outstanding performance in machine translation via in-context learning. In contrast to sentence-level translation, document-level translation (DOCMT) by LLMs based on in-context learning faces two major…

计算与语言 · 计算机科学 2024-06-12 Menglong Cui , Jiangcun Du , Shaolin Zhu , Deyi Xiong

Clinical decision support systems require models that are not only highly accurate but also equitable and sensitive to the implications of missed diagnoses. In this study, we introduce a knowledge-guided in-context learning (ICL) framework…

机器学习 · 计算机科学 2025-07-28 Fatemeh Nazary , Yashar Deldjoo , Tommaso Di Noia , Eugenio di Sciascio