English
Related papers

Related papers: The Power of Adaptation: Boosting In-Context Learn…

200 papers

Large language models (LLMs) have exhibited remarkable capabilities in learning from explanations in prompts, but there has been limited understanding of exactly how these explanations function or why they are effective. This work aims to…

Computation and Language · Computer Science 2023-06-14 Xi Ye , Srinivasan Iyer , Asli Celikyilmaz , Ves Stoyanov , Greg Durrett , Ramakanth Pasunuru

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

Computation and Language · Computer Science 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

Large language models (LLMs) have demonstrated their ability to learn in-context, allowing them to perform various tasks based on a few input-output examples. However, the effectiveness of in-context learning is heavily reliant on the…

Computation and Language · Computer Science 2024-01-29 Liang Wang , Nan Yang , Furu Wei

Large Language Models (LLMs) can adapt to new tasks via in-context learning (ICL). ICL is efficient as it does not require any parameter updates to the trained LLM, but only few annotated examples as input for the LLM. In this work, we…

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

Machine Learning · Computer Science 2024-12-02 Kamesh R

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

Machine Learning · Computer Science 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

In-context learning is a recent paradigm in natural language understanding, where a large pre-trained language model (LM) observes a test instance and a few training examples as its input, and directly decodes the output without any update…

Computation and Language · Computer Science 2022-05-10 Ohad Rubin , Jonathan Herzig , Jonathan Berant

Recently, large language models (LLMs) have made remarkable progress in natural language processing. The most representative ability of LLMs is in-context learning (ICL), which enables LLMs to learn patterns from in-context exemplars…

Computation and Language · Computer Science 2023-12-20 Jiachen Zhao

Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question answering. Previous…

Computation and Language · Computer Science 2023-06-08 Zixian Huang , Jiaying Zhou , Gengyang Xiao , Gong Cheng

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

Computation and Language · Computer Science 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West

Prompting Large Language Models (LLMs), or providing context on the expected model of operation, is an effective way to steer the outputs of such models to satisfy human desiderata after they have been trained. But in rapidly evolving…

Machine Learning · Computer Science 2025-08-08 Younwoo Choi , Muhammad Adil Asif , Ziwen Han , John Willes , Rahul G. Krishnan

The emergence of large language models (LLMs) has substantially influenced natural language processing, demonstrating exceptional results across various tasks. In this study, we employ ``Introspective Tips" to facilitate LLMs in…

Artificial Intelligence · Computer Science 2023-05-22 Liting Chen , Lu Wang , Hang Dong , Yali Du , Jie Yan , Fangkai Yang , Shuang Li , Pu Zhao , Si Qin , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

In-context learning can help Large Language Models (LLMs) to adapt new tasks without additional training. However, this performance heavily depends on the quality of the demonstrations, driving research into effective demonstration…

Computation and Language · Computer Science 2024-10-31 Dong Shu , Mengnan Du

In-Context Learning (ICL) is a technique by which language models make predictions based on examples provided in their input context. Previously, their context window size imposed a limit on the number of examples that can be shown, making…

Computation and Language · Computer Science 2025-05-29 Jinheon Baek , Sun Jae Lee , Prakhar Gupta , Geunseob Oh , Siddharth Dalmia , Prateek Kolhar

The ability of generative large language models (LLMs) to perform in-context learning has given rise to a large body of research into how best to prompt models for various natural language processing tasks. In this paper, we focus on…

Computation and Language · Computer Science 2024-08-02 Armel Zebaze , Benoît Sagot , Rachel Bawden
‹ Prev 1 2 3 10 Next ›