English
Related papers

Related papers: Plug-and-Play Performance Estimation for LLM Servi…

200 papers

Large Language Models (LLMs) have the impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is…

Computation and Language · Computer Science 2023-10-27 Harvey Yiyun Fu , Qinyuan Ye , Albert Xu , Xiang Ren , Robin Jia

In-context Learning (ICL) has emerged as a powerful capability alongside the development of scaled-up large language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks…

Computation and Language · Computer Science 2024-07-24 Quanyu Long , Yin Wu , Wenya Wang , Sinno Jialin Pan

In-Context Learning (ICL) is an emergent capability of Large Language Models (LLMs). Only a few demonstrations enable LLMs to be used as blackbox for new tasks. Previous studies have shown that using LLMs' outputs as labels is effective in…

Computation and Language · Computer Science 2024-04-04 Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Large language models (LLMs) have shown remarkable capacity for in-context learning (ICL), where learning a new task from just a few training examples is done without being explicitly pre-trained. However, despite the success of LLMs, there…

Computation and Language · Computer Science 2023-08-02 Xindi Wang , Yufei Wang , Can Xu , Xiubo Geng , Bowen Zhang , Chongyang Tao , Frank Rudzicz , Robert E. Mercer , Daxin Jiang

Large language models (LLMs) exhibit impressive in-context learning (ICL) capabilities, yet the quality of their predictions is fundamentally limited by the few costly labeled demonstrations that can fit into a prompt. Meanwhile, there…

Machine Learning · Computer Science 2026-01-16 Renpu Liu , Jing Yang

Ever since the development of GPT-3 in the natural language processing (NLP) field, in-context learning (ICL) has played an essential role in utilizing large language models (LLMs). By presenting the LM utterance-label demonstrations at the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-18 Ming-Hao Hsu , Kai-Wei Chang , Shang-Wen Li , Hung-yi Lee

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

Following the success of Large Language Models (LLMs), Large Multimodal Models (LMMs), such as the Flamingo model and its subsequent competitors, have started to emerge as natural steps towards generalist agents. However, interacting with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Mustafa Shukor , Alexandre Rame , Corentin Dancette , Matthieu Cord

Large Language Models (LLMs) have demonstrated the ability to solve complex tasks through In-Context Learning (ICL), where models learn from a few input-output pairs without explicit fine-tuning. In this paper, we explore the capacity of…

Machine Learning · Computer Science 2024-11-26 Paimon Goulart , Evangelos E. Papalexakis

In-context learning (ICL) has emerged as an effective approach to enhance the performance of large language models (LLMs). However, its effectiveness varies significantly across models and tasks, posing challenges for practitioners to…

Computation and Language · Computer Science 2025-07-15 Dingzriui Wang , Xuanliang Zhang , Keyan Xu , Qingfu Zhu , Wanxiang Che , Yang Deng

In-context learning (ICL) is the ability of a large language model (LLM) to learn a new task from a few demonstrations presented as part of the context. Past studies have attributed a large portion of the success of ICL to the way these…

Computation and Language · Computer Science 2025-10-10 Ioana Marinescu , Kyunghyun Cho , Eric Karl Oermann

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

The reasoning large language model (RLLM) has been proven competitive in solving complex reasoning tasks such as mathematics, coding, compared to general LLM. However, the serving performance and behavior of RLLM remains unexplored, which…

Machine Learning · Computer Science 2025-10-22 Qi Li , Junpan Wu , Xiang Liu , Yuxin Wang , Zeyu Li , Zhenheng Tang , Yuhan Chen , Shaohuai Shi , Xiaowen Chu

Large Language Models (LLMs) have proven effective at In-Context Learning (ICL), an ability that allows them to create predictors from labeled examples. Few studies have explored the interplay between ICL and specific properties of…

Machine Learning · Computer Science 2023-11-23 David Oniani , Yanshan Wang

Whereas the recent emergence of large language models (LLMs) like ChatGPT has exhibited impressive general performance, it still has a large gap with fully-supervised models on specific tasks such as multi-span question answering. Previous…

Computation and Language · Computer Science 2023-06-08 Zixian Huang , Jiaying Zhou , Gengyang Xiao , Gong Cheng

Large Language Models (LLMs) have transformed NLP with their remarkable In-context Learning (ICL) capabilities. Automated assistants based on LLMs are gaining popularity; however, adapting them to novel tasks is still challenging. While…

Computation and Language · Computer Science 2024-06-13 Anwoy Chatterjee , Eshaan Tanwar , Subhabrata Dutta , Tanmoy Chakraborty

In-context learning (ICL) has emerged as an effective solution for few-shot learning with large language models (LLMs). However, how LLMs leverage demonstrations to specify a task and learn a corresponding computational function through ICL…

Computation and Language · Computer Science 2025-11-17 Yu Bai , Heyan Huang , Cesare Spinoso-Di Piano , Marc-Antoine Rondeau , Sanxing Chen , Yang Gao , Jackie Chi Kit Cheung

In-context learning (ICL) with dynamically selected demonstrations combines the flexibility of prompting large language models (LLMs) with the ability to leverage training data to improve performance. While ICL has been highly successful…

Computation and Language · Computer Science 2025-06-17 Shivanshu Gupta , Sameer Singh , Ashish Sabharwal , Tushar Khot , Ben Bogin

Large language models (LLMs) exhibit remarkable flexibility: they can adapt to novel tasks from in-context examples without any parameter updates, a capability known as in-context learning (ICL). Prior work on synthetic tasks has shown that…

Computation and Language · Computer Science 2026-05-29 Hua-Dong Xiong , Li Ji-An , Robert C. Wilson , Kwonjoon Lee , Xue-Xin Wei

Large Language Models (LLMs) have shown impressive abilities in solving various natural language processing tasks and are now widely offered as services. LLM services enable users to accomplish tasks without requiring specialized knowledge,…

Software Engineering · Computer Science 2024-12-24 Can Wang , Dianbo Sui , Bolin Zhang , Xiaoyu Liu , Jiabao Kang , Zhidong Qiao , Zhiying Tu
‹ Prev 1 2 3 10 Next ›