English
Related papers

Related papers: LLMs Learn Task Heuristics from Demonstrations: A …

200 papers

Visual In-Context Learning (ICL) has emerged as a promising research area due to its capability to accomplish various tasks with limited example pairs through analogical reasoning. However, training-based visual ICL has limitations in its…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zheng Gu , Shiyuan Yang , Jing Liao , Jing Huo , Yang Gao

Event Causality Identification (ECI) aims at determining the existence of a causal relation between two events. Although recent prompt learning-based approaches have shown promising improvements on the ECI task, their performance are often…

Information Retrieval · Computer Science 2024-09-30 Chao Liang , Wei Xiang , Bang Wang

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks without weight updates by learning from demonstration sequences. While ICL shows strong empirical performance, its internal representational mechanisms are…

Computation and Language · Computer Science 2025-10-07 Jiachen Jiang , Yuxin Dong , Jinxin Zhou , Zhihui Zhu

Recently, large language models (LLMs) have made remarkable progress in natural language processing. The most representative ability of LLMs is in-context learning (ICL), which enables LLMs to learn patterns from in-context exemplars…

Computation and Language · Computer Science 2023-12-20 Jiachen Zhao

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

Machine Learning · Computer Science 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Prompt optimization automatically refines prompting expressions, unlocking the full potential of LLMs in downstream tasks. However, current prompt optimization methods are costly to train and lack sufficient interpretability. This paper…

Computation and Language · Computer Science 2024-12-23 Yajing Wang , Zongwei Luo , Jingzhe Wang , Zhanke Zhou , Yongqiang Chen , Bo Han

The capability of in-context learning (ICL) enables large language models (LLMs) to perform novel tasks without parameter updates by conditioning on a few input-output examples. However, collecting high-quality examples for new or…

Artificial Intelligence · Computer Science 2025-10-29 Zihan Chen , Song Wang , Xingbo Fu , Chengshuai Shi , Zhenyu Lei , Cong Shen , Jundong Li

Large language model-based agents, empowered by in-context learning (ICL), have demonstrated strong capabilities in complex reasoning and tool-use tasks. However, existing works have shown that the effectiveness of ICL is highly sensitive…

Artificial Intelligence · Computer Science 2025-08-01 Ruoyu Wang , Junda Wu , Yu Xia , Tong Yu , Ryan A. Rossi , Julian McAuley , Lina Yao

In-context learning (ICL) i.e. showing LLMs only a few task-specific demonstrations has led to downstream gains with no task-specific fine-tuning required. However, LLMs are sensitive to the choice of prompts, and therefore a crucial…

Computation and Language · Computer Science 2024-01-31 Lingyu Gao , Aditi Chaudhary , Krishna Srinivasan , Kazuma Hashimoto , Karthik Raman , Michael Bendersky

In-context learning (ICL) emerges as a promising capability of large language models (LLMs) by providing them with demonstration examples to perform diverse tasks. However, the underlying mechanism of how LLMs learn from the provided…

Computation and Language · Computer Science 2023-12-20 Lean Wang , Lei Li , Damai Dai , Deli Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

Large language models (LLMs), such as GPT-3 and ChatGPT, have demonstrated remarkable results in various natural language processing (NLP) tasks with in-context learning, which involves inference based on a few demonstration examples.…

Computation and Language · Computer Science 2023-08-22 Jiabang He , Lei Wang , Yi Hu , Ning Liu , Hui Liu , Xing Xu , Heng Tao Shen

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

Computation and Language · Computer Science 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

Modern large language models (LLMs) are capable of interpreting input strings as instructions, or prompts, and carry out tasks based on them. Unlike traditional learners, LLMs cannot use back-propagation to obtain feedback, and condition…

Computation and Language · Computer Science 2026-03-17 Adrian de Wynter , Xun Wang , Qilong Gu , Si-Qing Chen

Eliciting knowledge from pre-trained language models via prompt-based learning has shown great potential in many natural language processing tasks. Whereas, the applications for more complex tasks such as event extraction are less studied…

Computation and Language · Computer Science 2022-05-16 Jiaju Lin , Qin Chen

Transformers have demonstrated exceptional in-context learning (ICL) capabilities, enabling applications across natural language processing, computer vision, and sequential decision-making. In reinforcement learning, ICL reframes learning…

Machine Learning · Computer Science 2025-11-14 Oliver Dippel , Alexei Lisitsa , Bei Peng

Large pretrained language models (LMs) have shown impressive In-Context Learning (ICL) ability, where the model learns to do an unseen task via a prompt consisting of input-output examples as the demonstration, without any parameter…

Computation and Language · Computer Science 2023-06-21 Jiacheng Ye , Zhiyong Wu , Jiangtao Feng , Tao Yu , Lingpeng Kong

In-context learning (ICL) is an emerging capability of large autoregressive language models where a few input-label demonstrations are appended to the input to enhance the model's understanding of downstream NLP tasks, without directly…

Computation and Language · Computer Science 2023-10-31 Zhuocheng Gong , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Rui Yan

Information extraction (IE) plays very important role in natural language processing (NLP) and is fundamental to many NLP applications that used to extract structured information from unstructured text data. Heuristic-based searching and…

Computation and Language · Computer Science 2023-07-04 Shiyu Yuan , Carlo Lipizzi

In-context learning (ICL) allows large language models (LLMs) to solve novel tasks without weight updates. Despite its empirical success, the mechanism behind ICL remains poorly understood, limiting our ability to interpret, improve, and…

Machine Learning · Computer Science 2025-06-16 Chengye Li , Haiyun Liu , Yuanxi Li

The in-context learning (ICL) for relational triple extraction (RTE) has achieved promising performance, but still encounters two key challenges: (1) how to design effective prompts and (2) how to select proper demonstrations. Existing…

Computation and Language · Computer Science 2024-02-22 Guozheng Li , Wenjun Ke , Peng Wang , Zijie Xu , Ke Ji , Jiajun Liu , Ziyu Shang , Qiqing Luo