English
Related papers

Related papers: LLMs Learn Task Heuristics from Demonstrations: A …

200 papers

In-Context Learning (ICL) enables transformer-based language models to adapt to new tasks by conditioning on demonstration examples. However, traditional example-driven in-context learning lacks explicit modules for knowledge retrieval and…

Computation and Language · Computer Science 2026-03-31 Pan Chen , Shaohong Chen , Mark Wang , Shi Xuan Leong , Priscilla Fung , Varinia Bernales , Alan Aspuru-Guzik

Implicit event argument extraction (EAE) aims to identify arguments that could scatter over the document. Most previous work focuses on learning the direct relations between arguments and the given trigger, while the implicit relations with…

Computation and Language · Computer Science 2022-06-14 Jiaju Lin , Qin Chen , Jie Zhou , Jian Jin , Liang He

In-Context Learning (ICL) is an important paradigm for adapting Large Language Models (LLMs) to downstream tasks through a few demonstrations. Despite the great success of ICL, the limitation of the demonstration number may lead to…

Computation and Language · Computer Science 2024-01-10 Caoyun Fan , Jidong Tian , Yitian Li , Hao He , Yaohui Jin

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

In-context learning (ICL) has emerged as a powerful paradigm leveraging LLMs for specific downstream tasks by utilizing labeled examples as demonstrations (demos) in the preconditioned prompts. Despite its promising performance, crafted…

Machine Learning · Computer Science 2025-05-30 Xiangyu Zhou , Yao Qiang , Saleh Zare Zade , Prashant Khanduri , Dongxiao Zhu

Large Language Models (LLMs) exhibit the ability to perform in-context learning (ICL), where they acquire new tasks directly from examples provided in demonstrations. This process is thought to operate through an implicit task selection…

Computation and Language · Computer Science 2024-12-17 Xingwei Qu , Yiming Liang , Yucheng Wang , Tianyu Zheng , Tommy Yue , Xingyuan Bu , Lei Ma , Stephen W. Huang , Jiajun Zhang , Yinan Shi , Chenghua Lin , Jie Fu , Ge Zhang

Interpreting the internal process of neural models has long been a challenge. This challenge remains relevant in the era of large language models (LLMs) and in-context learning (ICL); for example, ICL poses a new issue of interpreting which…

Computation and Language · Computer Science 2025-07-10 Mengyu Ye , Tatsuki Kuribayashi , Goro Kobayashi , Jun Suzuki

Ensuring the reproducibility of physics results is one of the crucial challenges in high-energy physics (HEP). In this study, we develop a proof-of-concept system that uses large language models (LLMs) to extract analysis procedures from…

Data Analysis, Statistics and Probability · Physics 2026-04-17 Masahiko Saito , Tomoe Kishimoto , Junichi Tanaka

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

In-context learning (ICL) is the trending prompting strategy in the era of large language models (LLMs), where a few examples are demonstrated to evoke LLMs' power for a given task. How to select informative examples remains an open issue.…

Computation and Language · Computer Science 2024-05-30 Chenming Tang , Zhixiang Wang , Yunfang Wu

In-Context Learning (ICL) in Large Language Models (LLM) has emerged as the dominant technique for performing natural language tasks, as it does not require updating the model parameters with gradient-based methods. ICL promises to "adapt"…

Computation and Language · Computer Science 2025-03-05 Georgios Chochlakis , Niyantha Maruthu Pandiyan , Kristina Lerman , Shrikanth Narayanan

Spurred by advancements in scale, large language models (LLMs) have demonstrated strong few-shot learning ability via in-context learning (ICL). However, the performance of ICL has been shown to be highly sensitive to the selection of…

Computation and Language · Computer Science 2024-12-31 Chengwei Qin , Aston Zhang , Chen Chen , Anirudh Dagar , Wenming Ye

Event extraction is essential for event understanding and analysis. It supports tasks such as document summarization and decision-making in emergency scenarios. However, existing event extraction approaches have limitations: (1)…

Computation and Language · Computer Science 2026-04-24 Praval Sharma

Event argument extraction (EAE) is an important task for information extraction to discover specific argument roles. In this study, we cast EAE as a question-based cloze task and empirically analyze fixed discrete token template…

Computation and Language · Computer Science 2023-01-26 Hongbin Ye , Ningyu Zhang , Zhen Bi , Shumin Deng , Chuanqi Tan , Hui Chen , Fei Huang , Huajun Chen

Large Language Models (LLMs) have demonstrated remarkable proficiency across diverse tasks, exhibiting emergent properties such as semantic prompt comprehension, In-Context Learning (ICL), and Chain-of-Thought (CoT) reasoning. Despite their…

Computation and Language · Computer Science 2026-03-13 Yuling Jiao , Yanming Lai , Huazhen Lin , Wensen Ma , Houduo Qi , Defeng Sun

This paper investigates demonstration selection strategies for predicting a user's next point-of-interest (POI) using large language models (LLMs), aiming to accurately forecast a user's subsequent location based on historical check-in…

Computation and Language · Computer Science 2026-04-09 Ryo Nishida , Masayuki Kawarada , Tatsuya Ishigaki , Hiroya Takamura , Masaki Onishi

In-context learning (ICL, also known as few-shot prompting) has been the standard method of adapting LLMs to downstream tasks, by learning from a few input-output examples. Nonetheless, all ICL-based approaches only learn from correct…

Computation and Language · Computer Science 2024-02-13 Tianjun Zhang , Aman Madaan , Luyu Gao , Steven Zheng , Swaroop Mishra , Yiming Yang , Niket Tandon , Uri Alon

Demonstration ordering, which is an important strategy for in-context learning (ICL), can significantly affects the performance of large language models (LLMs). However, most of the current approaches of ordering require high computational…

Computation and Language · Computer Science 2024-06-18 Yinpeng Liu , Jiawei Liu , Xiang Shi , Qikai Cheng , Yong Huang , Wei Lu

Document-level Event Extraction (DEE) is particularly tricky due to the two challenges it poses: scattering-arguments and multi-events. The first challenge means that arguments of one event record could reside in different sentences in the…

Computation and Language · Computer Science 2022-02-08 Shiyao Cui , Xin Cong , Bowen Yu , Tingwen Liu , Yucheng Wang , Jinqiao Shi

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao