English
Related papers

Related papers: LLMs Learn Task Heuristics from Demonstrations: A …

200 papers

To alleviate the data scarcity problem in training question answering systems, recent works propose additional intermediate pre-training for dense passage retrieval (DPR). However, there still remains a large discrepancy between the…

Computation and Language · Computer Science 2022-04-13 Jiawei Zhou , Xiaoguang Li , Lifeng Shang , Lan Luo , Ke Zhan , Enrui Hu , Xinyu Zhang , Hao Jiang , Zhao Cao , Fan Yu , Xin Jiang , Qun Liu , Lei Chen

Large Language Models (LLMs) have recently gained the In-Context Learning (ICL) ability with the models scaling up, allowing them to quickly adapt to downstream tasks with only a few demonstration examples prepended in the input sequence.…

Computation and Language · Computer Science 2024-03-19 Zhe Yang , Damai Dai , Peiyi Wang , Zhifang Sui

Large-scale pre-trained language models (PLMs) are well-known for being capable of solving a task simply by conditioning a few input-label pairs dubbed demonstrations on a prompt without being explicitly tuned for the desired downstream…

Computation and Language · Computer Science 2022-06-17 Hyuhng Joon Kim , Hyunsoo Cho , Junyeob Kim , Taeuk Kim , Kang Min Yoo , Sang-goo Lee

This paper explores the impact of context selection on the efficiency of Large Language Models (LLMs) in generating Artificial Intelligence (AI) research leaderboards, a task defined as the extraction of (Task, Dataset, Metric, Score)…

Computation and Language · Computer Science 2024-07-03 Salomon Kabongo , Jennifer D'Souza , Sören Auer

Heuristic functions are essential to the performance of tree search algorithms such as A*, where their accuracy and efficiency directly impact search outcomes. Traditionally, such heuristics are handcrafted, requiring significant expertise.…

Artificial Intelligence · Computer Science 2026-01-28 Thomas Bömer , Nico Koltermann , Max Disselnmeyer , Bastian Amberg , Anne Meyer

The quality of output from large language models (LLMs), particularly in machine translation (MT), is closely tied to the quality of in-context examples (ICEs) provided along with the query, i.e., the text to translate. The effectiveness of…

Computation and Language · Computer Science 2024-09-19 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

In-context learning is a recent paradigm in natural language understanding, where a large pre-trained language model (LM) observes a test instance and a few training examples as its input, and directly decodes the output without any update…

Computation and Language · Computer Science 2022-05-10 Ohad Rubin , Jonathan Herzig , Jonathan Berant

Large pretrained language models (LLMs) can be rapidly adapted to a wide variety of tasks via a text-to-text approach, where the instruction and input are fed to the model in natural language. Combined with in-context learning (ICL), this…

Computation and Language · Computer Science 2023-12-13 Marc-Etienne Brunet , Ashton Anderson , Richard Zemel

While systems designed for solving planning tasks vastly outperform Large Language Models (LLMs) in this domain, they usually discard the rich semantic information embedded within task descriptions. In contrast, LLMs possess parametrised…

Computation and Language · Computer Science 2025-02-03 Andrey Borro , Patricia J Riddle , Michael W Barley , Michael J Witbrock

LLM-based automatic heuristic design has shown promise for generating executable heuristics for combinatorial optimization, but existing methods mainly rely on delayed endpoint performance. We propose a \emph{teacher-aware evolutionary…

Artificial Intelligence · Computer Science 2026-05-12 Minyu Chen , Song Qin , Ling-I Wu , Jianxin Xue , Guoqiang Li

Providing Language Models (LMs) with relevant evidence in the context (either via retrieval or user-provided) can significantly improve their ability to provide better-grounded responses. However, recent studies have found that LMs often…

Computation and Language · Computer Science 2025-05-27 Zhining Liu , Rana Ali Amjad , Ravinarayana Adkathimar , Tianxin Wei , Hanghang Tong

Event extraction (EE) is one of the core information extraction tasks, whose purpose is to automatically identify and extract information about incidents and their actors from texts. This may be beneficial to several domains such as…

Machine Learning · Computer Science 2020-10-29 Ali Balali , Masoud Asadpour , Ricardo Campos , Adam Jatowt

In-context learning (ICL) has demonstrated significant potential in enhancing the capabilities of large language models (LLMs) during inference. It's well-established that ICL heavily relies on selecting effective demonstrations to generate…

Computation and Language · Computer Science 2025-02-20 Qi Zhang , Zhiqing Xiao , Ruixuan Xiao , Lirong Gao , Junbo Zhao

Large language models (LLMs) frequently generate factually incorrect or unsupported content, commonly referred to as hallucinations. Prior work has explored decoding strategies, retrieval augmentation, and supervised fine-tuning for…

Machine Learning · Computer Science 2026-01-22 Bodla Krishna Vamshi , Rohan Bhatnagar , Haizhao Yang

In-context learning (ICL) is a powerful paradigm emerged from large language models (LLMs). Despite its promises, ICL performance is known to be highly sensitive to input examples. In this work, we use $\textit{in-context influences}$ to…

Computation and Language · Computer Science 2023-06-06 Tai Nguyen , Eric Wong

In-context learning (ICL) has emerged as a powerful paradigm for adapting large language models (LLMs) to new and data-scarce tasks using only a few carefully selected task-specific examples presented in the prompt. However, given the…

Machine Learning · Computer Science 2025-09-22 Vaibhav Singh , Soumya Suvra Ghosal , Kapu Nirmal Joshua , Soumyabrata Pal , Sayak Ray Chowdhury

Large, high-quality annotated corpora remain scarce in document-level entity and relation extraction in zero-shot or few-shot settings. In this paper, we present a fully automatic, LLM-based pipeline for synthetic data generation and…

Computation and Language · Computer Science 2025-07-09 Nicholas Popovič , Ashish Kangen , Tim Schopf , Michael Färber

While most existing works on LLM prompting techniques focus only on how to select a better set of data samples inside one single prompt input (In-Context Learning or ICL), why can not we design and leverage multiple prompts together to…

Computation and Language · Computer Science 2024-04-03 Bingsheng Yao , Guiming Chen , Ruishi Zou , Yuxuan Lu , Jiachen Li , Shao Zhang , Yisi Sang , Sijia Liu , James Hendler , Dakuo Wang

Event extraction has long been treated as a sentence-level task in the IE community. We argue that this setting does not match human information-seeking behavior and leads to incomplete and uninformative extraction results. We propose a…

Computation and Language · Computer Science 2021-04-14 Sha Li , Heng Ji , Jiawei Han

To understand a document with multiple events, event-event relation extraction (ERE) emerges as a crucial task, aiming to discern how natural events temporally or structurally associate with each other. To achieve this goal, our work…

Information Theory · Computer Science 2024-12-20 Peixin Huang , Xiang Zhao , Minghao Hu , Zhen Tan , Weidong Xiao