English
Related papers

Related papers: PoKE: A Prompt-based Knowledge Eliciting Approach …

200 papers

Demonstration learning aims to guide the prompt prediction via providing answered demonstrations in the few shot settings. Despite achieving promising results, existing work only concatenates the answered examples as demonstrations to the…

Machine Learning · Computer Science 2022-09-02 Sirui Wang , Kaiwen Wei , Hongzhi Zhang , Yuntao Li , Wei Wu

Large Language Models (LLMs) are often used as automated judges to evaluate text, but their effectiveness can be hindered by various unintentional biases. We propose using linear classifying probes, trained by leveraging differences between…

Computation and Language · Computer Science 2025-03-25 Sharan Maiya , Yinhong Liu , Ramit Debnath , Anna Korhonen

Nested Event Extraction (NEE) aims to extract complex event structures where an event contains other events as its arguments recursively. Nested events involve a kind of Pivot Elements (PEs) that simultaneously act as arguments of…

Computation and Language · Computer Science 2024-04-09 Weicheng Ren , Zixuan Li , Xiaolong Jin , Long Bai , Miao Su , Yantao Liu , Saiping Guan , Jiafeng Guo , Xueqi Cheng

Most previous studies of document-level event extraction mainly focus on building argument chains in an autoregressive way, which achieves a certain success but is inefficient in both training and inference. In contrast to the previous…

Computation and Language · Computer Science 2022-10-05 Tong Zhu , Xiaoye Qu , Wenliang Chen , Zhefeng Wang , Baoxing Huai , Nicholas Jing Yuan , Min Zhang

Eliciting information to reduce uncertainty about a latent entity is a critical task in many application domains, e.g., assessing individual student learning outcomes, diagnosing underlying diseases, or learning user preferences. Though…

Computation and Language · Computer Science 2025-07-10 Jimmy Wang , Thomas Zollo , Richard Zemel , Hongseok Namkoong

Consumer Event-Cause Extraction, the task aimed at extracting the potential causes behind certain events in the text, has gained much attention in recent years due to its wide applications. The ICDM 2020 conference sets up an evaluation…

Computation and Language · Computer Science 2024-04-25 Congqing He , Jie Zhang , Xiangyu Zhu , Huan Liu , Yukun Huang

The active research topic of prompt engineering makes it evident that LLMs are sensitive to small changes in prompt wording. A portion of this can be ascribed to the inductive bias that is present in the LLM. By using an LLM's output as a…

Computation and Language · Computer Science 2025-08-15 Christian M. Angel , Francis Ferraro

Estimating mutual information from text usually requires training a task-specific critic, which limits its use in low-data settings. We ask whether large language models can instead estimate pointwise mutual information zero-shot, using…

Computation and Language · Computer Science 2026-05-22 Juliette Woodrow , Chris Piech

Incorporation of expert information in inference or decision settings is often important, especially in cases where data are unavailable, costly or unreliable. One approach is to elicit prior quantiles from an expert and then to fit these…

Statistics Theory · Mathematics 2016-11-04 Nicholas M. Kiefer

Events and entities are closely related; entities are often actors or participants in events and events without entities are uncommon. The interpretation of events and entities is highly contextually dependent. Existing work in information…

Computation and Language · Computer Science 2016-09-14 Bishan Yang , Tom Mitchell

Event-based state estimation can achieve estimation quality comparable to traditional time-triggered methods, but with a significantly lower number of samples. In networked estimation problems, this reduction in sampling instants does,…

Systems and Control · Computer Science 2016-09-27 Sebastian Trimpe

Large language models (LLMs) are susceptible to memorizing training data, raising concerns about the potential extraction of sensitive information at generation time. Discoverable extraction is the most common method for measuring this…

Prompting has become a practical method for utilizing pre-trained language models (LMs). This approach offers several advantages. It allows an LM to adapt to new tasks with minimal training and parameter updates, thus achieving efficiency…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-26 Kai-Wei Chang , Haibin Wu , Yu-Kai Wang , Yuan-Kuei Wu , Hua Shen , Wei-Cheng Tseng , Iu-thing Kang , Shang-Wen Li , Hung-yi Lee

Combining different forms of prompts with pre-trained large language models has yielded remarkable results on reasoning tasks (e.g. Chain-of-Thought prompting). However, along with testing on more complex reasoning, these methods also…

Computation and Language · Computer Science 2024-05-14 Yitian Li , Jidong Tian , Hao He , Yaohui Jin

The task of event detection and classification is central to most information retrieval applications. We show that a Transformer based architecture can effectively model event extraction as a sequence labeling task. We propose a combination…

Computation and Language · Computer Science 2020-09-16 Parul Awasthy , Tahira Naseem , Jian Ni , Taesun Moon , Radu Florian

Event Causality Identification (ECI) aims at determining the existence of a causal relation between two events. Although recent prompt learning-based approaches have shown promising improvements on the ECI task, their performance are often…

Information Retrieval · Computer Science 2024-09-30 Chao Liang , Wei Xiang , Bang Wang

Aligning text-to-image generation with user intent remains challenging, as users frequently provide ambiguous inputs and struggle with model idiosyncrasies. We propose Adaptive Prompt Elicitation (APE), a technique that adaptively poses…

Human-Computer Interaction · Computer Science 2026-04-22 Xinyi Wen , Lena Hegemann , Xiaofu Jin , Shuai Ma , Antti Oulasvirta

Answering complex questions is a challenging task that requires question decomposition and multistep reasoning for arriving at the solution. While existing supervised and unsupervised approaches are specialized to a certain task and involve…

Computation and Language · Computer Science 2023-10-31 Venktesh V , Sourangshu Bhattacharya , Avishek Anand

Event Detection, which aims to identify and classify mentions of event instances from unstructured articles, is an important task in Natural Language Processing (NLP). Existing techniques for event detection only use homogeneous one-hot…

Computation and Language · Computer Science 2022-11-03 Anran Hao , Siu Cheung Hui , Jian Su

This paper investigates models of event implications. Specifically, how well models predict entity state-changes, by targeting their understanding of physical attributes. Nominally, Large Language models (LLM) have been exposed to…

Computation and Language · Computer Science 2022-11-11 Evangelia Spiliopoulou , Artidoro Pagnoni , Yonatan Bisk , Eduard Hovy