English
Related papers

Related papers: Global Constraints with Prompting for Zero-Shot Ev…

200 papers

Contrastively trained text-image models have the remarkable ability to perform zero-shot classification, that is, classifying previously unseen images into categories that the model has never been explicitly trained to identify. However,…

Event detection (ED) is aimed to identify the key trigger words in unstructured text and predict the event types accordingly. Traditional ED models are too data-hungry to accommodate real applications with scarce labeled data. Besides,…

Computation and Language · Computer Science 2023-05-17 Siyuan Wang , Jianming Zheng , Xuejun Hu , Fei Cai , Chengyu Song , Xueshan Luo

Recent studies have demonstrated that natural-language prompts can help to leverage the knowledge learned by pre-trained language models for the binary sentence-level sentiment classification task. Specifically, these methods utilize…

Computation and Language · Computer Science 2023-07-04 Mohna Chakraborty , Adithya Kulkarni , Qi Li

The problem of event extraction requires detecting the event trigger and extracting its corresponding arguments. Existing work in event argument extraction typically relies heavily on entity recognition as a preprocessing/concurrent step,…

Computation and Language · Computer Science 2021-02-08 Xinya Du , Claire Cardie

Extracting informative arguments of events from news articles is a challenging problem in information extraction, which requires a global contextual understanding of each document. While recent work on document-level extraction has gone…

Computation and Language · Computer Science 2022-09-20 Xinya Du , Sha Li , Heng Ji

In this paper, we propose an effective yet efficient model PAIE for both sentence-level and document-level Event Argument Extraction (EAE), which also generalizes well when there is a lack of training data. On the one hand, PAIE utilizes…

Computation and Language · Computer Science 2022-03-29 Yubo Ma , Zehao Wang , Yixin Cao , Mukai Li , Meiqi Chen , Kun Wang , Jing Shao

Prevailing methods for mapping large generative language models to supervised tasks may fail to sufficiently probe models' novel capabilities. Using GPT-3 as a case study, we show that 0-shot prompts can significantly outperform few-shot…

Computation and Language · Computer Science 2021-02-16 Laria Reynolds , Kyle McDonell

Most previous event extraction studies have relied heavily on features derived from annotated event mentions, thus cannot be applied to new event types without annotation effort. In this work, we take a fresh look at event extraction and…

Computation and Language · Computer Science 2017-07-05 Lifu Huang , Heng Ji , Kyunghyun Cho , Clare R. Voss

Prompting is used to guide or steer a language model in generating an appropriate response that is consistent with the desired outcome. Chaining is a strategy used to decompose complex tasks into smaller, manageable components. In this…

Computation and Language · Computer Science 2023-08-09 Dietrich Trautmann

Image recognition has recently witnessed a paradigm shift, where vision-language models are now used to perform few-shot classification based on textual prompts. Among these, the CLIP model has shown remarkable capabilities for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Lorenzo Agnolucci , Alberto Baldrati , Francesco Todino , Federico Becattini , Marco Bertini , Alberto Del Bimbo

Event extraction (EE), which acquires structural event knowledge from texts, can be divided into two sub-tasks: event type classification and element extraction (namely identifying triggers and arguments under different role patterns). As…

Computation and Language · Computer Science 2022-08-19 Qian Li , Shu Guo , Jia Wu , Jianxin Li , Jiawei Sheng , Lihong Wang , Xiaohan Dong , Hao Peng

Event extraction is typically modeled as a multi-class classification problem where event types and argument roles are treated as atomic symbols. These approaches are usually limited to a set of pre-defined types. We propose a novel event…

Computation and Language · Computer Science 2022-03-23 Sijia Wang , Mo Yu , Shiyu Chang , Lichao Sun , Lifu Huang

We present a system for rapidly customizing event extraction capability to find new event types and their arguments. The system allows a user to find, expand and filter event triggers for a new event type by exploring an unannotated corpus.…

Computation and Language · Computer Science 2018-09-24 Yee Seng Chan , Joshua Fasching , Haoling Qiu , Bonan Min

This paper surveys and organizes research works in a new paradigm in natural language processing, which we dub "prompt-based learning". Unlike traditional supervised learning, which trains a model to take in an input x and predict an output…

Computation and Language · Computer Science 2021-07-30 Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , Graham Neubig

Pre-trained language models have shown excellent results in few-shot learning scenarios using in-context learning. Although it is impressive, the size of language models can be prohibitive to make them usable in on-device applications, such…

Computation and Language · Computer Science 2022-04-27 Navid Rezaei , Marek Z. Reformat

Script event prediction aims to predict the subsequent event given the context. This requires the capability to infer the correlations between events. Recent works have attempted to improve event correlation reasoning by using pretrained…

Computation and Language · Computer Science 2022-12-12 Fangqi Zhu , Jun Gao , Changlong Yu , Wei Wang , Chen Xu , Xin Mu , Min Yang , Ruifeng Xu

Large pre-trained language models (PLMs) have made significant progress in encoding world knowledge and spawned a new set of learning paradigms including zero-shot, few-shot, and in-context learning. Many language tasks can be modeled as a…

Computation and Language · Computer Science 2023-05-25 Debaditya Shome , Kuldeep Yadav

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Audio-text models trained via contrastive learning offer a practical approach to perform audio classification through natural language prompts, such as "this is a sound of" followed by category names. In this work, we explore alternative…

Sound · Computer Science 2024-09-23 Michel Olvera , Paraskevas Stamatiadis , Slim Essid

Language models are achieving impressive performance on various tasks by aggressively adopting inference-time prompting techniques, such as zero-shot and few-shot prompting. In this work, we introduce EchoPrompt, a simple yet effective…

Computation and Language · Computer Science 2024-02-22 Rajasekhar Reddy Mekala , Yasaman Razeghi , Sameer Singh