中文
相关论文

相关论文: Multilingual Generative Language Models for Zero-S…

200 篇论文

Zero-shot cross-lingual transfer is when a multilingual model is trained to perform a task in one language and then is applied to another language. Although the zero-shot cross-lingual transfer approach has achieved success in various…

计算与语言 · 计算机科学 2023-05-30 Tianjian Li , Kenton Murray

In this work we focus on transferring supervision signals of natural language generation (NLG) tasks between multiple languages. We propose to pretrain the encoder and the decoder of a sequence-to-sequence model under both monolingual and…

计算与语言 · 计算机科学 2019-11-25 Zewen Chi , Li Dong , Furu Wei , Wenhui Wang , Xian-Ling Mao , Heyan Huang

Zero-shot cross-lingual transfer learning has been shown to be highly challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between languages, such as in hate speech detection. In this paper, we…

计算与语言 · 计算机科学 2022-10-26 Syrielle Montariol , Arij Riabi , Djamé Seddah

This paper presents a question-answering approach to extract document-level event-argument structures. We automatically ask and answer questions for each argument type an event may have. Questions are generated using manually defined…

计算与语言 · 计算机科学 2024-04-26 Md Nayem Uddin , Enfa Rose George , Eduardo Blanco , Steven Corman

Event Extraction (EE), aiming to identify and classify event triggers and arguments from event mentions, has benefited from pre-trained language models (PLMs). However, existing PLM-based methods ignore the information of trigger/argument…

计算与语言 · 计算机科学 2023-05-22 Xingyu Bai , Taiqiang Wu , Han Guo , Zhe Zhao , Xuefeng Yang , Jiayi Li , Weijie Liu , Qi Ju , Weigang Guo , Yujiu Yang

Recent work in cross-lingual semantic parsing has successfully applied machine translation to localize parsers to new languages. However, these advances assume access to high-quality machine translation systems and word alignment tools. We…

计算与语言 · 计算机科学 2022-03-08 Tom Sherborne , Mirella Lapata

Structural extraction of events within discourse is critical since it avails a deeper understanding of communication patterns and behavior trends. Event argument extraction (EAE), at the core of event-centric understanding, is the task of…

计算与语言 · 计算机科学 2025-03-21 Xinliang Frederick Zhang , Carter Blum , Temma Choji , Shalin Shah , Alakananda Vempala

Document-level Event Argument Extraction (EAE) requires the model to extract arguments of multiple events from a single document. Considering the underlying dependencies between these events, recent efforts leverage the idea of "memory",…

计算与语言 · 计算机科学 2023-10-26 Quzhe Huang , Yanxi Zhang , Dongyan Zhao

Event extraction (EE) has considerably benefited from pre-trained language models (PLMs) by fine-tuning. However, existing pre-training methods have not involved modeling event characteristics, resulting in the developed EE models cannot…

计算与语言 · 计算机科学 2021-06-01 Ziqi Wang , Xiaozhi Wang , Xu Han , Yankai Lin , Lei Hou , Zhiyuan Liu , Peng Li , Juanzi Li , Jie Zhou

We revisit the classic problem of document-level role-filler entity extraction (REE) for template filling. We argue that sentence-level approaches are ill-suited to the task and introduce a generative transformer-based encoder-decoder…

计算与语言 · 计算机科学 2021-02-01 Xinya Du , Alexander M. Rush , Claire Cardie

Extracting informative arguments of events from news articles is a challenging problem in information extraction, which requires a global contextual understanding of each document. While recent work on document-level extraction has gone…

计算与语言 · 计算机科学 2022-09-20 Xinya Du , Sha Li , Heng Ji

Recent works in Event Argument Extraction (EAE) have focused on improving model generalizability to cater to new events and domains. However, standard benchmarking datasets like ACE and ERE cover less than 40 event types and 25…

计算与语言 · 计算机科学 2023-06-02 Tanmay Parekh , I-Hung Hsu , Kuan-Hao Huang , Kai-Wei Chang , Nanyun Peng

Document-level Event Argument Extraction (DEAE) aims to identify arguments and their specific roles from an unstructured document. The advanced approaches on DEAE utilize prompt-based methods to guide pre-trained language models (PLMs) in…

计算与语言 · 计算机科学 2024-03-18 Jian Zhang , Changlin Yang , Haiping Zhu , Qika Lin , Fangzhi Xu , Jun Liu

Large pre-trained models exhibit distinct and complementary capabilities dependent on the data they are trained on. Language models such as GPT-3 are capable of textual reasoning but cannot understand visual information, while vision models…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Shuang Li , Yilun Du , Joshua B. Tenenbaum , Antonio Torralba , Igor Mordatch

Acoustic word embeddings are fixed-dimensional representations of variable-length speech segments. Such embeddings can form the basis for speech search, indexing and discovery systems when conventional speech recognition is not possible. In…

计算与语言 · 计算机科学 2021-02-08 Herman Kamper , Yevgen Matusevych , Sharon Goldwater

Recent mainstream event argument extraction methods process each event in isolation, resulting in inefficient inference and ignoring the correlations among multiple events. To address these limitations, here we propose a multiple-event…

计算与语言 · 计算机科学 2024-06-18 Wanlong Liu , Li Zhou , Dingyi Zeng , Yichen Xiao , Shaohuan Cheng , Chen Zhang , Grandee Lee , Malu Zhang , Wenyu Chen

Transfer learning between different language pairs has shown its effectiveness for Neural Machine Translation (NMT) in low-resource scenario. However, existing transfer methods involving a common target language are far from success in the…

计算与语言 · 计算机科学 2019-12-04 Baijun Ji , Zhirui Zhang , Xiangyu Duan , Min Zhang , Boxing Chen , Weihua Luo

The problem of event extraction requires detecting the event trigger and extracting its corresponding arguments. Existing work in event argument extraction typically relies heavily on entity recognition as a preprocessing/concurrent step,…

计算与语言 · 计算机科学 2021-02-08 Xinya Du , Claire Cardie

Most previous event extraction studies have relied heavily on features derived from annotated event mentions, thus cannot be applied to new event types without annotation effort. In this work, we take a fresh look at event extraction and…

计算与语言 · 计算机科学 2017-07-05 Lifu Huang , Heng Ji , Kyunghyun Cho , Clare R. Voss

Lexical simplification (LS) methods based on pretrained language models have made remarkable progress, generating potential substitutes for a complex word through analysis of its contextual surroundings. However, these methods require…

计算与语言 · 计算机科学 2023-07-31 Kang Liu , Jipeng Qiang , Yun Li , Yunhao Yuan , Yi Zhu , Kaixun Hua