中文
相关论文

相关论文: Multilingual Generative Language Models for Zero-S…

200 篇论文

Acoustic word embeddings (AWEs) are vector representations of spoken word segments. AWEs can be learned jointly with embeddings of character sequences, to generate phonetically meaningful embeddings of written words, or acoustically…

计算与语言 · 计算机科学 2020-06-26 Yushi Hu , Shane Settle , Karen Livescu

Multilingual neural machine translation systems learn to map sentences of different languages into a common representation space. Intuitively, with a growing number of seen languages the encoder sentence representation grows more flexible…

计算与语言 · 计算机科学 2024-08-06 Carlos Mullov , Ngoc-Quan Pham , Alexander Waibel

To extract the structured representations of open-domain events, Bayesian graphical models have made some progress. However, these approaches typically assume that all words in a document are generated from a single event. While this may be…

计算与语言 · 计算机科学 2019-08-27 Rui Wang , Deyu Zhou , Yulan He

This research addresses the challenge of developing speech applications for zero-resource languages that lack labelled data. It specifically uses acoustic word embedding (AWE) -- fixed-dimensional representations of variable-duration speech…

音频与语音处理 · 电气工程与系统科学 2024-01-24 Christiaan Jacobs

Prior work on multilingual question answering has mostly focused on using large multilingual pre-trained language models (LM) to perform zero-shot language-wise learning: train a QA model on English and test on other languages. In this…

计算与语言 · 计算机科学 2020-12-14 Mihaela Bornea , Lin Pan , Sara Rosenthal , Radu Florian , Avirup Sil

Document-level Event Argument Extraction (EAE) faces two challenges due to increased input length: 1) difficulty in distinguishing semantic boundaries between events, and 2) interference from redundant information. To address these issues,…

计算与语言 · 计算机科学 2024-11-12 Jiaren Peng , Hongda Sun , Wenzhong Yang , Fuyuan Wei , Liang He , Liejun Wang

Neural network based approaches to automated story plot generation attempt to learn how to generate novel plots from a corpus of natural language plot summaries. Prior work has shown that a semantic abstraction of sentences called events…

计算与语言 · 计算机科学 2023-01-19 Prithviraj Ammanabrolu , Ethan Tien , Wesley Cheung , Zhaochen Luo , William Ma , Lara J. Martin , Mark O. Riedl

The topic-to-essay generation task is a challenging natural language generation task that aims to generate paragraph-level text with high semantic coherence based on a given set of topic words. Previous work has focused on the introduction…

计算与语言 · 计算机科学 2024-02-27 Jieyong Wang , Chunyao Song , Yihao Wu

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

计算与语言 · 计算机科学 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

Document-level event extraction (DEE) faces two main challenges: arguments-scattering and multi-event. Although previous methods attempt to address these challenges, they overlook the interference of event-unrelated sentences during event…

计算与语言 · 计算机科学 2023-10-17 Gang Zhao , Yidong Shi , Shudong Lu , Xinjie Yang , Guanting Dong , Jian Xu , Xiaocheng Gong , Si Li

We study the selection of transfer languages for automatic abusive language detection. Instead of preparing a dataset for every language, we demonstrate the effectiveness of cross-lingual transfer learning for zero-shot abusive language…

计算与语言 · 计算机科学 2022-06-07 Juuso Eronen , Michal Ptaszynski , Fumito Masui , Masaki Arata , Gniewosz Leliwa , Michal Wroczynski

Most studies on word-level Quality Estimation (QE) of machine translation focus on language-specific models. The obvious disadvantages of these approaches are the need for labelled data for each language pair and the high cost required to…

计算与语言 · 计算机科学 2021-06-02 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their…

计算与语言 · 计算机科学 2019-04-05 Tal Schuster , Ori Ram , Regina Barzilay , Amir Globerson

Nested Event Extraction (NEE) aims to extract complex event structures where an event contains other events as its arguments recursively. Nested events involve a kind of Pivot Elements (PEs) that simultaneously act as arguments of…

计算与语言 · 计算机科学 2024-04-09 Weicheng Ren , Zixuan Li , Xiaolong Jin , Long Bai , Miao Su , Yantao Liu , Saiping Guan , Jiafeng Guo , Xueqi Cheng

Although large language models(LLMs) show amazing capabilities, among various exciting applications discovered for LLMs fall short in other low-resource languages. Besides, most existing methods depend on large-scale dialogue corpora and…

计算与语言 · 计算机科学 2024-08-19 Yongkang Liu , Feng Shi , Daling Wang , Yifei Zhang , Hinrich Schütze

Recent progress in cross-lingual relation and event extraction use graph convolutional networks (GCNs) with universal dependency parses to learn language-agnostic sentence representations such that models trained on one language can be…

计算与语言 · 计算机科学 2021-02-19 Wasi Uddin Ahmad , Nanyun Peng , Kai-Wei Chang

The lack of annotated data in many languages is a well-known challenge within the field of multilingual natural language processing (NLP). Therefore, many recent studies focus on zero-shot transfer learning and joint training across…

计算与语言 · 计算机科学 2019-12-24 Niels van der Heijden , Samira Abnar , Ekaterina Shutova

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

计算与语言 · 计算机科学 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

Adapters are light-weight modules that allow parameter-efficient fine-tuning of pretrained models. Specialized language and task adapters have recently been proposed to facilitate cross-lingual transfer of multilingual pretrained models…

计算与语言 · 计算机科学 2021-09-13 Xinyi Wang , Yulia Tsvetkov , Sebastian Ruder , Graham Neubig

This paper presents multiple question generation strategies for document-level event argument extraction. These strategies do not require human involvement and result in uncontextualized questions as well as contextualized questions…

计算与语言 · 计算机科学 2024-04-09 Md Nayem Uddin , Enfa Rose George , Eduardo Blanco , Steven Corman