English
Related papers

Related papers: Multilingual Generative Language Models for Zero-S…

200 papers

Acoustic word embeddings (AWEs) are vector representations of spoken word segments. AWEs can be learned jointly with embeddings of character sequences, to generate phonetically meaningful embeddings of written words, or acoustically…

Computation and Language · Computer Science 2020-06-26 Yushi Hu , Shane Settle , Karen Livescu

Multilingual neural machine translation systems learn to map sentences of different languages into a common representation space. Intuitively, with a growing number of seen languages the encoder sentence representation grows more flexible…

Computation and Language · Computer Science 2024-08-06 Carlos Mullov , Ngoc-Quan Pham , Alexander Waibel

To extract the structured representations of open-domain events, Bayesian graphical models have made some progress. However, these approaches typically assume that all words in a document are generated from a single event. While this may be…

Computation and Language · Computer Science 2019-08-27 Rui Wang , Deyu Zhou , Yulan He

This research addresses the challenge of developing speech applications for zero-resource languages that lack labelled data. It specifically uses acoustic word embedding (AWE) -- fixed-dimensional representations of variable-duration speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-24 Christiaan Jacobs

Prior work on multilingual question answering has mostly focused on using large multilingual pre-trained language models (LM) to perform zero-shot language-wise learning: train a QA model on English and test on other languages. In this…

Computation and Language · Computer Science 2020-12-14 Mihaela Bornea , Lin Pan , Sara Rosenthal , Radu Florian , Avirup Sil

Document-level Event Argument Extraction (EAE) faces two challenges due to increased input length: 1) difficulty in distinguishing semantic boundaries between events, and 2) interference from redundant information. To address these issues,…

Computation and Language · Computer Science 2024-11-12 Jiaren Peng , Hongda Sun , Wenzhong Yang , Fuyuan Wei , Liang He , Liejun Wang

Neural network based approaches to automated story plot generation attempt to learn how to generate novel plots from a corpus of natural language plot summaries. Prior work has shown that a semantic abstraction of sentences called events…

Computation and Language · Computer Science 2023-01-19 Prithviraj Ammanabrolu , Ethan Tien , Wesley Cheung , Zhaochen Luo , William Ma , Lara J. Martin , Mark O. Riedl

The topic-to-essay generation task is a challenging natural language generation task that aims to generate paragraph-level text with high semantic coherence based on a given set of topic words. Previous work has focused on the introduction…

Computation and Language · Computer Science 2024-02-27 Jieyong Wang , Chunyao Song , Yihao Wu

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

Document-level event extraction (DEE) faces two main challenges: arguments-scattering and multi-event. Although previous methods attempt to address these challenges, they overlook the interference of event-unrelated sentences during event…

Computation and Language · Computer Science 2023-10-17 Gang Zhao , Yidong Shi , Shudong Lu , Xinjie Yang , Guanting Dong , Jian Xu , Xiaocheng Gong , Si Li

We study the selection of transfer languages for automatic abusive language detection. Instead of preparing a dataset for every language, we demonstrate the effectiveness of cross-lingual transfer learning for zero-shot abusive language…

Computation and Language · Computer Science 2022-06-07 Juuso Eronen , Michal Ptaszynski , Fumito Masui , Masaki Arata , Gniewosz Leliwa , Michal Wroczynski

Most studies on word-level Quality Estimation (QE) of machine translation focus on language-specific models. The obvious disadvantages of these approaches are the need for labelled data for each language pair and the high cost required to…

Computation and Language · Computer Science 2021-06-02 Tharindu Ranasinghe , Constantin Orasan , Ruslan Mitkov

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. While contextual embeddings have been shown to yield richer representations of meaning compared to their…

Computation and Language · Computer Science 2019-04-05 Tal Schuster , Ori Ram , Regina Barzilay , Amir Globerson

Nested Event Extraction (NEE) aims to extract complex event structures where an event contains other events as its arguments recursively. Nested events involve a kind of Pivot Elements (PEs) that simultaneously act as arguments of…

Computation and Language · Computer Science 2024-04-09 Weicheng Ren , Zixuan Li , Xiaolong Jin , Long Bai , Miao Su , Yantao Liu , Saiping Guan , Jiafeng Guo , Xueqi Cheng

Although large language models(LLMs) show amazing capabilities, among various exciting applications discovered for LLMs fall short in other low-resource languages. Besides, most existing methods depend on large-scale dialogue corpora and…

Computation and Language · Computer Science 2024-08-19 Yongkang Liu , Feng Shi , Daling Wang , Yifei Zhang , Hinrich Schütze

Recent progress in cross-lingual relation and event extraction use graph convolutional networks (GCNs) with universal dependency parses to learn language-agnostic sentence representations such that models trained on one language can be…

Computation and Language · Computer Science 2021-02-19 Wasi Uddin Ahmad , Nanyun Peng , Kai-Wei Chang

The lack of annotated data in many languages is a well-known challenge within the field of multilingual natural language processing (NLP). Therefore, many recent studies focus on zero-shot transfer learning and joint training across…

Computation and Language · Computer Science 2019-12-24 Niels van der Heijden , Samira Abnar , Ekaterina Shutova

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

Computation and Language · Computer Science 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

Adapters are light-weight modules that allow parameter-efficient fine-tuning of pretrained models. Specialized language and task adapters have recently been proposed to facilitate cross-lingual transfer of multilingual pretrained models…

Computation and Language · Computer Science 2021-09-13 Xinyi Wang , Yulia Tsvetkov , Sebastian Ruder , Graham Neubig

This paper presents multiple question generation strategies for document-level event argument extraction. These strategies do not require human involvement and result in uncontextualized questions as well as contextualized questions…

Computation and Language · Computer Science 2024-04-09 Md Nayem Uddin , Enfa Rose George , Eduardo Blanco , Steven Corman