English
Related papers

Related papers: Unlikelihood Tuning on Negative Samples Amazingly …

200 papers

In this paper, we proposed two strategies which can be applied to a multilingual neural machine translation system in order to better tackle zero-shot scenarios despite not having any parallel corpus. The experiments show that they are…

Computation and Language · Computer Science 2017-11-23 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Multilingual neural machine translation systems learn to map sentences of different languages into a common representation space. Intuitively, with a growing number of seen languages the encoder sentence representation grows more flexible…

Computation and Language · Computer Science 2024-08-06 Carlos Mullov , Ngoc-Quan Pham , Alexander Waibel

Massively Multilingual Transformer based Language Models have been observed to be surprisingly effective on zero-shot transfer across languages, though the performance varies from language to language depending on the pivot language(s) used…

Computation and Language · Computer Science 2022-05-13 Kabir Ahuja , Shanu Kumar , Sandipan Dandapat , Monojit Choudhury

Instruction tuning (IT) is widely used to teach pretrained large language models (LLMs) to follow arbitrary instructions, but is under-studied in multilingual settings. In this work, we conduct a systematic study of zero-shot cross-lingual…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Vassilina Nikoulina

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

Translation-tailored Large language models (LLMs) exhibit remarkable translation capabilities, even competing with supervised-trained commercial translation systems. However, off-target translation remains an unsolved problem, especially…

Computation and Language · Computer Science 2024-03-22 Changtong Zan , Liang Ding , Li Shen , Yibing Zhen , Weifeng Liu , Dacheng Tao

Zero-Shot Cross-lingual Transfer (ZS-XLT) utilizes a model trained in a source language to make predictions in another language, often with a performance loss. To alleviate this, additional improvements can be achieved through subsequent…

Computation and Language · Computer Science 2024-04-04 Emilio Villa-Cueva , A. Pastor López-Monroy , Fernando Sánchez-Vega , Thamar Solorio

Pretrained multilingual encoders enable zero-shot cross-lingual transfer, but often produce unreliable models that exhibit high performance variance on the target language. We postulate that this high variance results from zero-shot…

Computation and Language · Computer Science 2022-07-13 Shijie Wu , Benjamin Van Durme , Mark Dredze

Recently, data-driven task-oriented dialogue systems have achieved promising performance in English. However, developing dialogue systems that support low-resource languages remains a long-standing challenge due to the absence of…

Computation and Language · Computer Science 2019-11-22 Zihan Liu , Genta Indra Winata , Zhaojiang Lin , Peng Xu , Pascale Fung

This paper proposes a simple yet effective method to improve direct (X-to-Y) translation for both cases: zero-shot and when direct data is available. We modify the input tokens at both the encoder and decoder to include signals for the…

Computation and Language · Computer Science 2022-08-12 Muhammad ElNokrashy , Amr Hendy , Mohamed Maher , Mohamed Afify , Hany Hassan Awadalla

Current multimodal machine translation (MMT) systems rely on fully supervised data (i.e models are trained on sentences with their translations and accompanying images). However, this type of data is costly to collect, limiting the…

Computation and Language · Computer Science 2025-03-12 Matthieu Futeral , Cordelia Schmid , Benoît Sagot , Rachel Bawden

Hallucinations and off-target translation remain unsolved problems in MT, especially for low-resource languages and massively multilingual models. In this paper, we introduce two related methods to mitigate these failure cases with a…

Computation and Language · Computer Science 2024-01-30 Rico Sennrich , Jannis Vamvas , Alireza Mohammadshahi

The language-independency of encoded representations within multilingual neural machine translation (MNMT) models is crucial for their generalization ability on zero-shot translation. Neural interlingua representations have been shown as an…

Computation and Language · Computer Science 2023-05-18 Zhuoyuan Mao , Haiyue Song , Raj Dabre , Chenhui Chu , Sadao Kurohashi

Zero-shot cross-lingual knowledge transfer enables a multilingual pretrained language model, finetuned on a task in one language, make predictions for this task in other languages. While being broadly studied for natural language…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Vassilina Nikoulina

Predicting user intent and detecting the corresponding slots from text are two key problems in Natural Language Understanding (NLU). In the context of zero-shot learning, this task is typically approached by either using representations…

Computation and Language · Computer Science 2021-03-17 Jitin Krishnan , Antonios Anastasopoulos , Hemant Purohit , Huzefa Rangwala

In this work, we show a novel method for neural machine translation (NMT), using a denoising diffusion probabilistic model (DDPM), adjusted for textual data, following recent advances in the field. We show that it's possible to translate…

Computation and Language · Computer Science 2021-11-03 Eliya Nachmani , Shaked Dovrat

Cross-lingual adaptation with multilingual pre-trained language models (mPTLMs) mainly consists of two lines of works: zero-shot approach and translation-based approach, which have been studied extensively on the sequence-level tasks. We…

Computation and Language · Computer Science 2021-06-23 Xin Li , Lidong Bing , Wenxuan Zhang , Zheng Li , Wai Lam

We propose a new paradigm for zero-shot learners that is format agnostic, i.e., it is compatible with any format and applicable to a list of language tasks, such as text classification, commonsense reasoning, coreference resolution, and…

Computation and Language · Computer Science 2022-10-19 Ping Yang , Junjie Wang , Ruyi Gan , Xinyu Zhu , Lin Zhang , Ziwei Wu , Xinyu Gao , Jiaxing Zhang , Tetsuya Sakai

Zero-shot In-context learning is the phenomenon where models can perform the task simply given the instructions. However, pre-trained large language models are known to be poorly calibrated for this task. One of the most effective…

Computation and Language · Computer Science 2024-04-04 Suzanna Sia , Alexandra DeLucia , Kevin Duh

Most of the recent work in leveraging Large Language Models (LLMs) such as GPT-3 for Machine Translation (MT) has focused on selecting the few-shot samples for prompting. In this work, we try to better understand the role of demonstration…

Computation and Language · Computer Science 2023-10-25 Vikas Raunak , Hany Hassan Awadalla , Arul Menezes