English
Related papers

Related papers: Towards Zero-Shot Multimodal Machine Translation

200 papers

Multilingual neural machine translation systems learn to map sentences of different languages into a common representation space. Intuitively, with a growing number of seen languages the encoder sentence representation grows more flexible…

Computation and Language · Computer Science 2024-08-06 Carlos Mullov , Ngoc-Quan Pham , Alexander Waibel

Massively Multilingual Language Models (MMLMs) have recently gained popularity due to their surprising effectiveness in cross-lingual transfer. While there has been much work in evaluating these models for their performance on a variety of…

Computation and Language · Computer Science 2022-10-25 Kabir Ahuja , Sunayana Sitaram , Sandipan Dandapat , Monojit Choudhury

Unsupervised machine translation, which utilizes unpaired monolingual corpora as training data, has achieved comparable performance against supervised machine translation. However, it still suffers from data-scarce domains. To address this…

Computation and Language · Computer Science 2021-05-10 Cheonbok Park , Yunwon Tae , Taehee Kim , Soyoung Yang , Mohammad Azam Khan , Eunjeong Park , Jaegul Choo

One of the things that need to change when it comes to machine translation is the models' ability to translate code-switching content, especially with the rise of social media and user-generated content. In this paper, we are proposing a…

Computation and Language · Computer Science 2023-09-12 Mohamed Anwar

Zero-shot translation is a promising direction for building a comprehensive multilingual neural machine translation~(MNMT) system. However, its quality is still not satisfactory due to off-target issues. In this paper, we aim to understand…

Computation and Language · Computer Science 2024-10-22 Wenxuan Wang , Wenxiang Jiao , Shuo Wang , Zhaopeng Tu , Michael R. Lyu

The capability to jointly process multi-modal information is becoming an essential task. However, the limited number of paired multi-modal data and the large computational requirements in multi-modal learning hinder the development. We…

Computation and Language · Computer Science 2025-06-09 Minsu Kim , Jee-weon Jung , Hyeongseop Rha , Soumi Maiti , Siddhant Arora , Xuankai Chang , Shinji Watanabe , Yong Man Ro

A rising interest in the modality extension of foundation language models warrants discussion on the most effective, and efficient, multimodal training approach. This work focuses on neural machine translation (NMT) and proposes a joint…

While billions of non-English speaking users rely on search engines every day, the problem of ad-hoc information retrieval is rarely studied for non-English languages. This is primarily due to a lack of data set that are suitable to train…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Luca Soldaini , Nazli Goharian

Because it is not feasible to collect training data for every language, there is a growing interest in cross-lingual transfer learning. In this paper, we systematically explore zero-shot cross-lingual transfer learning on reading…

Computation and Language · Computer Science 2019-09-23 Tsung-yuan Hsu , Chi-liang Liu , Hung-yi Lee

The scarcity of parallel data is a major obstacle for training high-quality machine translation systems for low-resource languages. Fortunately, some low-resource languages are linguistically related or similar to high-resource languages;…

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Multilingual semantic parsing is a cost-effective method that allows a single model to understand different languages. However, researchers face a great imbalance of availability of training data, with English being resource rich, and other…

Computation and Language · Computer Science 2021-06-15 Menglin Xia , Emilio Monti

Machine translation has an undesirable propensity to produce "translationese" artifacts, which can lead to higher BLEU scores while being liked less by human raters. Motivated by this, we model translationese and original (i.e. natural)…

Computation and Language · Computer Science 2020-07-13 Parker Riley , Isaac Caswell , Markus Freitag , David Grangier

In this work, we show a novel method for neural machine translation (NMT), using a denoising diffusion probabilistic model (DDPM), adjusted for textual data, following recent advances in the field. We show that it's possible to translate…

Computation and Language · Computer Science 2021-11-03 Eliya Nachmani , Shaked Dovrat

We present a new approach to perform zero-shot cross-modal transfer between speech and text for translation tasks. Multilingual speech and text are encoded in a joint fixed-size representation space. Then, we compare different approaches to…

Computation and Language · Computer Science 2022-11-11 Paul-Ambroise Duquenne , Hongyu Gong , Benoît Sagot , Holger Schwenk

Pretrained language models are promising particularly for low-resource languages as they only require unlabelled data. However, training existing models requires huge amounts of compute, while pretrained cross-lingual models often…

Computation and Language · Computer Science 2020-06-05 Julian Martin Eisenschlos , Sebastian Ruder , Piotr Czapla , Marcin Kardas , Sylvain Gugger , Jeremy Howard

Although the multilingual Neural Machine Translation(NMT), which extends Google's multilingual NMT, has ability to perform zero-shot translation and the iterative self-learning algorithm can improve the quality of zero-shot translation, it…

Computation and Language · Computer Science 2021-10-05 Chenyang Li , Gongxu Luo

Even with the latest developments in deep learning and large-scale language modeling, the task of machine translation (MT) of low-resource languages remains a challenge. Neural MT systems can be trained in an unsupervised way without any…

Computation and Language · Computer Science 2023-10-24 Ivana Kvapilíková , Ondřej Bojar

We propose a two-stage approach for training a single NMT model to translate unseen languages both to and from English. For the first stage, we initialize an encoder-decoder model to pretrained XLM-R and RoBERTa weights, then perform…

Computation and Language · Computer Science 2023-04-05 Bryan Li , Mohammad Sadegh Rasooli , Ajay Patel , Chris Callison-Burch

Recently, universal neural machine translation (NMT) with shared encoder-decoder gained good performance on zero-shot translation. Unlike universal NMT, jointly trained language-specific encoders-decoders aim to achieve universal…

Computation and Language · Computer Science 2021-02-15 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Hong Qu , Michael Zeng