English
Related papers

Related papers: Multilingual Neural Machine Translation with Langu…

200 papers

In a multilingual neural machine translation model that fully shares parameters across all languages, an artificial language token is usually used to guide translation into the desired target language. However, recent studies show that…

Computation and Language · Computer Science 2022-09-07 Renren Jin , Deyi Xiong

Parallel corpora are indispensable for training neural machine translation (NMT) models, and parallel corpora for most language pairs do not exist or are scarce. In such cases, pivot language NMT can be helpful where a pivot language is…

Computation and Language · Computer Science 2021-04-16 Raj Dabre , Aizhan Imankulova , Masahiro Kaneko , Abhisek Chakrabarty

We introduce ClusterLLM, a novel text clustering framework that leverages feedback from an instruction-tuned large language model, such as ChatGPT. Compared with traditional unsupervised methods that builds upon "small" embedders,…

Computation and Language · Computer Science 2023-11-07 Yuwei Zhang , Zihan Wang , Jingbo Shang

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

Computation and Language · Computer Science 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

The use of subword embedding has proved to be a major innovation in Neural Machine Translation (NMT). It helps NMT to learn better context vectors for Low Resource Languages (LRLs) so as to predict the target words by better modelling the…

Computation and Language · Computer Science 2023-05-23 Amit Kumar , Shantipriya Parida , Ajay Pratap , Anil Kumar Singh

There has been relatively little attention to incorporating linguistic prior to neural machine translation. Much of the previous work was further constrained to considering linguistic prior on the source side. In this paper, we propose a…

Computation and Language · Computer Science 2017-04-25 Akiko Eriguchi , Yoshimasa Tsuruoka , Kyunghyun Cho

Monolingual data have been demonstrated to be helpful in improving translation quality of both statistical machine translation (SMT) systems and neural machine translation (NMT) systems, especially in resource-poor or domain adaptation…

Computation and Language · Computer Science 2018-03-02 Zhirui Zhang , Shujie Liu , Mu Li , Ming Zhou , Enhong Chen

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised…

Computation and Language · Computer Science 2023-12-21 Isidora Chara Tourni , Derry Wijaya

High-quality machine translation (MT) can scale to hundreds of languages, setting a high bar for multilingual systems. However, compared to the world's 7,000 languages, current systems still offer only limited coverage: about 200 languages…

Multilingual neural machine translation (MNMT) aims to build a unified model for many language directions. Existing monolithic models for MNMT encounter two challenges: parameter interference among languages and inefficient inference for…

Computation and Language · Computer Science 2023-07-20 Fei Yuan , Yinquan Lu , WenHao Zhu , Lingpeng Kong , Lei Li , Yu Qiao , Jingjing Xu

Although neural machine translation (NMT) has advanced the state-of-the-art on various language pairs, the interpretability of NMT remains unsatisfactory. In this work, we propose to address this gap by focusing on understanding the…

Computation and Language · Computer Science 2019-09-18 Shilin He , Zhaopeng Tu , Xing Wang , Longyue Wang , Michael R. Lyu , Shuming Shi

Multilingual machine translation (MMT) benefits from cross-lingual transfer but is a challenging multitask optimization problem. This is partly because there is no clear framework to systematically learn language-specific parameters.…

Computation and Language · Computer Science 2023-02-13 Haoran Xu , Jean Maillard , Vedanuj Goswami

Ensembling is a well-known technique in neural machine translation (NMT) to improve system performance. Instead of a single neural net, multiple neural nets with the same topology are trained separately, and the decoder generates…

Computation and Language · Computer Science 2017-07-24 Felix Stahlberg , Bill Byrne

Embedding matrices are key components in neural natural language processing (NLP) models that are responsible to provide numerical representations of input tokens.\footnote{In this paper words and subwords are referred to as \textit{tokens}…

Computation and Language · Computer Science 2022-04-19 Krtin Kumar , Peyman Passban , Mehdi Rezagholizadeh , Yiu Sing Lau , Qun Liu

Learning word embeddings using distributional information is a task that has been studied by many researchers, and a lot of studies are reported in the literature. On the contrary, less studies were done for the case of multiple languages.…

Computation and Language · Computer Science 2020-04-15 Marco Berlot , Evan Kaplan

There has been a growing interest in developing multimodal machine translation (MMT) systems that enhance neural machine translation (NMT) with visual knowledge. This problem setup involves using images as auxiliary information during…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Devaansh Gupta , Siddhant Kharbanda , Jiawei Zhou , Wanhua Li , Hanspeter Pfister , Donglai Wei

Text clustering is a fundamental task in natural language processing, yet traditional clustering algorithms with pre-trained embeddings often struggle in domain-specific contexts without costly fine-tuning. Large language models (LLMs)…

Computation and Language · Computer Science 2025-12-05 Yiming Xu , Yuan Yuan , Vijay Viswanathan , Graham Neubig

Training mixed-domain translation models is a complex task that demands tailored architectures and costly data preparation techniques. In this work, we leverage federated learning (FL) in order to tackle the problem. Our investigation…

Computation and Language · Computer Science 2022-05-04 Peyman Passban , Tanya Roosta , Rahul Gupta , Ankit Chadha , Clement Chung

Most translation tasks among languages belong to the zero-resource translation problem where parallel corpora are unavailable. Multilingual neural machine translation (MNMT) enables one-pass translation using shared semantic space for all…

Computation and Language · Computer Science 2022-08-25 Jian Yang , Yuwei Yin , Shuming Ma , Dongdong Zhang , Shuangzhi Wu , Hongcheng Guo , Zhoujun Li , Furu Wei

Recent studies on the analysis of the multilingual representations focus on identifying whether there is an emergence of language-independent representations, or whether a multilingual model partitions its weights among different languages.…

Computation and Language · Computer Science 2021-06-01 Zae Myung Kim , Laurent Besacier , Vassilina Nikoulina , Didier Schwab