English
Related papers

Related papers: Neural Machine Translation Data Generation and Aug…

200 papers

Recently, mT5 - a massively multilingual version of T5 - leveraged a unified text-to-text format to attain state-of-the-art results on a wide variety of multilingual NLP tasks. In this paper, we investigate the impact of incorporating…

Computation and Language · Computer Science 2021-06-07 Mihir Kale , Aditya Siddhant , Noah Constant , Melvin Johnson , Rami Al-Rfou , Linting Xue

Recent advances in natural language processing (NLP), particularly large language models (LLMs), have motivated the automatic translation of natural language statements into formal logic without human intervention. This enables automated…

Computation and Language · Computer Science 2025-12-03 Muyu Pan , Dheeraj Kodakandla , Mahfuza Farooque

Although the parallel corpus has an irreplaceable role in machine translation, its scale and coverage is still beyond the actual needs. Non-parallel corpus resources on the web have an inestimable potential value in machine translation and…

Computation and Language · Computer Science 2014-05-23 Lijiang Chen

The goal of universal machine translation is to learn to translate between any pair of languages, given a corpus of paired translated documents for \emph{a small subset} of all pairs of languages. Despite impressive empirical results and an…

Machine Learning · Computer Science 2020-08-12 Han Zhao , Junjie Hu , Andrej Risteski

We propose a neural machine translation architecture that models the surrounding text in addition to the source sentence. These models lead to better performance, both in terms of general translation quality and pronoun prediction, when…

Machine Learning · Statistics 2017-04-19 Sebastien Jean , Stanislas Lauly , Orhan Firat , Kyunghyun Cho

In this paper, we show that the combination of Phrase Pair Injection and Corpus Filtering boosts the performance of Neural Machine Translation (NMT) systems. We extract parallel phrases and sentences from the pseudo-parallel corpus and…

Computation and Language · Computer Science 2023-01-20 Akshay Batheja , Pushpak Bhattacharyya

Large-scale language models, like ChatGPT, have garnered significant media attention and stunned the public with their remarkable capacity for generating coherent text from short natural language prompts. In this paper, we aim to conduct a…

Computation and Language · Computer Science 2024-12-11 Dongqi Liu , Vera Demberg

Generative AI has significantly reduced the entry barrier to the domain of AI owing to the ease of use and core capabilities of automation, translation, and intelligent actions in our day to day lives. Currently, Large language models…

Computation and Language · Computer Science 2023-11-21 Sohini Roychowdhury

Neural machine translation (NMT) has become the de-facto standard in real-world machine translation applications. However, NMT models can unpredictably produce severely pathological translations, known as hallucinations, that seriously…

Computation and Language · Computer Science 2023-05-22 Nuno M. Guerreiro , Pierre Colombo , Pablo Piantanida , André F. T. Martins

In the current work, we explore the enrichment in the machine translation output when the training parallel corpus is augmented with the introduction of sentiment analysis. The paper discusses the preparation of the same sentiment tagged…

Computation and Language · Computer Science 2020-07-29 Sainik Kumar Mahata , Amrita Chandra , Dipankar Das , Sivaji Bandyopadhyay

Generative Pre-trained Transformer (GPT) is a state-of-the-art machine learning model capable of generating human-like text through natural language processing (NLP). GPT is trained on massive amounts of text data and uses deep learning…

With a large amount of parallel data, neural machine translation systems are able to deliver human-level performance for sentence-level translation. However, it is costly to label a large amount of parallel data by humans. In contrast,…

Computation and Language · Computer Science 2020-09-21 Guokun Lai , Zihang Dai , Yiming Yang

In this paper, a novel approach is proposed to automatically construct parallel discourse corpus for dialogue machine translation. Firstly, the parallel subtitle data and its corresponding monolingual movie script data are crawled and…

Computation and Language · Computer Science 2016-05-24 Longyue Wang , Xiaojun Zhang , Zhaopeng Tu , Andy Way , Qun Liu

Conventional retrieval-augmented neural machine translation (RANMT) systems leverage bilingual corpora, e.g., translation memories (TMs). Yet, in many settings, monolingual corpora in the target language are often available. This work…

Computation and Language · Computer Science 2025-10-02 Maxime Bouthors , Josep Crego , François Yvon

We propose a Bayesian model of unsupervised semantic role induction in multiple languages, and use it to explore the usefulness of parallel corpora for this task. Our joint Bayesian model consists of individual models for each language plus…

Computation and Language · Computer Science 2016-03-07 Nikhil Garg , James Henderson

Existing neural machine translation systems do not explicitly model what has been translated and what has not during the decoding phase. To address this problem, we propose a novel mechanism that separates the source information into two…

Computation and Language · Computer Science 2017-12-27 Zaixiang Zheng , Hao Zhou , Shujian Huang , Lili Mou , Xinyu Dai , Jiajun Chen , Zhaopeng Tu

ChatGPT has gained both positive and negative publicity after reports suggesting that it is able to pass various professional and licensing examinations. This suggests that ChatGPT may pass Turing Test in the near future. However, a…

Computation and Language · Computer Science 2023-04-26 Maurice HT Ling

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for…

Computation and Language · Computer Science 2022-01-06 Xu Zhang , Jian Yang , Haoyang Huang , Shuming Ma , Dongdong Zhang , Jinlong Li , Furu Wei

Designing better machine translation systems by considering auxiliary inputs such as images has attracted much attention in recent years. While existing methods show promising performance over the conventional text-only translation systems,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Yi Li , Rameswar Panda , Yoon Kim , Chun-Fu Chen , Rogerio Feris , David Cox , Nuno Vasconcelos