English
Related papers

Related papers: Gaussian Multi-head Attention for Simultaneous Mac…

200 papers

Existing neural machine translation (NMT) studies mainly focus on developing dataset-specific models based on data from different tasks (e.g., document translation and chat translation). Although the dataset-specific models have achieved…

Computation and Language · Computer Science 2023-05-19 Yunlong Liang , Fandong Meng , Jinan Xu , Jiaan Wang , Yufeng Chen , Jie Zhou

Unsupervised machine translation (MT) has recently achieved impressive results with monolingual corpora only. However, it is still challenging to associate source-target sentences in the latent space. As people speak different languages…

Computation and Language · Computer Science 2020-05-08 Po-Yao Huang , Junjie Hu , Xiaojun Chang , Alexander Hauptmann

Transfer learning approaches for Neural Machine Translation (NMT) train a NMT model on the assisting-target language pair (parent model) which is later fine-tuned for the source-target language pair of interest (child model), with the…

Computation and Language · Computer Science 2019-04-11 Rudra Murthy , Anoop Kunchukuttan , Pushpak Bhattacharyya

This paper studies the problem of sequential Gaussian shift-in-mean hypothesis testing in a distributed multi-agent network. A sequential probability ratio test (SPRT) type algorithm in a distributed framework of the…

Optimization and Control · Mathematics 2015-09-02 Anit Kumar Sahu , Soummya Kar

The growing popularity of neural machine translation (NMT) and LLMs represented by ChatGPT underscores the need for a deeper understanding of their distinct characteristics and relationships. Such understanding is crucial for language…

Computation and Language · Computer Science 2024-10-15 Zhaokun Jiang , Qianxi Lv , Ziyin Zhang , Lei Lei

We propose a semi-supervised generative model, SeGMA, which learns a joint probability distribution of data and their classes and which is implemented in a typical Wasserstein auto-encoder framework. We choose a mixture of Gaussians as a…

Machine Learning · Computer Science 2020-08-28 Marek Śmieja , Maciej Wołczyk , Jacek Tabor , Bernhard C. Geiger

Unsupervised word translation from non-parallel inter-lingual corpora has attracted much research interest. Very recently, neural network methods trained with adversarial loss functions achieved high accuracy on this task. Despite the…

Machine Learning · Computer Science 2018-08-15 Yedid Hoshen , Lior Wolf

State-of-the-art text-to-image models produce visually impressive results but often struggle with precise alignment to text prompts, leading to missing critical elements or unintended blending of distinct concepts. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Paul Grimal , Michaël Soumm , Hervé Le Borgne , Olivier Ferret , Akihiro Sugimoto

Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation…

Computation and Language · Computer Science 2020-03-31 Pei Zhang , Xu Zhang , Wei Chen , Jian Yu , Yanfeng Wang , Deyi Xiong

Utilizing well-trained representations in transfer learning often results in superior performance and faster convergence compared to training from scratch. However, even if such good representations are transferred, a model can easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 SeokHyun Seo , Jinwoo Hong , JungWoo Chae , Kyungyul Kim , Sangheum Hwang

Simultaneous machine translation (SimulMT) models start translation before the end of the source sentence, making the translation monotonically aligned with the source sentence. However, the general full-sentence translation test set is…

Computation and Language · Computer Science 2023-03-14 Mengge Liu , Wen Zhang , Xiang Li , Jian Luan , Bin Wang , Yuhang Guo , Shuoying Chen

High-performing machine translation (MT) systems can help overcome language barriers while making it possible for everyone to communicate and use language technologies in the language of their choice. However, such systems require large…

Computation and Language · Computer Science 2021-06-15 Rajat Bhatnagar , Ananya Ganesh , Katharina Kann

In this paper, we introduce a hybrid search for attention-based neural machine translation (NMT). A target phrase learned with statistical MT models extends a hypothesis in the NMT beam search when the attention of the NMT model focuses on…

Computation and Language · Computer Science 2017-08-11 Leonard Dahlmann , Evgeny Matusov , Pavel Petrushkov , Shahram Khadivi

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understanding the meaning of the sentence. We propose a method to alleviate this problem by augmenting NMT systems with…

Computation and Language · Computer Science 2016-10-06 Philip Arthur , Graham Neubig , Satoshi Nakamura

In the online world, Machine Translation (MT) systems are extensively used to translate User-Generated Text (UGT) such as reviews, tweets, and social media posts, where the main message is often the author's positive or negative attitude…

Computation and Language · Computer Science 2023-06-09 Hadeel Saadany , Constantin Orasan , Emad Mohamed , Ashraf Tantawy

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Simultaneous Machine Translation is the task of incrementally translating an input sentence before it is fully available. Currently, simultaneous translation is carried out by translating each sentence independently of the previously…

Computation and Language · Computer Science 2022-04-01 Javier Iranzo-Sánchez , Jorge Civera , Alfons Juan

Multi-modal machine translation aims at translating the source sentence into a different language in the presence of the paired image. Previous work suggests that additional visual information only provides dispensable help to translation,…

Computation and Language · Computer Science 2019-12-30 Pengcheng Yang , Boxing Chen , Pei Zhang , Xu Sun