English
Related papers

Related papers: Neural Machine Translation for Code Generation

200 papers

Machine translation systems are conventionally trained on textual resources that do not model phenomena that occur in spoken language. While the evaluation of neural machine translation systems on textual inputs is actively researched in…

Computation and Language · Computer Science 2019-04-26 Nicholas Ruiz , Mattia Antonino Di Gangi , Nicola Bertoldi , Marcello Federico

Neural models have drastically advanced state of the art for machine translation (MT) between high-resource languages. Traditionally, these models rely on large amounts of training data, but many language pairs lack these resources.…

Computation and Language · Computer Science 2023-06-13 Manuel Mager , Rajat Bhatnagar , Graham Neubig , Ngoc Thang Vu , Katharina Kann

Recent years have witnessed the rapid advance in neural machine translation (NMT), the core of which lies in the encoder-decoder architecture. Inspired by the recent progress of large-scale pre-trained language models on machine translation…

Computation and Language · Computer Science 2021-06-28 Shuo Wang , Zhaopeng Tu , Zhixing Tan , Wenxuan Wang , Maosong Sun , Yang Liu

Phrases play an important role in natural language understanding and machine translation (Sag et al., 2002; Villavicencio et al., 2005). However, it is difficult to integrate them into current neural machine translation (NMT) which reads…

Computation and Language · Computer Science 2017-08-08 Xing Wang , Zhaopeng Tu , Deyi Xiong , Min Zhang

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Derek F. Wong , Yikai Zhou , Lidia S. Chao , Haibo Zhang , Boxing Chen

We describe an open-source toolkit for neural machine translation (NMT). The toolkit prioritizes efficiency, modularity, and extensibility with the goal of supporting NMT research into model architectures, feature representations, and…

Computation and Language · Computer Science 2017-03-07 Guillaume Klein , Yoon Kim , Yuntian Deng , Jean Senellart , Alexander M. Rush

In this paper, we explore a simple solution to "Multi-Source Neural Machine Translation" (MSNMT) which only relies on preprocessing a N-way multilingual corpus without modifying the Neural Machine Translation (NMT) architecture or training…

Computation and Language · Computer Science 2019-03-05 Raj Dabre , Fabien Cromieres , Sadao Kurohashi

We introduce an open-source toolkit for neural machine translation (NMT) to support research into model architectures, feature representations, and source modalities, while maintaining competitive performance, modularity and reasonable…

Computation and Language · Computer Science 2017-09-13 Guillaume Klein , Yoon Kim , Yuntian Deng , Josep Crego , Jean Senellart , Alexander M. Rush

Writing software exploits is an important practice for offensive security analysts to investigate and prevent attacks. In particular, shellcodes are especially time-consuming and a technical challenge, as they are written in assembly…

Software Engineering · Computer Science 2022-03-09 Pietro Liguori , Erfan Al-Hossami , Domenico Cotroneo , Roberto Natella , Bojan Cukic , Samira Shaikh

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

Computation and Language · Computer Science 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

This paper proposes a novel method to inject custom terminology into neural machine translation at run time. Previous works have mainly proposed modifications to the decoding algorithm in order to constrain the output to include…

Computation and Language · Computer Science 2019-06-26 Georgiana Dinu , Prashant Mathur , Marcello Federico , Yaser Al-Onaizan

Improving neural machine translation (NMT) systems with prompting has achieved significant progress in recent years. In this work, we focus on how to integrate multi-knowledge, multiple types of knowledge, into NMT models to enhance the…

Computation and Language · Computer Science 2023-12-11 Ke Wang , Jun Xie , Yuqi Zhang , Yu Zhao

We propose a novel decoding approach for neural machine translation (NMT) based on continuous optimisation. We convert decoding - basically a discrete optimization problem - into a continuous optimization problem. The resulting constrained…

Computation and Language · Computer Science 2017-07-25 Cong Duy Vu Hoang , Gholamreza Haffari , Trevor Cohn

Code search is a task to find programming codes that semantically match the given natural language queries. Even though some of the existing datasets for this task are multilingual on the programming language side, their query data are only…

Computation and Language · Computer Science 2023-06-28 Ryo Sekizawa , Nan Duan , Shuai Lu , Hitomi Yanaka

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

Computation and Language · Computer Science 2018-12-19 Markus Freitag , Yaser Al-Onaizan

In this paper, we propose Neural Phrase-to-Phrase Machine Translation (NP$^2$MT). Our model uses a phrase attention mechanism to discover relevant input (source) segments that are used by a decoder to generate output (target) phrases. We…

Computation and Language · Computer Science 2018-11-07 Jiangtao Feng , Lingpeng Kong , Po-Sen Huang , Chong Wang , Da Huang , Jiayuan Mao , Kan Qiao , Dengyong Zhou

Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation…

Computation and Language · Computer Science 2020-03-31 Pei Zhang , Xu Zhang , Wei Chen , Jian Yu , Yanfeng Wang , Deyi Xiong

Neural Machine Translation (NMT) generates target words sequentially in the way of predicting the next word conditioned on the context words. At training time, it predicts with the ground truth words as context while at inference it has to…

Computation and Language · Computer Science 2019-06-18 Wen Zhang , Yang Feng , Fandong Meng , Di You , Qun Liu

In this paper we provide the largest published comparison of translation quality for phrase-based SMT and neural machine translation across 30 translation directions. For ten directions we also include hierarchical phrase-based MT.…

Computation and Language · Computer Science 2016-12-01 Marcin Junczys-Dowmunt , Tomasz Dwojak , Hieu Hoang

In recent years, Neural Machine Translator (NMT) has shown promise in automatically editing source code. Typical NMT based code editor only considers the code that needs to be changed as input and suggests developers with a ranked list of…

Software Engineering · Computer Science 2021-08-17 Saikat Chakraborty , Baishakhi Ray