English
Related papers

Related papers: Sockeye: A Toolkit for Neural Machine Translation

200 papers

Neural Machine Translation (NMT) remains a formidable challenge, especially when dealing with low-resource languages. Pre-trained sequence-to-sequence (seq2seq) multi-lingual models, such as mBART-50, have demonstrated impressive…

Computation and Language · Computer Science 2024-07-10 Aniruddha Roy , Pretam Ray , Ayush Maheshwari , Sudeshna Sarkar , Pawan Goyal

Deep Learning techniques are powerful in mimicking humans in a particular set of problems. They have achieved a remarkable performance in complex learning tasks. Deep learning inspired Neural Machine Translation (NMT) is a proficient…

Computation and Language · Computer Science 2021-10-04 Vishvajit Bakarola , Jitendra Nasriwala

We present an open-source and extensible knowledge extraction toolkit DeepKE, supporting complicated low-resource, document-level and multimodal scenarios in the knowledge base population. DeepKE implements various information extraction…

Although end-to-end Neural Machine Translation (NMT) has achieved remarkable progress in the past two years, it suffers from a major drawback: translations generated by NMT systems often lack of adequacy. It has been widely observed that…

Computation and Language · Computer Science 2016-11-22 Zhaopeng Tu , Yang Liu , Lifeng Shang , Xiaohua Liu , Hang Li

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

This paper describes NCRF++, a toolkit for neural sequence labeling. NCRF++ is designed for quick implementation of different neural sequence labeling models with a CRF inference layer. It provides users with an inference for building the…

Computation and Language · Computer Science 2018-06-19 Jie Yang , Yue Zhang

Interlingua based Machine Translation (MT) aims to encode multiple languages into a common linguistic representation and then decode sentences in multiple target languages from this representation. In this work we explore this idea in the…

Computation and Language · Computer Science 2016-06-16 Amrita Saha , Mitesh M. Khapra , Sarath Chandar , Janarthanan Rajendran , Kyunghyun Cho

Machine translation systems are expected to cope with various types of constraints in many practical scenarios. While neural machine translation (NMT) has achieved strong performance in unconstrained cases, it is non-trivial to impose…

Computation and Language · Computer Science 2022-10-24 Shuo Wang , Peng Li , Zhixing Tan , Zhaopeng Tu , Maosong Sun , Yang Liu

Retrieval over knowledge graphs is usually performed using dedicated, complex query languages like SPARQL. We propose a novel system, Ontology and Semantic Exploration Toolkit (OnSET) that allows non-expert users to easily build queries…

Information Retrieval · Computer Science 2025-07-15 Benedikt Kantz , Kevin Innerebner , Peter Waldert , Stefan Lengauer , Elisabeth Lex , Tobias Schreck

The sequence-to-sequence (seq2seq) model for neural machine translation has significantly improved the accuracy of language translation. There have been new efforts to use this seq2seq model for program language translation or program…

Machine Learning · Computer Science 2019-05-21 Yonghae Kim , Hyesoon Kim

Previous work on neural noisy channel modeling relied on latent variable models that incrementally process the source and target sentence. This makes decoding decisions based on partial source prefixes even though the full source is…

Computation and Language · Computer Science 2019-08-19 Kyra Yee , Nathan Ng , Yann N. Dauphin , Michael Auli

Neural machine translation (NMT) heavily relies on word-level modelling to learn semantic representations of input sentences. However, for languages without natural word delimiters (e.g., Chinese) where input sentences have to be tokenized…

Computation and Language · Computer Science 2016-12-12 Jinsong Su , Zhixing Tan , Deyi Xiong , Rongrong Ji , Xiaodong Shi , Yang Liu

To understand a narrative, it is essential to comprehend the temporal event flows, especially those associated with main characters; however, this can be challenging with lengthy and unstructured narrative texts. To address this, we…

Artificial Intelligence · Computer Science 2023-08-15 Guangxuan Xu , Paulina Toro Isaza , Moshi Li , Akintoye Oloko , Bingsheng Yao , Cassia Sanctos , Aminat Adebiyi , Yufang Hou , Nanyun Peng , Dakuo Wang

Neural Machine Translation (NMT) has been widely adopted recently due to its advantages compared with the traditional Statistical Machine Translation (SMT). However, an NMT system still often produces translation failures due to the…

Computation and Language · Computer Science 2018-10-04 Wujie Zheng , Wenyu Wang , Dian Liu , Changrong Zhang , Qinsong Zeng , Yuetang Deng , Wei Yang , Pinjia He , Tao Xie

Although Neural Machine Translation (NMT) models have advanced state-of-the-art performance in machine translation, they face problems like the inadequate translation. We attribute this to that the standard Maximum Likelihood Estimation…

Computation and Language · Computer Science 2018-11-22 Xiang Kong , Zhaopeng Tu , Shuming Shi , Eduard Hovy , Tong Zhang

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Attentional sequence-to-sequence models have become the new standard for machine translation, but one challenge of such models is a significant increase in training and decoding cost compared to phrase-based systems. Here, we focus on…

Computation and Language · Computer Science 2017-05-08 Jacob Devlin

The machine translation mechanism translates texts automatically between different natural languages, and Neural Machine Translation (NMT) has gained attention for its rational context analysis and fluent translation accuracy. However,…

Computation and Language · Computer Science 2023-01-03 Neeraj Vashistha , Kriti Singh , Ramakant Shakya

Neural Machine Translation (NMT) models are typically trained on datasets with limited exposure to Scientific, Technical and Educational domains. Translation models thus, in general, struggle with tasks that involve scientific understanding…

Computation and Language · Computer Science 2024-12-13 Advait Joglekar , Srinivasan Umesh