中文
相关论文

相关论文: Morphological and Language-Agnostic Word Segmentat…

200 篇论文

Direct neural machine translation (direct NMT) is a type of NMT system that translates text between two non-English languages. Direct NMT systems often face limitations due to the scarcity of parallel data between non-English language…

计算与语言 · 计算机科学 2024-05-21 Isidora Chara Tourni , Subhajit Naskar

In state-of-the-art Neural Machine Translation (NMT), an attention mechanism is used during decoding to enhance the translation. At every step, the decoder uses this mechanism to focus on different parts of the source sentence to gather the…

计算与语言 · 计算机科学 2018-05-31 Jean-Benoit Delbrouck , Stéphane Dupont

This study investigates the impact of morphological typology on tokenization and language modeling performance. We focus on languages with synthetic and analytical morphological structures and examine their productivity when tokenized using…

计算与语言 · 计算机科学 2024-11-01 Iñigo Parra

Nen verbal morphology is remarkably complex; a transitive verb can take up to 1,740 unique forms. The combined effect of having a large combinatoric space and a low-resource setting amplifies the need for NLP tools. Nen morphology utilises…

计算与语言 · 计算机科学 2020-12-08 Saliha Muradoğlu , Nicholas Evans , Ekaterina Vylomova

Neural machine translation (NMT) is sensitive to domain shift. In this paper, we address this problem in an active learning setting where we can spend a given budget on translating in-domain data, and gradually fine-tune a pre-trained…

计算与语言 · 计算机科学 2021-06-23 Junjie Hu , Graham Neubig

In this paper, we extend an attention-based neural machine translation (NMT) model by allowing it to access an entire training set of parallel sentence pairs even after training. The proposed approach consists of two stages. In the first…

计算与语言 · 计算机科学 2018-03-09 Jiatao Gu , Yong Wang , Kyunghyun Cho , Victor O. K. Li

While neural machine translation (NMT) has become the new paradigm, the parameter optimization requires large-scale parallel data which is scarce in many domains and language pairs. In this paper, we address a new translation scenario in…

计算与语言 · 计算机科学 2017-11-06 Yining Wang , Yang Zhao , Jiajun Zhang , Chengqing Zong , Zhengshan Xue

The effectiveness of Neural Machine Translation (NMT) models largely depends on the vocabulary used at training; small vocabularies can lead to out-of-vocabulary problems -- large ones, to memory issues. Subword (SW) tokenization has been…

计算与语言 · 计算机科学 2023-03-02 J. Pourmostafa Roshan Sharami , D. Shterionov , P. Spronck

Neural machine translation (NMT) takes deterministic sequences for source representations. However, either word-level or subword-level segmentations have multiple choices to split a source sequence with different word segmentors or…

计算与语言 · 计算机科学 2019-06-05 Fengshun Xiao , Jiangtong Li , Hai Zhao , Rui Wang , Kehai Chen

In this paper, we propose Neural Phrase-to-Phrase Machine Translation (NP$^2$MT). Our model uses a phrase attention mechanism to discover relevant input (source) segments that are used by a decoder to generate output (target) phrases. We…

计算与语言 · 计算机科学 2018-11-07 Jiangtao Feng , Lingpeng Kong , Po-Sen Huang , Chong Wang , Da Huang , Jiayuan Mao , Kan Qiao , Dengyong Zhou

With the fast development of Machine Translation (MT) systems, especially the new boost from Neural MT (NMT) models, the MT output quality has reached a new level of accuracy. However, many researchers criticised that the current popular…

计算与语言 · 计算机科学 2022-11-11 Lifeng Han

The advent of the attention mechanism in neural machine translation models has improved the performance of machine translation systems by enabling selective lookup into the source sentence. In this paper, the efficiencies of translation…

计算与语言 · 计算机科学 2017-01-10 Krupakar Hans , R S Milton

Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be…

计算与语言 · 计算机科学 2020-06-23 Junxuan Chen , Xiang Li , Jiarui Zhang , Chulun Zhou , Jianwei Cui , Bin Wang , Jinsong Su

Machine translation (MT) systems translate text between different languages by automatically learning in-depth knowledge of bilingual lexicons, grammar and semantics from the training examples. Although neural machine translation (NMT) has…

计算与语言 · 计算机科学 2020-04-29 Shilin He , Xing Wang , Shuming Shi , Michael R. Lyu , Zhaopeng Tu

State-of-the-art Transformer-based neural machine translation (NMT) systems still follow a standard encoder-decoder framework, in which source sentence representation can be well done by an encoder with self-attention mechanism. Though…

计算与语言 · 计算机科学 2019-12-30 Zuchao Li , Rui Wang , Kehai Chen , Masao Utiyama , Eiichiro Sumita , Zhuosheng Zhang , Hai Zhao

Homographs, words with different meanings but the same surface form, have long caused difficulty for machine translation systems, as it is difficult to select the correct translation based on the context. However, with the advent of neural…

计算与语言 · 计算机科学 2018-03-29 Frederick Liu , Han Lu , Graham Neubig

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

计算与语言 · 计算机科学 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

计算与语言 · 计算机科学 2018-12-19 Markus Freitag , Yaser Al-Onaizan

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

计算与语言 · 计算机科学 2017-08-22 Robert Östling , Jörg Tiedemann

Subword segmentation is widely used to address the open vocabulary problem in machine translation. The dominant approach to subword segmentation is Byte Pair Encoding (BPE), which keeps the most frequent words intact while splitting the…

计算与语言 · 计算机科学 2020-05-05 Ivan Provilkov , Dmitrii Emelianenko , Elena Voita