中文
相关论文

相关论文: When and Why is Document-level Context Useful in N…

200 篇论文

To understand and infer meaning in language, neural models have to learn complicated nuances. Discovering distinctive linguistic phenomena from data is not an easy task. For instance, lexical ambiguity is a fundamental feature of language…

计算与语言 · 计算机科学 2021-02-23 Marzieh Fadaee

Document-level neural machine translation has yielded attractive improvements. However, majority of existing methods roughly use all context sentences in a fixed scope. They neglect the fact that different source sentences need different…

计算与语言 · 计算机科学 2020-10-12 Xiaomian Kang , Yang Zhao , Jiajun Zhang , Chengqing Zong

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

计算与语言 · 计算机科学 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Recent work in neural machine translation has demonstrated both the necessity and feasibility of using inter-sentential context -- context from sentences other than those currently being translated. However, while many current methods…

计算与语言 · 计算机科学 2021-06-03 Patrick Fernandes , Kayo Yin , Graham Neubig , André F. T. Martins

Despite the known limitations, most machine translation systems today still operate on the sentence-level. One reason for this is, that most parallel training data is only sentence-level aligned, without document-level meta information…

计算与语言 · 计算机科学 2023-10-20 Frithjof Petrick , Christian Herold , Pavel Petrushkov , Shahram Khadivi , Hermann Ney

Large language models (LLMs) have achieved state-of-the-art performance in machine translation (MT) and demonstrated the ability to leverage in-context learning through few-shot examples. However, the mechanisms by which LLMs use different…

计算与语言 · 计算机科学 2024-10-22 Emmanouil Zaranis , Nuno M. Guerreiro , André F. T. Martins

Interest in larger-context neural machine translation, including document-level and multi-modal translation, has been growing. Multiple works have proposed new network architectures or evaluation schemes, but potentially helpful context is…

计算与语言 · 计算机科学 2019-03-13 Sébastien Jean , Kyunghyun Cho

In translation, considering the document as a whole can help to resolve ambiguities and inconsistencies. In this paper, we propose a cross-sentence context-aware approach and investigate the influence of historical contextual information on…

计算与语言 · 计算机科学 2017-07-25 Longyue Wang , Zhaopeng Tu , Andy Way , Qun Liu

Machine translation (MT) is an important task in natural language processing (NLP) as it automates the translation process and reduces the reliance on human translators. With the resurgence of neural networks, the translation quality…

计算与语言 · 计算机科学 2021-01-14 Sameen Maruf , Fahimeh Saleh , Gholamreza Haffari

We investigate the use of extended context in attention-based neural machine translation. We base our experiments on translated movie subtitles and discuss the effect of increasing the segments beyond single translation units. We study the…

计算与语言 · 计算机科学 2017-08-22 Jörg Tiedemann , Yves Scherrer

In encoder-decoder neural models, multiple encoders are in general used to represent the contextual information in addition to the individual sentence. In this paper, we investigate multi-encoder approaches in documentlevel neural machine…

计算与语言 · 计算机科学 2020-05-19 Bei Li , Hui Liu , Ziyang Wang , Yufan Jiang , Tong Xiao , Jingbo Zhu , Tongran Liu , Changliang Li

Despite the progress made in sentence-level NMT, current systems still fall short at achieving fluent, good quality translation for a full document. Recent works in context-aware NMT consider only a few previous sentences as context and may…

计算与语言 · 计算机科学 2019-05-27 Sameen Maruf , André F. T. Martins , Gholamreza Haffari

Despite the recent success of automatic metrics for assessing translation quality, their application in evaluating the quality of machine-translated chats has been limited. Unlike more structured texts like news, chat conversations are…

计算与语言 · 计算机科学 2024-03-14 Sweta Agrawal , Amin Farajian , Patrick Fernandes , Ricardo Rei , André F. T. Martins

Standard context-aware neural machine translation (NMT) typically relies on parallel document-level data, exploiting both source and target contexts. Concatenation-based approaches in particular, still a strong baseline for document-level…

计算与语言 · 计算机科学 2024-02-12 Harritxu Gete , Thierry Etchegoyhen

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

计算与语言 · 计算机科学 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

It is well-known that document context is vital for resolving a range of translation ambiguities, and in fact the document setting is the most natural setting for nearly all translation. It is therefore unfortunate that machine translation…

计算与语言 · 计算机科学 2024-05-17 Matt Post , Marcin Junczys-Dowmunt

Large Language Models (LLM's) have demonstrated considerable success in various Natural Language Processing tasks, but they have yet to attain state-of-the-art performance in Neural Machine Translation (NMT). Nevertheless, their significant…

计算与语言 · 计算机科学 2024-03-20 Sai Koneru , Miriam Exel , Matthias Huck , Jan Niehues

Understanding context is key to understanding human language, an ability which Large Language Models (LLMs) have been increasingly seen to demonstrate to an impressive extent. However, though the evaluation of LLMs encompasses various…

Document-level machine translation conditions on surrounding sentences to produce coherent translations. There has been much recent work in this area with the introduction of custom model architectures and decoding algorithms. This paper…

计算与语言 · 计算机科学 2021-01-28 Zhiyi Ma , Sergey Edunov , Michael Auli

One of the most popular methods for context-aware machine translation (MT) is to use separate encoders for the source sentence and context as multiple sources for one target sentence. Recent work has cast doubt on whether these models…

计算与语言 · 计算机科学 2024-06-28 Matīss Rikters , Toshiaki Nakazawa