中文
相关论文

相关论文: Linguistically-driven Multi-task Pre-training for …

200 篇论文

Machine translation (MT) for low-resource languages such as Ge'ez, an ancient language that is no longer the native language of any community, faces challenges such as out-of-vocabulary words, domain mismatches, and lack of sufficient…

计算与语言 · 计算机科学 2024-04-16 Aman Kassahun Wassie

Fine-tuning multilingual sequence-to-sequence large language models (msLLMs) has shown promise in developing neural machine translation (NMT) systems for low-resource languages (LRLs). However, conventional single-stage fine-tuning methods…

计算与语言 · 计算机科学 2025-03-31 Sarubi Thillainathan , Songchen Yuan , En-Shiun Annie Lee , Sanath Jayasena , Surangika Ranathunga

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

计算与语言 · 计算机科学 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Although all-in-one-model multilingual neural machine translation (multilingual NMT) has achieved remarkable progress, the convergence inconsistency in the joint training is ignored, i.e., different language pairs reaching convergence in…

计算与语言 · 计算机科学 2022-10-20 Yichong Huang , Xiaocheng Feng , Xinwei Geng , Bing Qin

Neural Machine Translation (NMT) has obtained state-of-the art performance for several language pairs, while only using parallel data for training. Target-side monolingual data plays an important role in boosting fluency for phrase-based…

计算与语言 · 计算机科学 2016-06-06 Rico Sennrich , Barry Haddow , Alexandra Birch

While state-of-the-art models that rely upon massively multilingual pretrained encoders achieve sample efficiency in downstream applications, they still require abundant amounts of unlabelled text. Nevertheless, most of the world's…

计算与语言 · 计算机科学 2024-02-16 Yaoyiran Li , Edoardo M. Ponti , Ivan Vulić , Anna Korhonen

In this paper, we explore a simple solution to "Multi-Source Neural Machine Translation" (MSNMT) which only relies on preprocessing a N-way multilingual corpus without modifying the Neural Machine Translation (NMT) architecture or training…

计算与语言 · 计算机科学 2019-03-05 Raj Dabre , Fabien Cromieres , Sadao Kurohashi

While Active Learning (AL) techniques are explored in Neural Machine Translation (NMT), only a few works focus on tackling low annotation budgets where a limited number of sentences can get translated. Such situations are especially…

计算与语言 · 计算机科学 2022-01-19 Sai Koneru , Danni Liu , Jan Niehues

This paper demonstrates that multilingual denoising pre-training produces significant performance gains across a wide variety of machine translation (MT) tasks. We present mBART -- a sequence-to-sequence denoising auto-encoder pre-trained…

计算与语言 · 计算机科学 2020-01-24 Yinhan Liu , Jiatao Gu , Naman Goyal , Xian Li , Sergey Edunov , Marjan Ghazvininejad , Mike Lewis , Luke Zettlemoyer

This study presents a Long Short-Term Memory (LSTM) neural network approach to Japanese word segmentation (JWS). Previous studies on Chinese word segmentation (CWS) succeeded in using recurrent neural networks such as LSTM and gated…

计算与语言 · 计算机科学 2018-09-28 Yoshiaki Kitagawa , Mamoru Komachi

This paper describes the GMU systems for the IWSLT 2025 low-resource speech translation shared task. We trained systems for all language pairs, except for Levantine Arabic. We fine-tuned SeamlessM4T-v2 for automatic speech recognition…

计算与语言 · 计算机科学 2025-05-29 Chutong Meng , Antonios Anastasopoulos

Multilingual machine translation addresses the task of translating between multiple source and target languages. We propose task-specific attention models, a simple but effective technique for improving the quality of sequence-to-sequence…

计算与语言 · 计算机科学 2018-06-11 Graeme Blackwood , Miguel Ballesteros , Todd Ward

Nowadays, training end-to-end neural models for spoken language translation (SLT) still has to confront with extreme data scarcity conditions. The existing SLT parallel corpora are indeed orders of magnitude smaller than those available for…

计算与语言 · 计算机科学 2019-10-09 Mattia Antonino Di Gangi , Matteo Negri , Marco Turchi

End-to-end Speech-to-text Translation (E2E-ST), which directly translates source language speech to target language text, is widely useful in practice, but traditional cascaded approaches (ASR+MT) often suffer from error propagation in the…

计算与语言 · 计算机科学 2021-02-10 Junkun Chen , Mingbo Ma , Renjie Zheng , Liang Huang

In this paper, we propose a two-phase training approach where pre-trained large language models are continually pre-trained on parallel data and then supervised fine-tuned with a small amount of high-quality parallel data. To investigate…

计算与语言 · 计算机科学 2024-07-04 Minato Kondo , Takehito Utsuro , Masaaki Nagata

We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source…

计算与语言 · 计算机科学 2018-08-30 Felix Stahlberg , Danielle Saunders , Bill Byrne

In Neural Machine Translation (NMT) the usage of subwords and characters as source and target units offers a simple and flexible solution for translation of rare and unseen words. However, selecting the optimal subword segmentation involves…

计算与语言 · 计算机科学 2019-10-29 Tejas Srinivasan , Ramon Sanabria , Florian Metze

Recently, the development of neural machine translation (NMT) has significantly improved the translation quality of automatic machine translation. While most sentences are more accurate and fluent than translations by statistical machine…

计算与语言 · 计算机科学 2016-10-18 Jan Niehues , Eunah Cho , Thanh-Le Ha , Alex Waibel

Neural machine translation (NMT) for low-resource local languages in Indonesia faces significant challenges, including the need for a representative benchmark and limited data availability. This work addresses these challenges by…

计算与语言 · 计算机科学 2023-11-03 Lucky Susanto , Ryandito Diandaru , Adila Krisnadhi , Ayu Purwarianti , Derry Wijaya

Bilingual sequence models improve phrase-based translation and reordering by overcoming phrasal independence assumption and handling long range reordering. However, due to data sparsity, these models often fall back to very small context…

计算与语言 · 计算机科学 2018-01-30 Nadir Durrani , Fahim Dalvi