English
Related papers

Related papers: A Recipe of Parallel Corpora Exploitation for Mult…

200 papers

One of the major research trends currently is the evolution of heterogeneous parallel computing. GP-GPU computing is being widely used and several applications have been designed to exploit the massive parallelism that GP-GPU's have to…

Machine Learning · Computer Science 2014-04-16 Vivek Kulkarni , Rami Al-Rfou' , Bryan Perozzi , Steven Skiena

This work is concerned with the evaluation of the performance of parallelization of learning and tuning processes for image classification and large language models. For machine learning model in image recognition, various parallelization…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Marcin Lawenda , Krzesimir Samborski , Kyrylo Khloponin , Łukasz Szustak

Parallel corpora are a valuable resource for machine translation, but at present their availability and utility is limited by genre- and domain-specificity, licensing restrictions, and the basic difficulty of locating parallel texts in all…

cmp-lg · Computer Science 2007-05-23 Philip Resnik

With multilingual machine translation (MMT) models continuing to grow in size and number of supported languages, it is natural to reuse and upgrade existing models to save computation as data becomes available in more languages. However,…

Computation and Language · Computer Science 2023-02-08 Simeng Sun , Maha Elbayad , Anna Sun , James Cross

As artificial intelligence systems spread to more diverse and larger tasks in many domains, the machine learning algorithms, and in particular the deep learning models and the databases required to train them are getting bigger themselves.…

Machine Learning · Computer Science 2019-04-22 Philippe Lacaille

Pre-trained language models (PLMs) have established the new paradigm in the field of NLP. For more powerful PLMs, one of the most popular and successful way is to continuously scale up sizes of the models and the pre-training corpora. These…

Computation and Language · Computer Science 2023-11-17 Yipei Xu , Dakuan Lu , Jiaqing Liang , Xintao Wang , Yipeng Geng , Yingsi Xin , Hengkui Wu , Ken Chen , ruiji zhang , Yanghua Xiao

Multilinguality is a core capability for modern foundation models, yet training high-quality multilingual models remains challenging due to uneven data availability across languages. A further challenge is the performance interference that…

While multilingual large language models generally perform adequately, and sometimes even rival English performance on high-resource languages (HRLs), they often significantly underperform on low-resource languages (LRLs). Among several…

Computation and Language · Computer Science 2025-10-09 Yilei Tu , Andrew Xue , Freda Shi

Multimodal large language models (MLLMs) extend the capabilities of large language models (LLMs) by combining heterogeneous model architectures to handle diverse modalities like images and audio. However, this inherent heterogeneity in MLLM…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Insu Jang , Runyu Lu , Nikhil Bansal , Ang Chen , Mosharaf Chowdhury

In this article, we seek to answer the following question: could data duplication be useful in Natural Language Processing (NLP) for languages with limited computational resources? In this type of languages (or $\pi$-languages), corpora…

In recent years, large language models have demonstrated remarkable performance across various natural language processing (NLP) tasks. However, deploying these models for real-world applications often requires efficient inference solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Ditto PS , Jithin VG , Adarsh MS

Multimodal Large Language Models (MLLMs) have shown remarkable performance in high-resource languages. However, their effectiveness diminishes significantly in the contexts of low-resource languages. Current multilingual enhancement methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Yufei Gao , Jiaying Fei , Nuo Chen , Ruirui Chen , Guohang Yan , Yunshi Lan , Botian Shi

A multilingual tokenizer is a fundamental component of multilingual neural machine translation. It is trained from a multilingual corpus. Since a skewed data distribution is considered to be harmful, a sampling strategy is usually used to…

Computation and Language · Computer Science 2022-09-13 Shiyue Zhang , Vishrav Chaudhary , Naman Goyal , James Cross , Guillaume Wenzek , Mohit Bansal , Francisco Guzman

Neural machine translation, a recently proposed approach to machine translation based purely on neural networks, has shown promising results compared to the existing approaches such as phrase-based statistical machine translation. Despite…

Computation and Language · Computer Science 2015-03-19 Sébastien Jean , Kyunghyun Cho , Roland Memisevic , Yoshua Bengio

Lack of proper linguistic resources is the major challenges faced by the Machine Translation system developments when dealing with the resource poor languages. In this paper, we describe effective ways to utilize the lexical resources to…

Computation and Language · Computer Science 2017-11-13 Sreelekha S , Pushpak Bhattacharyya

Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hungry models by…

Computation and Language · Computer Science 2023-11-14 Seokjin Oh , Su Ah Lee , Woohwan Jung

Neural machine translation has become the state-of-the-art for language pairs with large parallel corpora. However, the quality of machine translation for low-resource languages leaves much to be desired. There are several approaches to…

Computation and Language · Computer Science 2019-10-02 Ilshat Gibadullin , Aidar Valeev , Albina Khusainova , Adil Khan

While large language models demonstrate remarkable capabilities at task-specific applications through fine-tuning, extending these benefits across diverse languages is essential for broad accessibility. However, effective cross-lingual…

Computation and Language · Computer Science 2025-06-03 Danni Liu , Jan Niehues

Our book "The Reality of Multi-Lingual Machine Translation" discusses the benefits and perils of using more than two languages in machine translation systems. While focused on the particular task of sequence-to-sequence processing and…

Computation and Language · Computer Science 2022-02-28 Tom Kocmi , Dominik Macháček , Ondřej Bojar

There are several approaches for improving neural machine translation for low-resource languages: Monolingual data can be exploited via pretraining or data augmentation; Parallel corpora on related language pairs can be used via parameter…

Computation and Language · Computer Science 2020-12-10 Stig-Arne Grönroos , Sami Virpioja , Mikko Kurimo