English
Related papers

Related papers: Machine Translation in Indian Languages: Challenge…

200 papers

Text style transfer (TST) involves altering the linguistic style of a text while preserving its core content. This paper focuses on sentiment transfer, a popular TST subtask, across a spectrum of Indian languages: Hindi, Magahi, Malayalam,…

Computation and Language · Computer Science 2024-08-28 Sourabrata Mukherjee , Atul Kr. Ojha , Akanksha Bansal , Deepak Alok , John P. McCrae , Ondřej Dušek

For real-life applications, it is crucial that end-to-end spoken language translation models perform well on continuous audio, without relying on human-supplied segmentation. For online spoken language translation, where models need to…

Computation and Language · Computer Science 2022-10-25 Chantal Amrhein , Barry Haddow

Large language models demonstrate reasonable multilingual abilities, despite predominantly English-centric pretraining. However, the spontaneous multilingual alignment in these models is shown to be weak, leading to unsatisfactory…

Computation and Language · Computer Science 2024-11-19 Jiahuan Li , Shujian Huang , Aarron Ching , Xinyu Dai , Jiajun Chen

This paper presents machine learning solutions to a practical problem of Natural Language Generation (NLG), particularly the word formation in agglutinative languages like Tamil, in a supervised manner. The morphological generator is an…

Computation and Language · Computer Science 2014-02-17 K. Rajan , Dr. V. Ramalingam , Dr. M. Ganesan

Machine translation (MT) involving Indigenous languages, including those possibly endangered, is challenging due to lack of sufficient parallel data. We describe an approach exploiting bilingual and multilingual pretrained MT models in a…

Computation and Language · Computer Science 2022-05-17 Wei-Rui Chen , Muhammad Abdul-Mageed

Large language models (LMs) are currently trained to predict tokens given document prefixes, enabling them to directly perform long-form generation and prompting-style tasks which can be reduced to document completion. Existing pretraining…

Learning word embeddings using distributional information is a task that has been studied by many researchers, and a lot of studies are reported in the literature. On the contrary, less studies were done for the case of multiple languages.…

Computation and Language · Computer Science 2020-04-15 Marco Berlot , Evan Kaplan

Neural Machine Translation (NMT) models are typically trained on datasets with limited exposure to Scientific, Technical and Educational domains. Translation models thus, in general, struggle with tasks that involve scientific understanding…

Computation and Language · Computer Science 2024-12-13 Advait Joglekar , Srinivasan Umesh

Statistical machine translation (SMT) systems perform poorly when it is applied to new target domains. Our goal is to explore domain adaptation approaches and techniques for improving the translation quality of domain-specific SMT systems.…

Computation and Language · Computer Science 2018-04-06 Longyue Wang

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

In this paper, we empirically study the optimization dynamics of multi-task learning, particularly focusing on those that govern a collection of tasks with significant data imbalance. We present a simple yet effective method of pre-training…

Computation and Language · Computer Science 2023-12-12 Dami Choi , Derrick Xin , Hamid Dadkhahi , Justin Gilmer , Ankush Garg , Orhan Firat , Chih-Kuan Yeh , Andrew M. Dai , Behrooz Ghorbani

Having recognized gender bias as a major issue affecting current translation technologies, researchers have primarily attempted to mitigate it by working on the data front. However, whether algorithmic aspects concur to exacerbate unwanted…

Computation and Language · Computer Science 2021-05-31 Marco Gaido , Beatrice Savoldi , Luisa Bentivogli , Matteo Negri , Marco Turchi

Thai is a low-resource language, so it is often the case that data is not available in sufficient quantities to train an Neural Machine Translation (NMT) model which perform to a high level of quality. In addition, the Thai script does not…

Computation and Language · Computer Science 2020-04-27 Alberto Poncelas , Wichaya Pidchamook , Chao-Hong Liu , James Hadley , Andy Way

Multilingual large language models (LLMs) often demonstrate a performance gap between English and non-English languages, particularly in low-resource settings. Aligning these models to low-resource languages is essential yet challenging due…

Computation and Language · Computer Science 2025-10-16 Rakesh Paul , Anusha Kamath , Kanishk Singla , Raviraj Joshi , Utkarsh Vaidya , Sanjay Singh Chauhan , Niranjan Wartikar

Translating technical terms into lexically similar, low-resource Indian languages remains a challenge due to limited parallel data and the complexity of linguistic structures. We propose a novel use-case of Sanskrit-based segments for…

Computation and Language · Computer Science 2026-03-26 Karthika N J , Krishnakant Bhatt , Ganesh Ramakrishnan , Preethi Jyothi

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. In this work, our aim is to explore the multilingual capabilities of large language models by using machine translation as a task involving…

Recent generative large language models (LLMs) show remarkable performance in non-English languages, but when prompted in those languages they tend to express higher harmful social biases and toxicity levels. Prior work has shown that…

Computation and Language · Computer Science 2025-06-03 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Dictionaries and phrase tables are the basis of modern statistical machine translation systems. This paper develops a method that can automate the process of generating and extending dictionaries and phrase tables. Our method can translate…

Computation and Language · Computer Science 2013-09-18 Tomas Mikolov , Quoc V. Le , Ilya Sutskever

Translating from languages without productive grammatical gender like English into gender-marked languages is a well-known difficulty for machines. This difficulty is also due to the fact that the training data on which models are built…

Computation and Language · Computer Science 2020-06-11 Luisa Bentivogli , Beatrice Savoldi , Matteo Negri , Mattia Antonino Di Gangi , Roldano Cattoni , Marco Turchi

Despite advances in the multilingual capabilities of Large Language Models (LLMs) across diverse tasks, English remains the dominant language for LLM research and development. So, when working with a different language, this has led to the…

Computation and Language · Computer Science 2025-02-14 Itai Mondshine , Tzuf Paz-Argaman , Reut Tsarfaty