English
Related papers

Related papers: MultiScript30k: Leveraging Multilingual Embeddings…

200 papers

Using a vocabulary that is shared across languages is common practice in Multilingual Neural Machine Translation (MNMT). In addition to its simple design, shared tokens play an important role in positive knowledge transfer, assuming that…

Computation and Language · Computer Science 2024-01-23 Di Wu , Christof Monz

Instruction tuning has become a key technique for enhancing the performance of large language models, enabling them to better follow human prompts. However, low-resource languages such as Luxembourgish face severe limitations due to the…

Computation and Language · Computer Science 2025-10-09 Fred Philippy , Laura Bernardy , Siwen Guo , Jacques Klein , Tegawendé F. Bissyandé

This paper contributes a new large-scale dataset for weakly supervised cross-media retrieval, named Twitter100k. Current datasets, such as Wikipedia, NUS Wide and Flickr30k, have two major limitations. First, these datasets are lacking in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-21 Yuting Hu , Liang Zheng , Yi Yang , Yongfeng Huang

General translation models often still struggle to generate accurate translations in specialized domains. To guide machine translation practitioners and characterize the effectiveness of domain adaptation methods under different data…

Computation and Language · Computer Science 2022-06-03 Virginia Adams , Sandeep Subramanian , Mike Chrzanowski , Oleksii Hrinchuk , Oleksii Kuchaiev

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Machine Learning · Computer Science 2021-09-17 Pranav Aggarwal , Ritiz Tambi , Ajinkya Kale

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

While large language models (LLMs) exhibit state-of-the-art performance in various tasks, recent studies have revealed their struggle for code translation. This is because they haven't been extensively pre-trained with parallel multilingual…

Software Engineering · Computer Science 2024-10-15 Qingxiao Tao , Tingrui Yu , Xiaodong Gu , Beijun Shen

Script diversity presents a challenge to Multilingual Language Models (MLLM) by reducing lexical overlap among closely related languages. Therefore, transliterating closely related languages that use different writing scripts to a common…

Computation and Language · Computer Science 2023-08-01 Ibraheem Muhammad Moosa , Mahmud Elahi Akhter , Ashfia Binte Habib

Modern translation workflows demand more than semantic equivalence. Users routinely require models to preserve JSON or HTML schemas, honor curated glossaries, disambiguate with provided context, and match prescribed registers, often several…

Computation and Language · Computer Science 2026-05-28 Mingrui Sun , Mao Zheng , Zheng Li , Mingyang Song

The successful adaptation of multilingual language models (LMs) to a specific language-task pair critically depends on the availability of data tailored for that condition. While cross-lingual transfer (XLT) methods have contributed to…

Computation and Language · Computer Science 2024-06-06 Seong Hoon Lim , Taejun Yun , Jinhyeon Kim , Jihun Choi , Taeuk Kim

Multilingual semantic parsing is a cost-effective method that allows a single model to understand different languages. However, researchers face a great imbalance of availability of training data, with English being resource rich, and other…

Computation and Language · Computer Science 2021-06-15 Menglin Xia , Emilio Monti

The multilingual neural machine translation (MNMT) aims for arbitrary translations across multiple languages. Although MNMT-specific models trained on parallel data offer low costs in training and deployment, their performance consistently…

Computation and Language · Computer Science 2025-05-27 Zhi Qu , Yiran Wang , Jiannan Mao , Chenchen Ding , Hideki Tanaka , Masao Utiyama , Taro Watanabe

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

Computation and Language · Computer Science 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

Existing datasets available for crosslinguistic investigations have tended to focus on large amounts of data for a small group of languages or a small amount of data for a large number of languages. This means that claims based on these…

Computation and Language · Computer Science 2026-01-27 Hiram Ring

To participate in the Isometric Spoken Language Translation Task of the IWSLT 2022 evaluation, constrained condition, AppTek developed neural Transformer-based systems for English-to-German with various mechanisms of length control, ranging…

Computation and Language · Computer Science 2022-05-13 Patrick Wilken , Evgeny Matusov

The effects of language mismatch impact speech anti-spoofing systems, while investigations and quantification of these effects remain limited. Existing anti-spoofing datasets are mainly in English, and the high cost of acquiring…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Tianchi Liu , Ivan Kukanov , Zihan Pan , Qiongqiong Wang , Hardik B. Sailor , Kong Aik Lee

Large Language Models are traditionally finetuned on large instruction datasets. However recent studies suggest that small, high-quality datasets can suffice for general purpose instruction following. This lack of consensus surrounding…

Machine Learning · Computer Science 2023-12-29 Aditi Jha , Sam Havens , Jeremy Dohmann , Alex Trott , Jacob Portes

Being able to rank the similarity of short text segments is an interesting bonus feature of neural machine translation. Translation-based similarity measures include direct and pivot translation probability, as well as translation…

Computation and Language · Computer Science 2022-10-20 Jannis Vamvas , Rico Sennrich

Pre-training state-of-the-art large language models (LLMs) requires vast amounts of clean and diverse text data. While the open development of large high-quality English pre-training datasets has seen substantial recent progress, training…

Multi-source translation systems translate from multiple languages to a single target language. By using information from these multiple sources, these systems achieve large gains in accuracy. To train these systems, it is necessary to have…

Computation and Language · Computer Science 2018-11-09 Yuta Nishimura , Katsuhito Sudoh , Graham Neubig , Satoshi Nakamura