中文
相关论文

相关论文: Open Language Data Initiative: Advancing Low-Resou…

200 篇论文

This paper describes the development of a new benchmark for machine translation that provides training and test data for thousands of language pairs covering over 500 languages and tools for creating state-of-the-art translation models from…

计算与语言 · 计算机科学 2020-10-14 Jörg Tiedemann

A large number of significant assets are available online in English, which is frequently translated into native languages to ease the information sharing among local people who are not much familiar with English. However, manual…

计算与语言 · 计算机科学 2020-04-30 Himanshu Choudhary , Shivansh Rao , Rajesh Rohilla

This work contributes towards balancing the inclusivity and global applicability of natural language processing techniques by proposing the first 'name entity recognition' dataset for Kurdish Sorani, a low-resource and under-represented…

计算与语言 · 计算机科学 2025-12-01 Bakhtawar Abdalla , Rebwar Mala Nabi , Hassan Eshkiki , Fabio Caraffini

Advancements in Large Language Models (LLMs) have significantly enhanced instruction-following capabilities. However, most Instruction Fine-Tuning (IFT) datasets are predominantly in English, limiting model performance in other languages.…

Machine translation for low resource language pairs is a challenging task. This task could become extremely difficult once a speaker uses code switching. We propose a method to build a machine translation model for code-switched…

计算与语言 · 计算机科学 2025-03-27 Maksim Borisov , Zhanibek Kozhirbayev , Valentin Malykh

Neural Machine Translation (NMT) for low-resource languages is still a challenging task in front of NLP researchers. In this work, we deploy a standard data augmentation methodology by back-translation to a new language translation…

计算与语言 · 计算机科学 2024-06-11 Kung Yin Hong , Lifeng Han , Riza Batista-Navarro , Goran Nenadic

Recent advances in Multilingual Large Language Models (MLLMs) have significantly enhanced cross-lingual conversational capabilities, yet modeling culturally nuanced and context-dependent communication remains a critical bottleneck.…

We describe an open-source toolkit for neural machine translation (NMT). The toolkit prioritizes efficiency, modularity, and extensibility with the goal of supporting NMT research into model architectures, feature representations, and…

计算与语言 · 计算机科学 2017-03-07 Guillaume Klein , Yoon Kim , Yuntian Deng , Jean Senellart , Alexander M. Rush

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

计算与语言 · 计算机科学 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in…

计算与语言 · 计算机科学 2024-06-24 Yue Huang , Chenrui Fan , Yuan Li , Siyuan Wu , Tianyi Zhou , Xiangliang Zhang , Lichao Sun

Machine translation is one of the applications of natural language processing which has been explored in different languages. Recently researchers started paying attention towards machine translation for resource-poor languages and closely…

计算与语言 · 计算机科学 2021-06-09 Bharathi Raja Chakravarthi , Priya Rani , Mihael Arcan , John P. McCrae

In this paper we present our submission for the EACL 2021 SRW; a methodology that aims at bridging the gap between high and low-resource languages in the context of Open Information Extraction, showcasing it on the Greek language. The goals…

计算与语言 · 计算机科学 2021-03-30 Dimitris Papadopoulos , Nikolaos Papadakis , Nikolaos Matsatsinis

Despite impressive empirical successes of neural machine translation (NMT) on standard benchmarks, limited parallel data impedes the application of NMT models to many language pairs. Data augmentation methods such as back-translation make…

计算与语言 · 计算机科学 2019-10-08 Chunting Zhou , Xuezhe Ma , Junjie Hu , Graham Neubig

Cross-lingual text classification leverages text classifiers trained in a high-resource language to perform text classification in other languages with no or minimal fine-tuning (zero/few-shots cross-lingual transfer). Nowadays,…

计算与语言 · 计算机科学 2023-06-09 Inigo Jauregi Unanue , Gholamreza Haffari , Massimo Piccardi

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

计算与语言 · 计算机科学 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri

Bangla is the sixth most widely spoken language globally, with approximately 234 million native speakers. However, progress in open-source Bangla machine translation remains limited. Most online resources are in English and often remain…

计算与语言 · 计算机科学 2025-12-16 Ayon Roy , Risat Rahaman , Sadat Shibly , Udoy Saha Joy , Abdulla Al Kafi , Farig Yousuf Sadeque

The quality of a Neural Machine Translation system depends substantially on the availability of sizable parallel corpora. For low-resource language pairs this is not the case, resulting in poor translation quality. Inspired by work in…

计算与语言 · 计算机科学 2018-02-14 Marzieh Fadaee , Arianna Bisazza , Christof Monz

Linguistic diversity across the world creates a disparity with the availability of good quality digital language resources thereby restricting the technological benefits to majority of human population. The lack or absence of data resources…

计算与语言 · 计算机科学 2025-10-16 Prawaal Sharma , Navneet Goyal , Poonam Goyal , Vishnupriyan R

Increasing concerns and regulations about data privacy and sparsity necessitate the study of privacy-preserving, decentralized learning methods for natural language processing (NLP) tasks. Federated learning (FL) provides promising…

A recurring challenge of crowdsourcing NLP datasets at scale is that human writers often rely on repetitive patterns when crafting examples, leading to a lack of linguistic diversity. We introduce a novel approach for dataset creation based…

计算与语言 · 计算机科学 2022-11-16 Alisa Liu , Swabha Swayamdipta , Noah A. Smith , Yejin Choi