English
Related papers

Related papers: Judging Quality Across Languages: A Multilingual A…

200 papers

Large Language Models (LLMs) have demonstrated exceptional performance across various tasks, with pre-training stage serving as the cornerstone of their capabilities. However, the conventional fixed-length data composition strategy for…

Computation and Language · Computer Science 2025-06-30 Qing Yang , Qiyao Peng , Hongtao Liu , Kai Liu , Bing Qin , Ting Liu

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

Computation and Language · Computer Science 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer

In this paper, we introduce XGLUE, a new benchmark dataset that can be used to train large-scale cross-lingual pre-trained models using multilingual and bilingual corpora and evaluate their performance across a diverse set of cross-lingual…

In recent years, the use of large language models (LLMs) for text classification has attracted widespread attention. Despite this, the classification accuracy of LLMs has not yet universally surpassed that of smaller models. LLMs can…

Computation and Language · Computer Science 2024-12-11 Min Zeng , Caiquan Liu , Shiqi Zhang , Li Xie , Chen Sang , Xiaoxin Chen

The driving factors behind the development of large language models (LLMs) with impressive learning capabilities are their colossal model sizes and extensive training datasets. Along with the progress in natural language processing, LLMs…

Computation and Language · Computer Science 2023-09-19 Thuat Nguyen , Chien Van Nguyen , Viet Dac Lai , Hieu Man , Nghia Trung Ngo , Franck Dernoncourt , Ryan A. Rossi , Thien Huu Nguyen

Large language models are trained on massive scrapes of the web, as required by current scaling laws. Most progress is made for English, given its abundance of high-quality pretraining data. For most other languages, however, such high…

Computation and Language · Computer Science 2025-02-07 Skyler Seto , Maartje ter Hoeve , Richard He Bai , Natalie Schluter , David Grangier

Autoformalization, the process of transforming informal mathematical language into formal specifications and proofs remains a difficult task for state-of-the-art (large) language models. Existing works point to competing explanations for…

Artificial Intelligence · Computer Science 2025-02-25 Willy Chan , Michael Souliman , Jakob Nordhagen , Brando Miranda , Elyas Obbad , Kai Fronsdal Sanmi Koyejo

Probing techniques for large language models (LLMs) have primarily focused on English, overlooking the vast majority of the world's languages. In this paper, we extend these probing methods to a multilingual context, investigating the…

Computation and Language · Computer Science 2025-02-03 Daoyang Li , Haiyan Zhao , Qingcheng Zeng , Mengnan Du

The composition of pre-training datasets for large language models (LLMs) remains largely undisclosed, hindering transparency and efforts to optimize data quality, a critical driver of model performance. Current data selection methods, such…

Computation and Language · Computer Science 2025-08-07 Xinlin Zhuang , Jiahui Peng , Ren Ma , Yinfan Wang , Tianyi Bai , Xingjian Wei , Jiantao Qiu , Chi Zhang , Ying Qian , Conghui He

The performance of a large language model (LLM) depends heavily on the quality and size of its pretraining dataset. However, the pretraining datasets for state-of-the-art open LLMs like Llama 3 and Mixtral are not publicly available and…

Computation and Language · Computer Science 2024-11-01 Guilherme Penedo , Hynek Kydlíček , Loubna Ben allal , Anton Lozhkov , Margaret Mitchell , Colin Raffel , Leandro Von Werra , Thomas Wolf

Over the past few years, Large Language Models of Code (Code LLMs) have started to have a significant impact on programming practice. Code LLMs are also emerging as building blocks for research in programming languages and software…

While large language models (LLMs) have been pre-trained on multilingual corpora, their performance still lags behind in most languages compared to a few resource-rich languages. One common approach to mitigate this issue is to translate…

Computation and Language · Computer Science 2024-02-20 Yuanchi Zhang , Yile Wang , Zijun Liu , Shuo Wang , Xiaolong Wang , Peng Li , Maosong Sun , Yang Liu

In recent years, Large Language Models (LLMs) have made significant strides towards Artificial General Intelligence. However, training these models from scratch requires substantial computational resources and vast amounts of text data. In…

Computation and Language · Computer Science 2024-10-03 Wenzhen Zheng , Wenbo Pan , Xu Xu , Libo Qin , Li Yue , Ming Zhou

Large Language Models have become the de facto approach to sequence-to-sequence text generation tasks, but for specialized tasks/domains, a pretrained LLM lacks specific capabilities to produce accurate or well-formatted responses.…

Computation and Language · Computer Science 2024-03-20 Jiuhai Chen , Jonas Mueller

Training large language models (LLMs) for external tool usage is a rapidly expanding field, with recent research focusing on generating synthetic data to address the shortage of available data. However, the absence of systematic data…

Machine Learning · Computer Science 2024-09-27 Shadi Iskander , Nachshon Cohen , Zohar Karnin , Ori Shapira , Sofia Tolmach

Large language models (LLMs) are typically multilingual due to pretraining on diverse multilingual corpora. But can these models relate corresponding concepts across languages, i.e., be crosslingual? This study evaluates state-of-the-art…

Computation and Language · Computer Science 2025-03-05 Lynn Chua , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Amer Sinha , Chulin Xie , Chiyuan Zhang

Large volumes of text data have contributed significantly to the development of large language models (LLMs) in recent years. This data is typically acquired by scraping the internet, leading to pretraining datasets comprised of noisy web…

Computation and Language · Computer Science 2023-09-12 Max Marion , Ahmet Üstün , Luiza Pozzobon , Alex Wang , Marzieh Fadaee , Sara Hooker

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they often exhibit a specific cultural biases, neglecting the values and linguistic diversity of low-resource regions. This cultural bias not…

Computation and Language · Computer Science 2025-05-28 Ruixiang Feng , Shen Gao , Xiuying Chen , Lisi Chen , Shuo Shang

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

Computation and Language · Computer Science 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri

Multilingual instruction fine-tuning (IFT) empowers large language models to generalize across diverse linguistic and cultural contexts; however, high-quality, systematically curated multilingual IFT datasets remain scarce. To address this…

Computation and Language · Computer Science 2026-05-01 Chunguang Zhao , Yilun Liu , Pufan Zeng , Yuanchang Luo , Shimin Tao , Minggui He , Weibin Meng , Song Xu , Chen Liu , Hongxia Ma , Li Zhang , Boxing Chen , Daimeng Wei