English
Related papers

Related papers: Are Pretrained Multilingual Models Equally Fair Ac…

200 papers

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

Computation and Language · Computer Science 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

This paper investigates biases of Large Language Models (LLMs) through the lens of grammatical gender. Drawing inspiration from seminal works in psycholinguistics, particularly the study of gender's influence on language perception, we…

Computation and Language · Computer Science 2024-07-16 Viktor Mihaylov , Aleksandar Shtedritski

The success of multilingual pre-trained models is underpinned by their ability to learn representations shared by multiple languages even in absence of any explicit supervision. However, it remains unclear how these models learn to…

Computation and Language · Computer Science 2022-05-10 Karolina Stańczak , Edoardo Ponti , Lucas Torroba Hennigen , Ryan Cotterell , Isabelle Augenstein

We study the problem of multilingual masked language modeling, i.e. the training of a single model on concatenated text from multiple languages, and present a detailed study of several factors that influence why these models are so…

Computation and Language · Computer Science 2020-05-11 Shijie Wu , Alexis Conneau , Haoran Li , Luke Zettlemoyer , Veselin Stoyanov

While reasoning and multilingual capabilities in language models (LMs) have achieved remarkable progress in recent years, their integration into a unified paradigm - multilingual reasoning - is at a nascent stage. Multilingual reasoning…

Computation and Language · Computer Science 2025-10-15 Akash Ghosh , Debayan Datta , Sriparna Saha , Chirag Agarwal

Large Language Models (LLMs) are increasingly deployed in multilingual and multicultural environments where moral reasoning is essential for generating ethically appropriate responses. Yet, the dominant pretraining of LLMs on…

Computation and Language · Computer Science 2025-09-29 Sualeha Farid , Jayden Lin , Zean Chen , Shivani Kumar , David Jurgens

Natural language processing (NLP) has witnessed a profound impact of large language models (LLMs) that excel in a multitude of tasks. However, the limitation of LLMs in multilingual settings, particularly in underrepresented languages,…

Computation and Language · Computer Science 2024-09-24 Samuel Cahyawijaya

Existing work on probing of pretrained language models (LMs) has predominantly focused on sentence-level syntactic tasks. In this paper, we introduce document-level discourse probing to evaluate the ability of pretrained LMs to capture…

Computation and Language · Computer Science 2021-04-14 Fajri Koto , Jey Han Lau , Timothy Baldwin

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

Computation and Language · Computer Science 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Recent advancements in large language models (LLMs) showcase varied multilingual capabilities across tasks like translation, code generation, and reasoning. Previous assessments often limited their scope to fundamental natural language…

Computation and Language · Computer Science 2025-05-15 Yidan Zhang , Yu Wan , Boyi Deng , Baosong Yang , Haoran Wei , Fei Huang , Bowen Yu , Junyang Lin , Fei Huang , Jingren Zhou

We introduce polyglot language models, recurrent neural network models trained to predict symbol sequences in many different languages using shared representations of symbols and conditioning on typological information about the language to…

Computation and Language · Computer Science 2016-05-13 Yulia Tsvetkov , Sunayana Sitaram , Manaal Faruqui , Guillaume Lample , Patrick Littell , David Mortensen , Alan W Black , Lori Levin , Chris Dyer

Linguistic analysis of language models is one of the ways to explain and describe their reasoning, weaknesses, and limitations. In the probing part of the model interpretability research, studies concern individual languages as well as…

Computation and Language · Computer Science 2022-10-25 Oleg Serikov , Vitaly Protasov , Ekaterina Voloshina , Viktoria Knyazkova , Tatiana Shavrina

In recent years, various methods have been proposed to evaluate gender bias in large language models (LLMs). A key challenge lies in the transferability of bias measurement methods initially developed for the English language when applied…

Computation and Language · Computer Science 2025-07-23 Kristin Gnadt , David Thulke , Simone Kopeinik , Ralf Schlüter

Generative large language models (LLMs) have been shown to exhibit harmful biases and stereotypes. While safety fine-tuning typically takes place in English, if at all, these models are being used by speakers of many different languages.…

Computation and Language · Computer Science 2024-07-18 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Massively multilingual pre-trained language models (MMPLMs) are developed in recent years demonstrating superpowers and the pre-knowledge they acquire for downstream tasks. This work investigates whether MMPLMs can be applied to clinical…

Computation and Language · Computer Science 2023-06-06 Lifeng Han , Gleb Erofeev , Irina Sorokina , Serge Gladkoff , Goran Nenadic

Scaling existing applications and solutions to multiple human languages has traditionally proven to be difficult, mainly due to the language-dependent nature of preprocessing and feature engineering techniques employed in traditional…

Computation and Language · Computer Science 2020-01-01 Xiaotong Liu , Yingbei Tong , Anbang Xu , Rama Akkiraju

In recent years, large language models (e.g., Open AI's GPT-4, Meta's LLaMa, Google's PaLM) have become the dominant approach for building AI systems to analyze and generate language online. However, the automated systems that increasingly…

Computation and Language · Computer Science 2023-06-14 Gabriel Nicholas , Aliya Bhatia

This paper aims for a potential architectural improvement for multilingual learning and asks: Can different tasks from different languages be modeled in a monolithic framework, i.e. without any task/language-specific module? The benefit of…

Computation and Language · Computer Science 2022-11-07 Jinlan Fu , See-Kiong Ng , Pengfei Liu

Large language models (LLMs) are demonstrably capable of cross-lingual transfer, but can produce inconsistent output when prompted with the same queries written in different languages. To understand how language models are able to…

Computation and Language · Computer Science 2025-09-29 Zheng Wei Lim , Alham Fikri Aji , Trevor Cohn

Recent studies in zero-shot cross-lingual learning using multilingual models have falsified the previous hypothesis that shared vocabulary and joint pre-training are the keys to cross-lingual generalization. Inspired by this advancement, we…

Computation and Language · Computer Science 2022-05-20 Evangelia Gogoulou , Ariel Ekgren , Tim Isbister , Magnus Sahlgren