English
Related papers

Related papers: Scaling Cultural Resources for Improving Generativ…

200 papers

Cultural accumulation drives the open-ended and diverse progress in capabilities spanning human history. It builds an expanding body of knowledge and skills by combining individual exploration with inter-generational information…

Artificial Intelligence · Computer Science 2024-10-29 Jonathan Cook , Chris Lu , Edward Hughes , Joel Z. Leibo , Jakob Foerster

Large language models are trained on massive scrapes of the web, as required by current scaling laws. Most progress is made for English, given its abundance of high-quality pretraining data. For most other languages, however, such high…

Computation and Language · Computer Science 2025-02-07 Skyler Seto , Maartje ter Hoeve , Richard He Bai , Natalie Schluter , David Grangier

The rapid advancement of generative models has empowered modern AI systems to comprehend and produce highly sophisticated content, even achieving human-level performance in specific domains. However, these models are fundamentally…

Multilingual large language models (MLLMs) are increasingly deployed across cultural, linguistic, and political contexts, yet existing governance frameworks largely assume English-centric data, homogeneous user populations, and abstract…

Computation and Language · Computer Science 2026-02-03 Hanjing Shi , Dominic DiFranzo

Large Language Models (LLMs) are known to lack cultural representation and overall diversity in their generations, from expressing opinions to answering factual questions. To mitigate this problem, we propose multilingual prompting: a…

Computation and Language · Computer Science 2025-09-30 Qihan Wang , Shidong Pan , Tal Linzen , Emily Black

Multilingual NLP is often treated as a route to global inclusion, but linguistic coverage and cultural competence frequently diverge. This paper synthesizes over 50 papers spanning multilingual performance inequality, cross-lingual…

Computation and Language · Computer Science 2026-05-05 Sina Bagheri Nezhad

Generative AI systems are increasingly recognized as cultural technologies, yet current evaluation frameworks often treat culture as a variable to be measured rather than fundamental to the system's operation. Drawing on hermeneutic theory…

There is a bidirectional relationship between culture and AI; AI models are increasingly used to analyse culture, thereby shaping our understanding of culture. On the other hand, the models are trained on collections of cultural artifacts…

Computers and Society · Computer Science 2022-11-15 Nanne van Noord , Melvin Wevers , Tobias Blanke , Julia Noordegraaf , Marcel Worring

Content moderation on a global scale must navigate a complex array of local cultural distinctions, which can hinder effective enforcement. While global policies aim for consistency and broad applicability, they often miss the subtleties of…

The remarkable ability of Large Language Models (LLMs) to understand and follow instructions has sometimes been limited by their in-context learning (ICL) performance in low-resource languages. To address this, we introduce a novel approach…

Computation and Language · Computer Science 2023-12-06 Xiaoqian Li , Ercong Nie , Sheng Liang

Knowledge built culturally across generations allows humans to learn far more than an individual could glean from their own experience in a lifetime. Cultural knowledge in turn rests on language: language is the richest record of what…

Computation and Language · Computer Science 2021-12-17 Michael Henry Tessler , Jason Madeano , Pedro A. Tsividis , Brin Harper , Noah D. Goodman , Joshua B. Tenenbaum

Culture fundamentally shapes people's reasoning, behavior, and communication. As people increasingly use generative artificial intelligence (AI) to expedite and automate personal and professional tasks, cultural values embedded in AI models…

Computation and Language · Computer Science 2024-09-20 Yan Tao , Olga Viberg , Ryan S. Baker , Rene F. Kizilcec

Achieving high-performing language models which include medium- and lower-resource languages remains a challenge. Massively multilingual models still underperform compared to language-specific adaptations, especially at smaller model…

Computation and Language · Computer Science 2025-12-12 Kevin Glocker , Kätriin Kukk , Romina Oji , Marcel Bollmann , Marco Kuhlmann , Jenny Kunz

Preserving ancient languages is essential for understanding humanity's cultural and linguistic heritage, yet Old English remains critically under-resourced, limiting its accessibility to modern natural language processing (NLP) techniques.…

Computation and Language · Computer Science 2025-07-29 Rodrigo Gabriel Salazar Alva , Matías Nuñez , Cristian López , Javier Martín Arista

Pretrained large language models have revolutionized many applications but still face challenges related to cultural bias and a lack of cultural commonsense knowledge crucial for guiding cross-culture communication and interactions.…

Computation and Language · Computer Science 2024-02-15 Yi Fung , Ruining Zhao , Jae Doo , Chenkai Sun , Heng Ji

Productive interactions between diverse users and language technologies require outputs from the latter to be culturally relevant and sensitive. Prior works have evaluated models' knowledge of cultural norms, values, and artifacts, without…

Computation and Language · Computer Science 2024-10-07 Shaily Bhatt , Fernando Diaz

The field of deep generative modeling has grown rapidly in the last few years. With the availability of massive amounts of training data coupled with advances in scalable unsupervised learning paradigms, recent large-scale generative models…

Bilingual and multilingual language models offer a promising path toward scaling NLP systems across diverse languages and users. However, their performance often varies wildly between languages as prior works show that adding more languages…

Computation and Language · Computer Science 2025-06-17 Skyler Seto , Maartje ter Hoeve , Maureen de Seyssel , David Grangier

Although Large Language Models (LLMs) demonstrate strong capabilities across various tasks, they exhibit significant performance discrepancies across languages. While prompting LLMs in English typically yields the highest general…

Computation and Language · Computer Science 2026-05-26 Andrew Ivan Soegeng , Patrick Sutanto , Tan Sang Nguyen

With the recent progress in generative artificial intelligence (Generative AI), particularly in the development of large language models, recommendation systems are evolving to become more versatile. Unlike traditional techniques,…

Information Retrieval · Computer Science 2025-06-23 Zihan Hong , Yushi Wu , Zhiting Zhao , Shanshan Feng , Jianghong Ma , Jiao Liu , Tianjun Wei