English
Related papers

Related papers: Extrinsic Evaluation of Cultural Competence in Lar…

200 papers

Despite substantial research efforts evaluating how well large language models~(LLMs) handle global cultural diversity, the mechanisms behind their cultural knowledge acquisition, particularly in multilingual settings, remain unclear. We…

Computation and Language · Computer Science 2025-06-03 Chen Zhang , Zhiyuan Liao , Yansong Feng

This study explores the relationship between cultural awareness, stereotypes, and communication skills among Algerian participants working or studying in multicultural environments. A quantitative questionnaire was administered to 40…

Computers and Society · Computer Science 2025-11-18 Mohamed Amine Kada Zair

Story-writing is a fundamental aspect of human imagination, relying heavily on creativity to produce narratives that are novel, effective, and surprising. While large language models (LLMs) have demonstrated the ability to generate…

Computation and Language · Computer Science 2025-05-13 Mete Ismayilzada , Claire Stevenson , Lonneke van der Plas

Understanding how styles differ across languages is advantageous for training both humans and computers to generate culturally appropriate text. We introduce an explanation framework to extract stylistic differences from multilingual LMs…

Computation and Language · Computer Science 2025-03-27 Shreya Havaldar , Matthew Pressimone , Eric Wong , Lyle Ungar

Despite widespread success in language understanding and generation, large language models (LLMs) exhibit unclear and often inconsistent behavior when faced with tasks that require probabilistic reasoning. In this work, we present the first…

Computation and Language · Computer Science 2025-09-29 Mobina Pournemat , Keivan Rezaei , Gaurang Sriramanan , Arman Zarei , Jiaxiang Fu , Yang Wang , Hamid Eghbalzadeh , Soheil Feizi

LLMs often default to equal treatment across cultural groups, even though context warrants differentiation: this is a lack of difference awareness. Using mechanistic interpretability and a factorial design on the N4 cultural appropriation…

Artificial Intelligence · Computer Science 2026-05-28 Avrile Floro , Luca Benedetto

As large language models (LLMs) advance in their linguistic capacity, understanding how they capture aspects of language competence remains a significant challenge. This study therefore employs psycholinguistic paradigms in English, which…

Computation and Language · Computer Science 2024-12-12 Xufeng Duan , Xinyu Zhou , Bei Xiao , Zhenguang G. Cai

Large language models generate complex, open-ended outputs: instead of outputting a class label they write summaries, generate dialogue, or produce working code. In order to asses the reliability of these open-ended generation systems, we…

Computation and Language · Computer Science 2022-11-28 Erik Jones , Jacob Steinhardt

We present a survey of more than 90 recent papers that aim to study cultural representation and inclusion in large language models (LLMs). We observe that none of the studies explicitly define "culture, which is a complex, multifaceted…

We propose iteratively prompting a large language model to self-correct a translation, with inspiration from their strong language understanding and translation capability as well as a human-like translation approach. Interestingly,…

Computation and Language · Computer Science 2024-05-03 Pinzhen Chen , Zhicheng Guo , Barry Haddow , Kenneth Heafield

In recent years, Large Language Models have garnered significant attention for their strong performance in various natural language tasks, such as machine translation and question answering. These models demonstrate an impressive ability to…

Computation and Language · Computer Science 2025-02-21 Qibang Liu , Wenzhe Wang , Jeffrey Willard

This chapter critically examines the potential contributions of modern language models to theoretical linguistics. Despite their focus on engineering goals, these models' ability to acquire sophisticated linguistic knowledge from mere…

Computation and Language · Computer Science 2024-08-15 Raphaël Millière

Existing simulations designed for cultural and interpersonal skill training rely on pre-defined responses with a menu option selection interface. Using a multiple-choice interface and restricting trainees' responses may limit the trainees'…

Computers and Society · Computer Science 2021-10-19 Sodiq Adewole , Erfaneh Gharavi , Benjamin Shpringer , Martin Bolger , Vaibhav Sharma , Sung Ming Yang , Donald E. Brown

Text-to-image diffusion models have recently enabled the creation of visually compelling, detailed images from textual prompts. However, their ability to accurately represent various cultural nuances remains an open question. In our work,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zahra Bayramli , Ayhan Suleymanzade , Na Min An , Huzama Ahmad , Eunsu Kim , Junyeong Park , James Thorne , Alice Oh

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

Adapting large language models (LLMs) to diverse cultural values is a challenging task, as existing LLMs often reflect the values of specific groups by default, and potentially causing harm to others. In this paper, we present CLCA, a novel…

Computation and Language · Computer Science 2025-04-07 Chen Cecilia Liu , Anna Korhonen , Iryna Gurevych

This paper outlines the implications of neural-level accounts of insight, and models of the conceptual interactions that underlie creativity, for a theory of cultural evolution. Since elements of human culture exhibit cumulative, adaptive,…

Neurons and Cognition · Quantitative Biology 2019-03-15 Liane Gabora

The meteoric rise in text generation capability has been accompanied by parallel growth in interest in machine-generated text detection: the capability to identify whether a given text was generated using a model or written by a person.…

Computation and Language · Computer Science 2026-04-24 Kevin Stowe , Svetlana Afanaseva , Rodolfo Raimundo , Yitao Sun , Kailash Patil

Large language models (LLMs) encode rich cultural knowledge learned from diverse web-scale data, offering an unprecedented opportunity to model cultural commonsense at scale. Yet this knowledge remains mostly implicit and unstructured,…

Computation and Language · Computer Science 2026-01-27 Junior Cedric Tonga , Chen Cecilia Liu , Iryna Gurevych , Fajri Koto

Context: Social aspects are of high importance for being successful using agile methods in software development. People are influenced by their cultural imprint, as the underlying cultural values are guiding us in how we think and act.…

Software Engineering · Computer Science 2023-11-22 Daniel Welsch , Luisa Burk , David Mötefindt , Michael Neumann