English
Related papers

Related papers: Towards A Cultural Intelligence and Values Inferen…

200 papers

LLMs as intelligent agents are being increasingly applied in scenarios where human interactions are involved, leading to a critical concern about whether LLMs are faithful to the variations in culture across regions. Several works have…

Computers and Society · Computer Science 2025-04-15 Nicholas Sukiennik , Chen Gao , Fengli Xu , Yong Li

To create culturally inclusive vision-language models (VLMs), developing a benchmark that tests their ability to address culturally relevant questions is essential. Existing approaches typically rely on human annotators, making the process…

Computation and Language · Computer Science 2025-06-02 ChaeHun Park , Yujin Baek , Jaeseok Kim , Yu-Jung Heo , Du-Seong Chang , Jaegul Choo

Cultural bias is pervasive in many large language models (LLMs), largely due to the deficiency of data representative of different cultures. Typically, cultural datasets and benchmarks are constructed either by extracting subsets of…

Artificial Intelligence · Computer Science 2024-11-22 Cheng Li , Damien Teney , Linyi Yang , Qingsong Wen , Xing Xie , Jindong Wang

We introduce MENAValues, a novel benchmark designed to evaluate the cultural alignment and multilingual biases of large language models (LLMs) with respect to the beliefs and values of the Middle East and North Africa (MENA) region, an…

Computation and Language · Computer Science 2025-10-16 Pardis Sadat Zahraei , Ehsaneddin Asgari

As Large Language Models (LLMs) increasingly influence high-stakes decision-making across global contexts, ensuring their alignment with diverse cultural values has become a critical governance challenge. This study presents a Multi-Layered…

Computers and Society · Computer Science 2025-11-24 Haijiang Liu , Jinguang Gu , Xun Wu , Daniel Hershcovich , Qiaoling Xiao

Large language models (LLMs) are used worldwide, yet exhibit Western cultural tendencies. Many countries are now building ``regional'' or ``sovereign'' LLMs, but it remains unclear whether they reflect local values and practices or merely…

Computation and Language · Computer Science 2026-01-26 Dhruv Agarwal , Anya Shukla , Sunayana Sitaram , Aditya Vashistha

Large language models (LLMs) alignment ensures model behaviors reflect human value. Existing alignment strategies primarily follow two paths: one assumes a universal value set for a unified goal (i.e., one-size-fits-all), while the other…

Computation and Language · Computer Science 2026-01-21 Jiayu Lin , Zhongyu Wei

Do Large Language Models (LLMs) hold positions that conflict with your country's values? Occasionally they do! However, existing works primarily focus on ethical reviews, failing to capture the diversity of national values, which encompass…

Computation and Language · Computer Science 2025-04-22 Weijie Shi , Chengyi Ju , Chengzhong Liu , Jiaming Ji , Jipeng Zhang , Ruiyuan Zhang , Jia Zhu , Jiajie Xu , Yaodong Yang , Sirui Han , Yike Guo

Existing benchmarks that measure cultural adaptation in LLMs are misaligned with the actual challenges these models face when interacting with users from diverse cultural backgrounds. In this work, we introduce the first framework and…

Computation and Language · Computer Science 2025-10-14 Shreya Havaldar , Sunny Rai , Young-Min Cho , Lyle Ungar

Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding, often misinterpreting symbols, gestures, and artifacts due to biases in predominantly Western-centric training data. In this paper,…

Artificial Intelligence · Computer Science 2025-01-03 Shudong Liu , Yiqiao Jin , Cheng Li , Derek F. Wong , Qingsong Wen , Lichao Sun , Haipeng Chen , Xing Xie , Jindong Wang

Large Language Models (LLMs) are predominantly trained and aligned in ways that reinforce Western-centric epistemologies and socio-cultural norms, leading to cultural homogenization and limiting their ability to reflect global…

Computation and Language · Computer Science 2025-05-15 Abdullah Mushtaq , Imran Taj , Rafay Naeem , Ibrahim Ghaznavi , Junaid Qadir

This paper is devoted to the development of a localized Large Language Model (LLM) specifically for Arabic, a language imbued with unique cultural characteristics inadequately addressed by current mainstream models. Significant concerns…

Large language models (LLMs) are deployed globally, yet their underlying cultural and ethical assumptions remain underexplored. We propose the notion of a "cultural gene" -- a systematic value orientation that LLMs inherit from their…

Computation and Language · Computer Science 2025-12-30 Emanuel Z. Fenech-Borg , Tilen P. Meznaric-Kos , Milica D. Lekovic-Bojovic , Arni J. Hentze-Djurhuus

Large language models (LLMs) have demonstrated substantial commonsense understanding through numerous benchmark evaluations. However, their understanding of cultural commonsense remains largely unexamined. In this paper, we conduct a…

Computation and Language · Computer Science 2024-05-09 Siqi Shen , Lajanugen Logeswaran , Moontae Lee , Honglak Lee , Soujanya Poria , Rada Mihalcea

The intricate relationship between language and culture has long been a subject of exploration within the realm of linguistic anthropology. Large Language Models (LLMs), promoted as repositories of collective human knowledge, raise a…

Computation and Language · Computer Science 2024-07-09 Badr AlKhamissi , Muhammad ElNokrashy , Mai AlKhamissi , Mona Diab

For Large Language Models (LLMs), a disconnect persists between benchmark performance and real-world utility. Current evaluation frameworks remain fragmented, prioritizing technical metrics while neglecting holistic assessment for…

Artificial Intelligence · Computer Science 2025-11-19 Jun Wang , Ninglun Gu , Kailai Zhang , Zijiao Zhang , Yelun Bao , Jin Yang , Xu Yin , Liwei Liu , Yihuan Liu , Pengyong Li , Gary G. Yen , Junchi Yan

Large Language Models (LLMs) have shown strong performance across many tasks, but their ability to capture culturally diverse moral values remains unclear. In this paper, we examine whether LLMs mirror variations in moral attitudes reported…

Computation and Language · Computer Science 2026-03-31 Hadi Mohammadi , Ayoub Bagheri

Knowledge Editing (KE) has emerged as a promising paradigm for updating facts in Large Language Models (LLMs) without retraining. However, progress in Multilingual Knowledge Editing (MKE) is currently hindered by biased evaluation…

Computation and Language · Computer Science 2026-01-27 Yucheng Hu , Wei Zhou , Juesi Xiao

The advancement of large language models (LLMs) has enhanced the ability to generalize across a wide range of unseen natural language processing (NLP) tasks through instruction-following. Yet, their effectiveness often diminishes in…

Large language models (LLMs) are increasingly deployed in culturally sensitive real-world tasks. However, existing cultural alignment approaches fail to align LLMs' broad cultural values with the specific goals of downstream tasks and…

Computation and Language · Computer Science 2026-02-27 Binchi Zhang , Xujiang Zhao , Jundong Li , Haifeng Chen , Zhengzhang Chen