English
Related papers

Related papers: Socio-Culturally Aware Evaluation Framework for LL…

200 papers

Research in cultural evolution aims at providing causal explanations for the change of culture over time. Over the past decades, this field has generated an important body of knowledge, using experimental, historical, and computational…

Improving cultural competence of language technologies is important. However most recent works rarely engage with the communities they study, and instead rely on synthetic setups and imperfect proxies of culture. In this work, we take a…

Computation and Language · Computer Science 2025-06-13 Shaily Bhatt , Tal August , Maria Antoniak

Large language models (LLMs) have demonstrated significant capabilities in solving mathematical problems expressed in natural language. However, multilingual and culturally-grounded mathematical reasoning in low-resource languages lags…

Computation and Language · Computer Science 2026-04-21 Israel Abebe Azime , Tadesse Destaw Belay , Dietrich Klakow , Philipp Slusallek , Anshuman Chhabra

As large language models (LLMs) become increasingly accessible in many countries, it is essential to align them to serve pluralistic human values across cultures. However, pluralistic culture alignment in LLMs remain an open problem. In…

Computation and Language · Computer Science 2024-10-18 Shaoyang Xu , Yongqi Leng , Linhao Yu , Deyi Xiong

Large Language Models (LLMs) have emerged as powerful tools for generating data across various modalities. By transforming data from a scarce resource into a controllable asset, LLMs mitigate the bottlenecks imposed by the acquisition costs…

Large Language Models' (LLMs) ability to converse naturally is empowered by their ability to empathetically understand and respond to their users. However, emotional experiences are shaped by demographic and cultural contexts. This raises…

Computation and Language · Computer Science 2025-10-28 Ananya Malik , Nazanin Sabri , Melissa Karnaze , Mai Elsherief

Fashion content generation is an emerging area at the intersection of artificial intelligence and creative design, with applications ranging from virtual try-on to culturally diverse design prototyping. Existing methods often struggle with…

Computation and Language · Computer Science 2025-01-28 Spencer Ramsey , Amina Grant , Jeffrey Lee

Social bias is shaped by the accumulation of social perceptions towards targets across various demographic identities. To fully understand such social bias in large language models (LLMs), it is essential to consider the composite of social…

Computation and Language · Computer Science 2024-06-07 Jisu Shin , Hoyun Song , Huije Lee , Soyeong Jeong , Jong C. Park

Humans adjust their linguistic style to the audience they are addressing. However, the extent to which LLMs adapt to different social contexts is largely unknown. As these models increasingly mediate human-to-human communication, their…

Computation and Language · Computer Science 2026-02-13 Elisa Bassignana , Mike Zhang , Dirk Hovy , Amanda Cercas Curry

As the volume of video content online grows exponentially, the demand for moderation of unsafe videos has surpassed human capabilities, posing both operational and mental health challenges. While recent studies demonstrated the merits of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Adi Levi , Or Levi , Sardhendu Mishra , Jonathan Morra

Are AI systems truly representing human values, or merely averaging across them? Our study suggests a concerning reality: Large Language Models (LLMs) fail to represent diverse cultural moral frameworks despite their linguistic…

Computation and Language · Computer Science 2025-08-01 Simon Münker

Large language models (LLMs) are increasingly deployed in culturally sensitive real-world tasks. However, existing cultural alignment approaches fail to align LLMs' broad cultural values with the specific goals of downstream tasks and…

Computation and Language · Computer Science 2026-02-27 Binchi Zhang , Xujiang Zhao , Jundong Li , Haifeng Chen , Zhengzhang Chen

The sheer volume of online user-generated content has rendered content moderation technologies essential in order to protect digital platform audiences from content that may cause anxiety, worry, or concern. Despite the efforts towards…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Ioannis Sarridis , Christos Koutlis , Olga Papadopoulou , Symeon Papadopoulos

Large language models (LLMs) are increasingly deployed as autonomous agents, yet evaluations focus primarily on task success rather than cultural appropriateness or evaluator reliability. We introduce LiveCultureBench, a multi-cultural,…

Artificial Intelligence · Computer Science 2026-03-03 Viet-Thanh Pham , Lizhen Qu , Thuy-Trang Vu , Gholamreza Haffari , Dinh Phung

Large language models (LLMs) are increasingly deployed in culturally diverse environments, yet existing evaluations of cultural competence remain limited. Existing methods focus on de-contextualized correctness or forced-choice judgments,…

Computation and Language · Computer Science 2025-11-18 Truong Vo , Sanmi Koyejo

This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background,…

Robotics · Computer Science 2024-06-26 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

This position paper argues that large language models (LLMs) can make cultural context, and therefore human meaning, legible at an unprecedented scale in AI-based sociotechnical systems. We argue that such systems have previously been…

Computation and Language · Computer Science 2026-01-28 Cody Kommers , Drew Hemment , Maria Antoniak , Joel Z. Leibo , Hoyt Long , Emily Robinson , Adam Sobey

Recent trends in LLMs development clearly show growing interest in the use and application of sovereign LLMs. The global debate over sovereign LLMs highlights the need for governments to develop their LLMs, tailored to their unique…

Computation and Language · Computer Science 2025-10-17 Kyubyung Chae , Gihoon Kim , Gyuseong Lee , Taesup Kim , Jaejin Lee , Heejin Kim

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

Sensitive information detection is crucial in content moderation to maintain safe online communities. Assisting in this traditionally manual process could relieve human moderators from overwhelming and tedious tasks, allowing them to focus…