English
Related papers

Related papers: Extrinsic Evaluation of Cultural Competence in Lar…

200 papers

There is a bidirectional relationship between culture and AI; AI models are increasingly used to analyse culture, thereby shaping our understanding of culture. On the other hand, the models are trained on collections of cultural artifacts…

Computers and Society · Computer Science 2022-11-15 Nanne van Noord , Melvin Wevers , Tobias Blanke , Julia Noordegraaf , Marcel Worring

Cultural representation in Large Language Model (LLM) outputs has primarily been evaluated through the proxies of cultural diversity and factual accuracy. However, a crucial gap remains in assessing cultural alignment: the degree to which…

Computation and Language · Computer Science 2026-04-07 Erin MacMurray van Liemt , Aida Davani , Sinchana Kumbale , Neha Dixit , Sunipa Dev

Large Language Models (LLMs) have emerged as a groundbreaking technology with their unparalleled text generation capabilities across various applications. Nevertheless, concerns persist regarding the accuracy and appropriateness of their…

Computation and Language · Computer Science 2024-03-15 Jie Huang , Xinyun Chen , Swaroop Mishra , Huaixiu Steven Zheng , Adams Wei Yu , Xinying Song , Denny Zhou

Research in cultural evolution aims at providing causal explanations for the change of culture over time. Over the past decades, this field has generated an important body of knowledge, using experimental, historical, and computational…

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

Computation and Language · Computer Science 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing

This paper seeks to develop a deeper understanding of the fundamental properties of neural text generations models. The study of artifacts that emerge in machine generated text as a result of modeling choices is a nascent research area.…

Computation and Language · Computer Science 2020-04-15 Yi Tay , Dara Bahri , Che Zheng , Clifford Brunk , Donald Metzler , Andrew Tomkins

We present a literature survey on non-interactive computational story generation. The article starts with the presentation of requirements for creative systems, three types of models of creativity (computational, socio-cultural, and…

Computation and Language · Computer Science 2021-10-22 Luis Miguel Botelho

Referential games and reconstruction games are the most common game types for studying emergent languages. We investigate how the type of the language game affects the emergent language in terms of: i) language compositionality and ii)…

Computation and Language · Computer Science 2020-12-08 Shangmin Guo , Yi Ren , Agnieszka Słowik , Kory Mathewson

Text-To-Image (TTI) models, such as DALL-E and StableDiffusion, have demonstrated remarkable prompt-based image generation capabilities. Multilingual encoders may have a substantial impact on the cultural agency of these models, as language…

Computation and Language · Computer Science 2024-08-14 Mor Ventura , Eyal Ben-David , Anna Korhonen , Roi Reichart

This paper investigates the inherent knowledge in language models from the perspective of epistemological holism. The purpose of this paper is to explore whether LLMs exhibit characteristics consistent with epistemological holism. These…

Computation and Language · Computer Science 2024-03-20 Minsu Kim , James Thorne

Knowledge built culturally across generations allows humans to learn far more than an individual could glean from their own experience in a lifetime. Cultural knowledge in turn rests on language: language is the richest record of what…

Computation and Language · Computer Science 2021-12-17 Michael Henry Tessler , Jason Madeano , Pedro A. Tsividis , Brin Harper , Noah D. Goodman , Joshua B. Tenenbaum

Probing and enhancing large language models' reasoning capacity remains a crucial open question. Here we re-purpose the reverse dictionary task as a case study to probe LLMs' capacity for conceptual inference. We use in-context learning to…

Computation and Language · Computer Science 2024-02-27 Ningyu Xu , Qi Zhang , Menghan Zhang , Peng Qian , Xuanjing Huang

The awareness of multi-cultural human values is critical to the ability of language models (LMs) to generate safe and personalized responses. However, this awareness of LMs has been insufficiently studied, since the computer science…

Computation and Language · Computer Science 2024-04-26 Wenlong Zhao , Debanjan Mondal , Niket Tandon , Danica Dillion , Kurt Gray , Yuling Gu

Our study aims to identify behavior patterns in cultural values exhibited by large language models (LLMs). The studied variants include question ordering, prompting language, and model size. Our experiments reveal that each tested LLM can…

Computers and Society · Computer Science 2024-07-25 Qishuai Zhong , Yike Yun , Aixin Sun

Moral norms vary across cultures. A recent line of work suggests that English large language models contain human-like moral biases, but these studies typically do not examine moral variation in a diverse cultural setting. We investigate…

Computation and Language · Computer Science 2023-06-06 Aida Ramezani , Yang Xu

This survey examines multilingual vision-language models that process text and images across languages. We review 33 models and 23 benchmarks, spanning encoder-only and generative architectures, and identify a key tension between language…

Computation and Language · Computer Science 2026-05-14 Andrei-Alexandru Manea , Jindřich Libovický

Scaling up language models has been shown to predictably improve performance and sample efficiency on a wide range of downstream tasks. This paper instead discusses an unpredictable phenomenon that we refer to as emergent abilities of large…

Cultural competence, defined as the ability to understand and adapt to multicultural contexts, is increasingly vital for large language models (LLMs) in global environments. While several cultural benchmarks exist to assess LLMs' cultural…

Computation and Language · Computer Science 2025-09-16 Xinyu Zhang , Pei Zhang , Shuang Luo , Jialong Tang , Yu Wan , Baosong Yang , Fei Huang

Technology for open-ended language generation, a key application of artificial intelligence, has advanced to a great extent in recent years. Large-scale language models, which are trained on large corpora of text, are being used in a wide…

Computation and Language · Computer Science 2023-05-12 Saketh Reddy Karra , Son The Nguyen , Theja Tulabandhula

Online reviews have become essential for users to make informed decisions in everyday tasks ranging from planning summer vacations to purchasing groceries and making financial investments. A key problem in using online reviews is the…

Information Retrieval · Computer Science 2023-05-09 Khaled Alanezi , Nuha Albadi , Omar Hammad , Maram Kurdi , Shivakant Mishra
‹ Prev 1 3 4 5 6 7 10 Next ›