English
Related papers

Related papers: Distributional Open-Ended Evaluation of LLM Cultur…

200 papers

This paper presents a hybrid framework for literature reviews that augments traditional bibliometric methods with large language models (LLMs). By fine-tuning open-source LLMs, our approach enables scalable extraction of qualitative…

Computation and Language · Computer Science 2025-04-21 Stefano M. Iacus , Haodong Qi , Jiyoung Han

With the rapid advancement of large language models (LLMs), aligning them with human values for safety and ethics has become a critical challenge. This problem is especially challenging when multiple, potentially conflicting human values…

Machine Learning · Computer Science 2025-11-25 Hefei Xu , Le Wu , Chen Cheng , Hao Liu

Visual Information Extraction (VIE) plays a crucial role in the comprehension of semi-structured documents, and several pre-trained models have been developed to enhance performance. However, most of these works are monolingual (usually…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Huawen Shen , Gengluo Li , Jinwen Zhong , Yu Zhou

Recent advances in large language models (LLMs) have opened the door to culture-aware language tasks. We introduce the novel problem of adapting wine reviews across Chinese and English, which goes beyond literal translation by incorporating…

Computation and Language · Computer Science 2025-09-17 Chenye Zou , Xingyue Wen , Tianyi Hu , Qian Janice Wang , Daniel Hershcovich

Achievement. We introduce LORE, a systematic framework for Large Generative Model-based relevance in e-commerce search. Deployed and iterated over three years, LORE achieves a cumulative +27\% improvement in online GoodRate metrics. This…

Information Retrieval · Computer Science 2026-01-07 Chenji Lu , Zhuo Chen , Hui Zhao , Zhiyuan Zeng , Gang Zhao , Junjie Ren , Ruicong Xu , Haoran Li , Songyan Liu , Pengjie Wang , Jian Xu , Bo Zheng

Recent advances in reinforcement learning (RL)-based post-training have led to notable improvements in large language models (LLMs), particularly in enhancing their reasoning capabilities to handle complex tasks. However, most existing…

Machine Learning · Computer Science 2025-10-14 Zhenting Wang , Guofeng Cui , Yu-Jhe Li , Kun Wan , Wentian Zhao

Ensuring that Large Language Models (LLMs) align with the diverse and evolving human values across different regions and cultures remains a critical challenge in AI ethics. Current alignment approaches often yield superficial conformity…

Artificial Intelligence · Computer Science 2025-11-04 Jiahao Wang , Songkai Xue , Jinghui Li , Xiaozhen Wang

Code readability is crucial for software comprehension and maintenance, yet difficult to assess at scale. Traditional static metrics often fail to capture the subjective, context-sensitive nature of human judgments. Large Language Models…

As Large Language Models (LLMs) evolve into interactive agents, understanding their behavioral alignment within human social dynamics becomes essential. While behavioral game theory offers a framework to study these interactions, previous…

Multiagent Systems · Computer Science 2026-05-26 Inseo Jung , Yoonseok Oh , Kyungryul Back , Jinkyu Kim , Jungbeom Lee

High-quality and diverse multimodal data are essential for improving vision-language models (VLMs), yet existing datasets often contain noisy, redundant, and poorly aligned samples. To address these problems, data filtering is commonly used…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Biao Wu , Yiwu Zhong , Meng Fang , Ling Chen

Evaluating large language models (LLMs) today rests on fixed benchmarks that apply the same set of items to any model, producing ceiling and floor effects that mask capability gaps. We argue that the most informative evaluation signal lies…

Artificial Intelligence · Computer Science 2026-05-27 Haoxiang Wang , Da Yu , Huishuai Zhang

Knowledge Editing (KE) has emerged as a promising paradigm for updating facts in Large Language Models (LLMs) without retraining. However, progress in Multilingual Knowledge Editing (MKE) is currently hindered by biased evaluation…

Computation and Language · Computer Science 2026-01-27 Yucheng Hu , Wei Zhou , Juesi Xiao

Current Large Language Models (LLMs) typically rely on coarse-grained national labels for pluralistic value alignment. However, such macro-level supervision often obscures intra-country value heterogeneity, yielding a loose alignment. We…

Artificial Intelligence · Computer Science 2026-05-15 Pengyun Zhu , Yuqi Ren , Zhen Wang , Lei Yang , Deyi Xiong

Large Language Models (LLMs) have demonstrated unprecedented capability in code generation. However, LLM-generated code is still plagued with a wide range of functional errors, especially for complex programming tasks that LLMs have not…

Software Engineering · Computer Science 2025-05-13 Yifeng Di , Tianyi Zhang

The diversity of human language, shaped by social, cultural, and regional influences, presents significant challenges for natural language processing (NLP) systems. Existing benchmarks often overlook intra-language variations, leaving…

Computation and Language · Computer Science 2025-04-11 Abhay Gupta , Jacob Cheung , Philip Meng , Shayan Sayyed , Austen Liao , Kevin Zhu , Sean O'Brien

The recent rise of reasoning-tuned Large Language Models (LLMs)--which generate chains of thought (CoTs) before giving the final answer--has attracted significant attention and offers new opportunities for gaining insights into human label…

Computation and Language · Computer Science 2025-09-25 Beiduo Chen , Yang Janet Liu , Anna Korhonen , Barbara Plank

Investigating value alignment in Large Language Models (LLMs) based on cultural context has become a critical area of research. However, similar biases have not been extensively explored in large vision-language models (VLMs). As the scale…

Computation and Language · Computer Science 2025-02-24 Srishti Yadav , Zhi Zhang , Daniel Hershcovich , Ekaterina Shutova

To create culturally inclusive vision-language models (VLMs), developing a benchmark that tests their ability to address culturally relevant questions is essential. Existing approaches typically rely on human annotators, making the process…

Computation and Language · Computer Science 2025-06-02 ChaeHun Park , Yujin Baek , Jaeseok Kim , Yu-Jung Heo , Du-Seong Chang , Jaegul Choo

Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding, often misinterpreting symbols, gestures, and artifacts due to biases in predominantly Western-centric training data. In this paper,…

Artificial Intelligence · Computer Science 2025-01-03 Shudong Liu , Yiqiao Jin , Cheng Li , Derek F. Wong , Qingsong Wen , Lichao Sun , Haipeng Chen , Xing Xie , Jindong Wang

The advancement of large language models (LLMs) has catalyzed a paradigm shift from code generation assistance to autonomous coding agents, enabling a novel development methodology termed "Vibe Coding" where developers validate AI-generated…