中文
相关论文

相关论文: Distributional Open-Ended Evaluation of LLM Cultur…

200 篇论文

This paper presents a hybrid framework for literature reviews that augments traditional bibliometric methods with large language models (LLMs). By fine-tuning open-source LLMs, our approach enables scalable extraction of qualitative…

计算与语言 · 计算机科学 2025-04-21 Stefano M. Iacus , Haodong Qi , Jiyoung Han

With the rapid advancement of large language models (LLMs), aligning them with human values for safety and ethics has become a critical challenge. This problem is especially challenging when multiple, potentially conflicting human values…

机器学习 · 计算机科学 2025-11-25 Hefei Xu , Le Wu , Chen Cheng , Hao Liu

Visual Information Extraction (VIE) plays a crucial role in the comprehension of semi-structured documents, and several pre-trained models have been developed to enhance performance. However, most of these works are monolingual (usually…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Huawen Shen , Gengluo Li , Jinwen Zhong , Yu Zhou

Recent advances in large language models (LLMs) have opened the door to culture-aware language tasks. We introduce the novel problem of adapting wine reviews across Chinese and English, which goes beyond literal translation by incorporating…

计算与语言 · 计算机科学 2025-09-17 Chenye Zou , Xingyue Wen , Tianyi Hu , Qian Janice Wang , Daniel Hershcovich

Achievement. We introduce LORE, a systematic framework for Large Generative Model-based relevance in e-commerce search. Deployed and iterated over three years, LORE achieves a cumulative +27\% improvement in online GoodRate metrics. This…

信息检索 · 计算机科学 2026-01-07 Chenji Lu , Zhuo Chen , Hui Zhao , Zhiyuan Zeng , Gang Zhao , Junjie Ren , Ruicong Xu , Haoran Li , Songyan Liu , Pengjie Wang , Jian Xu , Bo Zheng

Recent advances in reinforcement learning (RL)-based post-training have led to notable improvements in large language models (LLMs), particularly in enhancing their reasoning capabilities to handle complex tasks. However, most existing…

机器学习 · 计算机科学 2025-10-14 Zhenting Wang , Guofeng Cui , Yu-Jhe Li , Kun Wan , Wentian Zhao

Ensuring that Large Language Models (LLMs) align with the diverse and evolving human values across different regions and cultures remains a critical challenge in AI ethics. Current alignment approaches often yield superficial conformity…

人工智能 · 计算机科学 2025-11-04 Jiahao Wang , Songkai Xue , Jinghui Li , Xiaozhen Wang

Code readability is crucial for software comprehension and maintenance, yet difficult to assess at scale. Traditional static metrics often fail to capture the subjective, context-sensitive nature of human judgments. Large Language Models…

As Large Language Models (LLMs) evolve into interactive agents, understanding their behavioral alignment within human social dynamics becomes essential. While behavioral game theory offers a framework to study these interactions, previous…

多智能体系统 · 计算机科学 2026-05-26 Inseo Jung , Yoonseok Oh , Kyungryul Back , Jinkyu Kim , Jungbeom Lee

High-quality and diverse multimodal data are essential for improving vision-language models (VLMs), yet existing datasets often contain noisy, redundant, and poorly aligned samples. To address these problems, data filtering is commonly used…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Biao Wu , Yiwu Zhong , Meng Fang , Ling Chen

Evaluating large language models (LLMs) today rests on fixed benchmarks that apply the same set of items to any model, producing ceiling and floor effects that mask capability gaps. We argue that the most informative evaluation signal lies…

人工智能 · 计算机科学 2026-05-27 Haoxiang Wang , Da Yu , Huishuai Zhang

Knowledge Editing (KE) has emerged as a promising paradigm for updating facts in Large Language Models (LLMs) without retraining. However, progress in Multilingual Knowledge Editing (MKE) is currently hindered by biased evaluation…

计算与语言 · 计算机科学 2026-01-27 Yucheng Hu , Wei Zhou , Juesi Xiao

Current Large Language Models (LLMs) typically rely on coarse-grained national labels for pluralistic value alignment. However, such macro-level supervision often obscures intra-country value heterogeneity, yielding a loose alignment. We…

人工智能 · 计算机科学 2026-05-15 Pengyun Zhu , Yuqi Ren , Zhen Wang , Lei Yang , Deyi Xiong

Large Language Models (LLMs) have demonstrated unprecedented capability in code generation. However, LLM-generated code is still plagued with a wide range of functional errors, especially for complex programming tasks that LLMs have not…

软件工程 · 计算机科学 2025-05-13 Yifeng Di , Tianyi Zhang

The diversity of human language, shaped by social, cultural, and regional influences, presents significant challenges for natural language processing (NLP) systems. Existing benchmarks often overlook intra-language variations, leaving…

计算与语言 · 计算机科学 2025-04-11 Abhay Gupta , Jacob Cheung , Philip Meng , Shayan Sayyed , Austen Liao , Kevin Zhu , Sean O'Brien

The recent rise of reasoning-tuned Large Language Models (LLMs)--which generate chains of thought (CoTs) before giving the final answer--has attracted significant attention and offers new opportunities for gaining insights into human label…

计算与语言 · 计算机科学 2025-09-25 Beiduo Chen , Yang Janet Liu , Anna Korhonen , Barbara Plank

Investigating value alignment in Large Language Models (LLMs) based on cultural context has become a critical area of research. However, similar biases have not been extensively explored in large vision-language models (VLMs). As the scale…

计算与语言 · 计算机科学 2025-02-24 Srishti Yadav , Zhi Zhang , Daniel Hershcovich , Ekaterina Shutova

To create culturally inclusive vision-language models (VLMs), developing a benchmark that tests their ability to address culturally relevant questions is essential. Existing approaches typically rely on human annotators, making the process…

计算与语言 · 计算机科学 2025-06-02 ChaeHun Park , Yujin Baek , Jaeseok Kim , Yu-Jung Heo , Du-Seong Chang , Jaegul Choo

Vision-language models (VLMs) have advanced human-AI interaction but struggle with cultural understanding, often misinterpreting symbols, gestures, and artifacts due to biases in predominantly Western-centric training data. In this paper,…

人工智能 · 计算机科学 2025-01-03 Shudong Liu , Yiqiao Jin , Cheng Li , Derek F. Wong , Qingsong Wen , Lichao Sun , Haipeng Chen , Xing Xie , Jindong Wang

The advancement of large language models (LLMs) has catalyzed a paradigm shift from code generation assistance to autonomous coding agents, enabling a novel development methodology termed "Vibe Coding" where developers validate AI-generated…