English
Related papers

Related papers: Heterogeneous Value Alignment Evaluation for Large…

200 papers

A key challenge in training Large Language Models (LLMs) is properly aligning them with human preferences. Reinforcement Learning with Human Feedback (RLHF) uses pairwise comparisons from human annotators to train reward functions and has…

Machine Learning · Computer Science 2025-01-17 Ariel D. Procaccia , Benjamin Schiffer , Shirley Zhang

Large language models (LLMs) alignment ensures model behaviors reflect human value. Existing alignment strategies primarily follow two paths: one assumes a universal value set for a unified goal (i.e., one-size-fits-all), while the other…

Computation and Language · Computer Science 2026-01-21 Jiayu Lin , Zhongyu Wei

The wide exploration of large language models (LLMs) raises the awareness of alignment between healthcare stakeholder preferences and model outputs. This alignment becomes a crucial foundation to empower the healthcare workflow effectively,…

Computers and Society · Computer Science 2025-05-07 Kexin Ding , Mu Zhou , Akshay Chaudhari , Shaoting Zhang , Dimitris N. Metaxas

For Large Language Models (LLMs), a disconnect persists between benchmark performance and real-world utility. Current evaluation frameworks remain fragmented, prioritizing technical metrics while neglecting holistic assessment for…

Artificial Intelligence · Computer Science 2025-11-19 Jun Wang , Ninglun Gu , Kailai Zhang , Zijiao Zhang , Yelun Bao , Jin Yang , Xu Yin , Liwei Liu , Yihuan Liu , Pengyong Li , Gary G. Yen , Junchi Yan

There are many methods and systems to tackle the ontology alignment problem, yet a major challenge persists in producing high-quality mappings among a set of input ontologies. Adopting a human-in-the-loop approach during the alignment…

Artificial Intelligence · Computer Science 2026-02-17 Sviatoslav Lushnei , Dmytro Shumskyi , Severyn Shykula , Ernesto Jimenez-Ruiz , Artur d'Avila Garcez

Big models, exemplified by Large Language Models (LLMs), are models typically pre-trained on massive data and comprised of enormous parameters, which not only obtain significantly improved performance across diverse tasks but also present…

Artificial Intelligence · Computer Science 2023-09-06 Jing Yao , Xiaoyuan Yi , Xiting Wang , Jindong Wang , Xing Xie

The deployment of large language models (LLMs) raises concerns regarding their cultural misalignment and potential ramifications on individuals and societies with diverse cultural backgrounds. While the discourse has focused mainly on…

Computers and Society · Computer Science 2024-05-09 Reem I. Masoud , Ziquan Liu , Martin Ferianc , Philip Treleaven , Miguel Rodrigues

Aligning Large Language Models (LLMs) with human values has attracted increasing attention since it provides clarity, transparency, and the ability to adapt to evolving scenarios. In this paper, we introduce a Controlled Value Vector…

Computation and Language · Computer Science 2025-07-16 Haoran Jin , Meng Li , Xiting Wang , Zhihao Xu , Minlie Huang , Yantao Jia , Defu Lian

Minimizing negative impacts of Artificial Intelligent (AI) systems on human societies without human supervision requires them to be able to align with human values. However, most current work only addresses this issue from a technical point…

Computation and Language · Computer Science 2024-08-13 Mehdi Khamassi , Marceau Nahon , Raja Chatila

As large language models (LLMs) become more powerful and pervasive across society, ensuring these systems are beneficial, safe, and aligned with human values is crucial. Current alignment techniques, like Constitutional AI (CAI), involve…

Computers and Society · Computer Science 2025-06-03 Matthew Brophy

Large language models (LLMs) are increasingly being used for tasks where outputs shape human decisions, so it is critical to verify that their responses consistently reflect desired human values. Humans, as individuals or groups, don't…

Artificial Intelligence · Computer Science 2026-01-16 Aman Gupta , Denny O'Shea , Fazl Barez

Large Language Models (LLMs) are predominantly evaluated on Standard American English (SAE), often overlooking the diversity of global English varieties. This narrow focus may raise fairness concerns as degraded performance on non-standard…

Computation and Language · Computer Science 2025-10-10 Jiyoung Lee , Seungho Kim , Jieun Han , Jun-Min Lee , Kitaek Kim , Alice Oh , Edward Choi

The trustworthiness of Large Language Models (LLMs) refers to the extent to which their outputs are reliable, safe, and ethically aligned, and it has become a crucial consideration alongside their cognitive performance. In practice,…

Computation and Language · Computer Science 2024-12-24 Aaron J. Li , Satyapriya Krishna , Himabindu Lakkaraju

With the continued proliferation of Large Language Model (LLM) based chatbots, there is a growing demand for generating responses that are not only linguistically fluent but also consistently aligned with persona-specific traits in…

Computation and Language · Computer Science 2025-12-12 Qi Lin , Weikai Xu , Lisi Chen , Bin Dai

Aligning large language models (LLMs) with human values has become increasingly important as their influence on human behavior and decision-making expands. However, existing steering-based alignment methods suffer from limited…

Machine Learning · Computer Science 2026-02-10 Yonghui Yang , Junwei Li , Jilong Liu , Yicheng He , Fengbin Zhu , Weibiao Huang , Le Wu , Richang Hong , Tat-Seng Chua

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

Computation and Language · Computer Science 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

Rapid integration of large language models (LLMs) into societal applications has intensified concerns about their alignment with universal ethical principles, as their internal value representations remain opaque despite behavioral…

Computation and Language · Computer Science 2025-05-26 Yi Su , Jiayi Zhang , Shu Yang , Xinhai Wang , Lijie Hu , Di Wang

The concepts of ``human-centered AI'' and ``value-based decision'' have gained significant attention in both research and industry. However, many critical aspects remain underexplored and require further investigation. In particular, there…

Artificial Intelligence · Computer Science 2025-08-26 Sz-Ting Tzeng , Frank Dignum

The emergence of large language models (LLMs) has opened up exciting possibilities for simulating human behavior and cognitive processes, with potential applications in various domains, including marketing research and consumer behavior…

Computation and Language · Computer Science 2024-11-13 Behnam Mohammadi

The emergence of Large Language Models (LLMs) has shifted language model evaluation toward reasoning and problem-solving tasks as measures of general intelligence. Small Language Models (SLMs) -- defined here as models under 10B parameters…

Computation and Language · Computer Science 2026-01-08 Gabriel Benedict , Matthew Butler , Naved Merchant , Eetu Salama-Laine