English
Related papers

Related papers: ValueCompass: A Framework for Measuring Contextual…

200 papers

The value-alignment problem for artificial intelligence (AI) asks how we can ensure that the 'values' (i.e., objective functions) of artificial systems are aligned with the values of humanity. In this paper, I argue that linguistic…

Artificial Intelligence · Computer Science 2022-07-05 Travis LaCroix

We show how to assess a language model's knowledge of basic concepts of morality. We introduce the ETHICS dataset, a new benchmark that spans concepts in justice, well-being, duties, virtues, and commonsense morality. Models predict…

Computers and Society · Computer Science 2023-02-20 Dan Hendrycks , Collin Burns , Steven Basart , Andrew Critch , Jerry Li , Dawn Song , Jacob Steinhardt

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

Large-scale language technologies are increasingly used in various forms of communication with humans across different contexts. One particular use case for these technologies is conversational agents, which output natural language text in…

Computers and Society · Computer Science 2022-12-22 Atoosa Kasirzadeh , Iason Gabriel

Algorithmic (including AI/ML) decision-making artifacts are an established and growing part of our decision-making ecosystem. They are indispensable tools for managing the flood of information needed to make effective decisions in a complex…

Computers and Society · Computer Science 2020-11-11 Osonde A. Osoba , Benjamin Boudreaux , Douglas Yeung

As large language models (LLMs) become increasingly integrated into critical applications, aligning their behavior with human values presents significant challenges. Current methods, such as Reinforcement Learning from Human Feedback…

Computation and Language · Computer Science 2025-02-25 Yipeng Kang , Junqi Wang , Yexin Li , Mengmeng Wang , Wenming Tu , Quansen Wang , Hengli Li , Tingjun Wu , Xue Feng , Fangwei Zhong , Zilong Zheng

The application scope of Large Language Models (LLMs) continues to expand, leading to increasing interest in personalized LLMs that align with human values. However, aligning these models with individual values raises significant safety…

Computation and Language · Computer Science 2025-06-10 Sooyung Choi , Jaehyeok Lee , Xiaoyuan Yi , Jing Yao , Xing Xie , JinYeong Bak

The widespread application of artificial intelligence (AI) in various tasks, along with frequent reports of conflicts or violations involving AI, has sparked societal concerns about interactions with AI systems. Based on Wrightsman's…

Computation and Language · Computer Science 2025-04-04 Minheng Ni , Ennan Wu , Zidong Gong , Zhengyuan Yang , Linjie Li , Chung-Ching Lin , Kevin Lin , Lijuan Wang , Wangmeng Zuo

AI is becoming increasingly integrated into everyday life, both in professional work environments and in leisure and entertainment contexts. This integration requires AI to move beyond acting as an assistant for informational or…

Human-Computer Interaction · Computer Science 2026-02-26 Christian Poelitz , Finale Doshi-Velez , Siân Lindley

The SLAM paper demonstrated that on-device Small Language Models (SLMs) are a viable and cost-effective alternative to API-based Large Language Models (LLMs), such as OpenAI's GPT-4, offering comparable performance and stability. However,…

Computation and Language · Computer Science 2024-07-19 Roland Daynauth , Jason Mars

Navigating dilemmas involving conflicting values is challenging even for humans in high-stakes domains, let alone for AI, yet prior work has been limited to everyday scenarios. To close this gap, we introduce CLASH (Character…

Computation and Language · Computer Science 2025-09-29 Ayoung Lee , Ryan Sungmo Kwon , Peter Railton , Lu Wang

Ensuring cultural values alignment in Large Language Models (LLMs) remains a critical challenge, as these models often embed Western-centric biases from their training data, leading to misrepresentations and fairness concerns in…

Computation and Language · Computer Science 2025-05-09 Wonduk Seo , Zonghao Yuan , Yi Bu

Aligning large language models (LLMs) with human values is imperative to mitigate potential adverse effects resulting from their misuse. Drawing from the sociological insight that acknowledging all parties' concerns is a key factor in…

Computation and Language · Computer Science 2024-06-11 Xianghe Pang , Shuo Tang , Rui Ye , Yuxin Xiong , Bolun Zhang , Yanfeng Wang , Siheng Chen

We evaluate the moral alignment of LLMs with human preferences in multilingual trolley problems. Building on the Moral Machine experiment, which captures over 40 million human judgments across 200+ countries, we develop a cross-lingual…

The widespread adoption of large language models (LLMs) across various regions underscores the urgent need to evaluate their alignment with human values. Current benchmarks, however, fall short of effectively uncovering safety…

Computation and Language · Computer Science 2024-05-31 Kexin Huang , Xiangyang Liu , Qianyu Guo , Tianxiang Sun , Jiawei Sun , Yaru Wang , Zeyang Zhou , Yixu Wang , Yan Teng , Xipeng Qiu , Yingchun Wang , Dahua Lin

The critical inquiry pervading the realm of Philosophy, and perhaps extending its influence across all Humanities disciplines, revolves around the intricacies of morality and normativity. Surprisingly, in recent years, this thematic thread…

Artificial Intelligence · Computer Science 2024-06-19 Nicholas Kluge Corrêa

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Values or principles are key elements of human society that influence people to behave and function according to an accepted standard set of social rules to maintain social order. As AI systems are becoming ubiquitous in human society, it…

Artificial Intelligence · Computer Science 2025-01-17 Md Sultan Al Nahian , Tasmia Tasrin , Spencer Frazier , Mark Riedl , Brent Harrison

This position paper states that AI Alignment in Multi-Agent Systems (MAS) should be considered a dynamic and interaction-dependent process that heavily depends on the social environment where agents are deployed, either collaborative,…

Artificial Intelligence · Computer Science 2025-06-09 Florian Carichon , Aditi Khandelwal , Marylou Fauchard , Golnoosh Farnadi

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li