English
Related papers

Related papers: Strong and weak alignment of large language models…

200 papers

With the wide application of large language models (LLMs), the problems of bias and value inconsistency in sensitive domains have gradually emerged, especially in terms of race, society and politics. In this paper, we propose an adversarial…

Computation and Language · Computer Science 2026-01-23 Yuan Gao , Zhigang Liu , Xinyu Yao , Bo Chen , Xiaobing Zhao

One of today's most significant societal challenges is building AI systems whose behaviour, or the behaviour it enables within communities of interacting agents (human and artificial), aligns with human values. To address this challenge, we…

Artificial Intelligence · Computer Science 2026-02-09 Nardine Osman , Mark d'Inverno

A core challenge in the development of increasingly capable AI systems is to make them safe and reliable by ensuring their behaviour is consistent with human values. This challenge, known as the alignment problem, does not merely apply to…

Machine Learning · Computer Science 2023-11-07 Raphaël Millière

This paper addresses the question of how to align AI systems with human values and situates it within a wider body of thought regarding technology and value. Far from existing in a vacuum, there has long been an interest in the ability of…

Computers and Society · Computer Science 2021-01-19 Iason Gabriel , Vafa Ghazavi

Background: Value alignment in computer science research is often used to refer to the process of aligning artificial intelligence with humans, but the way the phrase is used often lacks precision. Objectives: In this paper, we conduct a…

Computers and Society · Computer Science 2026-03-27 Jack McKinlay , Marina De Vos , Janina A. Hoffmann , Andreas Theodorou

In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language…

Computation and Language · Computer Science 2025-03-11 Ryan Liu , Jiayi Geng , Joshua C. Peterson , Ilia Sucholutsky , Thomas L. Griffiths

As AI systems advance in capabilities, measuring their safety and alignment to human values is becoming paramount. A fast-growing field of AI research is devoted to developing such assessments. However, most current advances therein may be…

Computers and Society · Computer Science 2026-03-17 Max Hellrigel-Holderbaum , Edward James Young

Large language models (LLMs) are increasingly used in human-AI interaction research and practice, yet existing capability and safety benchmarks reveal little about the value priorities these systems express or how those priorities…

Artificial Intelligence · Computer Science 2026-05-19 Gabriel Rongyang Lau , Wei Yan Low , Seow Min Koh , Fiona Fui-Hoon Nah , Andree Hartanto

Large Language Models (LLMs) demonstrate a remarkable capacity to adopt different personas and roles; however, it remains unclear whether they can manifest behavior that adheres to a coherent, human-like value structure. In this work, we…

Artificial Intelligence · Computer Science 2026-05-29 Asaf Yehudai , Naama Rozen , Ariel Gera

Large language models (LLMs) are transforming human-computer interaction and conceptions of artificial intelligence (AI) with their impressive capacities for conversing and reasoning in natural language. There is growing interest in whether…

Human-Computer Interaction · Computer Science 2024-05-15 Winnie Street

Effective and safe human-machine collaboration requires the regulated and meaningful exchange of emotions between humans and artificial intelligence (AI). Current AI systems based on large language models (LLMs) can provide feedback that…

Computation and Language · Computer Science 2025-06-18 Xiuwen Wu , Hao Wang , Zhiang Yan , Xiaohan Tang , Pengfei Xu , Wai-Ting Siok , Ping Li , Jia-Hong Gao , Bingjiang Lyu , Lang Qin

How can we build AI systems that can learn any set of individual human values both quickly and safely, avoiding causing harm or violating societal standards for acceptable behavior during the learning process? We explore the effects of…

Artificial Intelligence · Computer Science 2024-11-11 Andrea Wynn , Ilia Sucholutsky , Thomas L. Griffiths

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Big models, exemplified by Large Language Models (LLMs), are models typically pre-trained on massive data and comprised of enormous parameters, which not only obtain significantly improved performance across diverse tasks but also present…

Artificial Intelligence · Computer Science 2023-09-06 Jing Yao , Xiaoyuan Yi , Xiting Wang , Jindong Wang , Xing Xie

Thanks to rapid progress in artificial intelligence, we have entered an era when technology and philosophy intersect in interesting ways. Sitting squarely at the centre of this intersection are large language models (LLMs). The more adept…

Computation and Language · Computer Science 2023-02-17 Murray Shanahan

Recent years have witnessed remarkable progress made in large language models (LLMs). Such advancements, while garnering significant attention, have concurrently elicited various concerns. The potential of these models is undeniably vast;…

Computation and Language · Computer Science 2023-09-27 Tianhao Shen , Renren Jin , Yufei Huang , Chuang Liu , Weilong Dong , Zishan Guo , Xinwei Wu , Yan Liu , Deyi Xiong

The wide exploration of large language models (LLMs) raises the awareness of alignment between healthcare stakeholder preferences and model outputs. This alignment becomes a crucial foundation to empower the healthcare workflow effectively,…

Computers and Society · Computer Science 2025-05-07 Kexin Ding , Mu Zhou , Akshay Chaudhari , Shaoting Zhang , Dimitris N. Metaxas

Large Language Models (LLMs) have revolutionised the capability of AI models in comprehending and generating natural language text. They are increasingly being used to empower and deploy agents in real-world scenarios, which make decisions…

Artificial Intelligence · Computer Science 2024-08-21 Sagar Uprety , Amit Kumar Jaiswal , Haiming Liu , Dawei Song

Existing alignment research is dominated by concerns about safety and preventing harm: safeguards, controllability, and compliance. This paradigm of alignment parallels early psychology's focus on mental illness: necessary but incomplete.…

Due to the remarkable capabilities and growing impact of large language models (LLMs), they have been deeply integrated into many aspects of society. Thus, ensuring their alignment with human values and intentions has emerged as a critical…