English
Related papers

Related papers: Are the Values of LLMs Structurally Aligned with H…

200 papers

Large Language Models (LLM) technology is constantly improving towards human-like dialogue. Values are a basic driving force underlying human behavior, but little research has been done to study the values exhibited in text generated by…

Computation and Language · Computer Science 2024-10-16 Naama Rozen , Liat Bezalel , Gal Elidan , Amir Globerson , Ella Daniel

Recent advances in large language models (LLMs) have demonstrated significant progress in performing complex tasks. While Reinforcement Learning from Human Feedback (RLHF) has been effective in aligning LLMs with human preferences, it is…

Machine Learning · Computer Science 2025-05-30 Chaoqi Wang , Zhuokai Zhao , Yibo Jiang , Zhaorun Chen , Chen Zhu , Yuxin Chen , Jiayi Liu , Lizhu Zhang , Xiangjun Fan , Hao Ma , Sinong Wang

Large Language Models (LLMs) demonstrate a remarkable capacity to adopt different personas and roles; however, it remains unclear whether they can manifest behavior that adheres to a coherent, human-like value structure. In this work, we…

Artificial Intelligence · Computer Science 2026-05-29 Asaf Yehudai , Naama Rozen , Ariel Gera

Large Language Models (LLMs) are increasingly employed in software engineering tasks such as requirements elicitation, design, and evaluation, raising critical questions regarding their alignment with human judgments on responsible AI…

Software Engineering · Computer Science 2025-11-07 Asma Yamani , Malak Baslyman , Moataz Ahmed

Big models, exemplified by Large Language Models (LLMs), are models typically pre-trained on massive data and comprised of enormous parameters, which not only obtain significantly improved performance across diverse tasks but also present…

Artificial Intelligence · Computer Science 2023-09-06 Jing Yao , Xiaoyuan Yi , Xiting Wang , Jindong Wang , Xing Xie

The emergent capabilities of Large Language Models (LLMs) have made it crucial to align their values with those of humans. However, current methodologies typically attempt to assign value as an attribute to LLMs, yet lack attention to the…

Computation and Language · Computer Science 2024-01-12 Zhaowei Zhang , Ceyao Zhang , Nian Liu , Siyuan Qi , Ziqi Rong , Song-Chun Zhu , Shuguang Cui , Yaodong Yang

Large Language Models (LLMs) have attracted significant attention for classification tasks, offering a flexible alternative to trusted classical machine learning models like LightGBM through zero-shot prompting. However, their reliability…

Machine Learning · Computer Science 2025-12-02 Saeed AlMarri , Mathieu Ravaut , Kristof Juhasz , Gautier Marti , Hamdan Al Ahbabi , Ibrahim Elfadel

Large language models (LLMs) excel at handling human queries, but they can occasionally generate flawed or unexpected responses. Understanding their internal states is crucial for understanding their successes, diagnosing their failures,…

Computation and Language · Computer Science 2025-02-24 Xuansheng Wu , Jiayi Yuan , Wenlin Yao , Xiaoming Zhai , Ninghao Liu

Large language models (LLMs) can lead to undesired consequences when misaligned with human values, especially in scenarios involving complex and sensitive social biases. Previous studies have revealed the misalignment of LLMs with human…

Computation and Language · Computer Science 2025-09-18 Yang Liu , Chenhui Chu

As Large Language Models (LLMs) achieve remarkable breakthroughs, aligning their values with humans has become imperative for their responsible development and customized applications. However, there still lack evaluations of LLMs values…

Artificial Intelligence · Computer Science 2025-06-03 Jing Yao , Xiaoyuan Yi , Shitong Duan , Jindong Wang , Yuzhuo Bai , Muhua Huang , Peng Zhang , Tun Lu , Zhicheng Dou , Maosong Sun , Xing Xie

Model alignment with human preferences is an essential step in making Large Language Models (LLMs) helpful and consistent with human values. It typically consists of supervised fine-tuning (SFT) and reinforcement learning from human…

Computation and Language · Computer Science 2023-10-10 Yi Dong , Zhilin Wang , Makesh Narsimhan Sreedhar , Xianchao Wu , Oleksii Kuchaiev

The application scope of Large Language Models (LLMs) continues to expand, leading to increasing interest in personalized LLMs that align with human values. However, aligning these models with individual values raises significant safety…

Computation and Language · Computer Science 2025-06-10 Sooyung Choi , Jaehyeok Lee , Xiaoyuan Yi , Jing Yao , Xing Xie , JinYeong Bak

Large language models (LLMs) have emerged as powerful tools for addressing a wide range of general inquiries and tasks. Despite this, fine-tuning aligned LLMs on smaller, domain-specific datasets, critical to adapting them to specialized…

Artificial Intelligence · Computer Science 2025-02-04 Guanlin Li , Kangjie Chen , Shangwei Guo , Jie Zhang , Han Qiu , Chao Zhang , Guoyin Wang , Tianwei Zhang , Jiwei Li

The autonomous decision-making process, which is increasingly applied to computer systems, requires that the choices made by these systems align with human values. In this context, systems must assess how well their decisions reflect human…

Computers and Society · Computer Science 2025-12-19 Eduardo de la Cruz Fernández , Marcelo Karanik , Sascha Ossowski

The rapid progress in Large Language Models (LLMs) poses potential risks such as generating unethical content. Assessing LLMs' values can help expose their misalignment, but relies on reference-free evaluators, e.g., fine-tuned LLMs or…

Computation and Language · Computer Science 2024-07-16 Jing Yao , Xiaoyuan Yi , Xing Xie

Large language models (LLMs) have been widely deployed across numerous fields. Reinforcement Learning from Human Feedback (RLHF) leverages reward models (RMs) as proxies for human preferences to align LLM behaviors with human values, making…

Machine Learning · Computer Science 2025-11-26 Shuyi Zhang , Wei Shi , Sihang Li , Jiayi Liao , Hengxing Cai , Xiang Wang

Value alignment is central to the development of safe and socially compatible artificial intelligence. However, how Large Language Models (LLMs) represent and enact human values in real-world decision contexts remains under-explored. We…

Computation and Language · Computer Science 2026-01-14 Jen-tse Huang , Jiantong Qin , Xueli Qiu , Sharon Levy , Michelle R. Kaufman , Mark Dredze

We propose Reinforcement Learning with Explicit Human Values (RLEV), a method that aligns Large Language Model (LLM) optimization directly with quantifiable human value signals. While Reinforcement Learning with Verifiable Rewards (RLVR)…

Machine Learning · Computer Science 2025-10-24 Dian Yu , Yulai Zhao , Kishan Panaganti , Linfeng Song , Haitao Mi , Dong Yu

As intelligent systems become more autonomous, the scientific community focuses on creating decision-making mechanisms that include ethical and moral considerations, unlike traditional utility-maximisation models. To achieve this, a key…

Artificial Intelligence · Computer Science 2026-05-28 Eduardo de la Cruz Fernández , Marcelo Karanik , Sascha Ossowski

Large Language Models (LLMs) behave non-deterministically, and prompting has become a common method for steering their outputs. A popular strategy is to assign a persona to the model to produce more varied, context-sensitive responses,…

Computation and Language · Computer Science 2026-04-21 Bruce W. Lee , Yeongheon Lee , Hyunsoo Cho
‹ Prev 1 2 3 10 Next ›