English
Related papers

Related papers: Societal Alignment Frameworks Can Improve LLM Alig…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their…

Computation and Language · Computer Science 2024-03-26 Jiahui Geng , Fengyu Cai , Yuxia Wang , Heinz Koeppl , Preslav Nakov , Iryna Gurevych

Alignment is the most critical step in building large language models (LLMs) that meet human needs. With the rapid development of LLMs gradually surpassing human capabilities, traditional alignment methods based on human-annotation are…

Computation and Language · Computer Science 2024-09-04 Boxi Cao , Keming Lu , Xinyu Lu , Jiawei Chen , Mengjie Ren , Hao Xiang , Peilin Liu , Yaojie Lu , Ben He , Xianpei Han , Le Sun , Hongyu Lin , Bowen Yu

This paper argues that Large Language Models (LLMs) should incorporate explicit mechanisms for human empathy. As LLMs become increasingly deployed in high-stakes human-centered settings, their success depends not only on correctness or…

Computation and Language · Computer Science 2026-04-14 Xiaoxing You , Qiang Huang , Jun Yu

Large language models (LLMs) can handle a wide variety of general tasks with simple prompts, without the need for task-specific training. Multimodal Large Language Models (MLLMs), built upon LLMs, have demonstrated impressive potential in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tao Yu , Yi-Fan Zhang , Chaoyou Fu , Junkang Wu , Jinda Lu , Kun Wang , Xingyu Lu , Yunhang Shen , Guibin Zhang , Dingjie Song , Yibo Yan , Tianlong Xu , Qingsong Wen , Zhang Zhang , Yan Huang , Liang Wang , Tieniu Tan

Reward design plays a pivotal role in aligning large language models (LLMs) with human values, serving as the bridge between feedback signals and model optimization. This survey provides a structured organization of reward modeling and…

Computation and Language · Computer Science 2025-09-03 Miaomiao Ji , Yanqiu Wu , Zhibin Wu , Shoujin Wang , Jian Yang , Mark Dras , Usman Naseem

Ensuring that Large Language Models (LLMs) align with the diverse and evolving human values across different regions and cultures remains a critical challenge in AI ethics. Current alignment approaches often yield superficial conformity…

Artificial Intelligence · Computer Science 2025-11-04 Jiahao Wang , Songkai Xue , Jinghui Li , Xiaozhen Wang

Large language models (LLMs) alignment ensures model behaviors reflect human value. Existing alignment strategies primarily follow two paths: one assumes a universal value set for a unified goal (i.e., one-size-fits-all), while the other…

Computation and Language · Computer Science 2026-01-21 Jiayu Lin , Zhongyu Wei

Recent work in large language modeling (LLMs) has used fine-tuning to align outputs with the preferences of a prototypical user. This work assumes that human preferences are static and homogeneous across individuals, so that aligning to a a…

There have been rapid advancements in the capabilities of large language models (LLMs) in recent years, greatly revolutionizing the field of natural language processing (NLP) and artificial intelligence (AI) to understand and interact with…

Computation and Language · Computer Science 2024-09-26 Zeyneb N. Kaya , Souvick Ghosh

Language models (LMs) are increasingly used as simulacra for people, yet their ability to match the distribution of views of a specific demographic group and be \textit{distributionally aligned} remains uncertain. This notion of…

Computation and Language · Computer Science 2024-11-11 Nicole Meister , Carlos Guestrin , Tatsunori Hashimoto

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in processing both visual and textual information. However, the critical challenge of alignment between visual and textual representations is not fully…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Dong Shu , Haiyan Zhao , Jingyu Hu , Weiru Liu , Ali Payani , Lu Cheng , Mengnan Du

As Large Language Models (LLMs) achieve remarkable breakthroughs, aligning their values with humans has become imperative for their responsible development and customized applications. However, there still lack evaluations of LLMs values…

Artificial Intelligence · Computer Science 2025-06-03 Jing Yao , Xiaoyuan Yi , Shitong Duan , Jindong Wang , Yuzhuo Bai , Muhua Huang , Peng Zhang , Tun Lu , Zhicheng Dou , Maosong Sun , Xing Xie

In early developmental contexts, particularly in parent-child interaction analysis, alignment involves families and professionals such as speech-language pathologists (SLPs) who interpret children's everyday interactions from different…

Human-Computer Interaction · Computer Science 2026-03-10 Weiyan Shi , Kenny Tsu Wei Choo

Large Language Models (LLMs) exhibit remarkably powerful capabilities. One of the crucial factors to achieve success is aligning the LLM's output with human preferences. This alignment process often requires only a small amount of data to…

The field of artificial intelligence (AI) alignment aims to investigate whether AI technologies align with human interests and values and function in a safe and ethical manner. AI alignment is particularly relevant for large language models…

Human-Computer Interaction · Computer Science 2023-01-18 Thilo Hagendorff , Sarah Fabi

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

Artificial Intelligence · Computer Science 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

Despite advances in large language models (LLMs) on reasoning and instruction-following tasks, it is unclear whether they can reliably produce outputs aligned with a variety of user goals, a concept called steerability. Two gaps in current…

Computation and Language · Computer Science 2026-01-21 Trenton Chang , Tobias Schnabel , Adith Swaminathan , Jenna Wiens

Adopting Large language models (LLMs) in organizations potentially revolutionizes our lives and work. However, they can generate off-topic, discriminating, or harmful content. This AI alignment problem often stems from misspecifications…

Artificial Intelligence · Computer Science 2025-09-10 Sascha Kaltenpoth , Oliver Müller

Recent advancements in large language models (LLMs) have established them as powerful tools across numerous domains. However, persistent concerns about embedded biases, such as gender, racial, and cultural biases arising from their training…

Computation and Language · Computer Science 2025-07-30 Hadi Mohammadi , Yasmeen F. S. S. Meijer , Efthymia Papadopoulou , Ayoub Bagheri

Large Language Models (LLMs) are increasingly used in decision-making scenarios that involve risk assessment, yet their alignment with human economic rationality remains unclear. In this study, we investigate whether LLMs exhibit risk…

General Economics · Economics 2025-09-16 Jiaxin Liu , Yixuan Tang , Yi Yang , Kar Yan Tam