中文
相关论文

相关论文: Mind the Value-Action Gap: Do LLMs Act in Alignmen…

200 篇论文

Large language models (LLMs) are increasingly deployed in agentic and multi-turn workflows where they are tasked to perform actions of significant consequence. In order to deploy them reliably and manage risky outcomes in these settings, it…

机器学习 · 计算机科学 2026-02-10 Arka Pal , Teo Kitanovski , Arthur Liang , Akilesh Potti , Micah Goldblum

The conformity bias exhibited by large language models (LLMs) can pose a significant challenge to decision-making in LLM-based multi-agent systems (LLM-MAS). While many prior studies have treated "conformity" simply as a matter of opinion…

人工智能 · 计算机科学 2026-04-22 Mikako Bito , Keita Nishimoto , Kimitaka Asatani , Ichiro Sakata

The rapid advancement of Large Language Models (LLMs) has attracted much attention to value alignment for their responsible development. However, how to define values in this context remains a largely unexplored question. Existing work…

计算与语言 · 计算机科学 2023-11-21 Jing Yao , Xiaoyuan Yi , Xiting Wang , Yifan Gong , Xing Xie

As Large Language Model (LLM) agents become more widespread, associated misalignment risks increase. While prior research has studied agents' ability to produce harmful outputs or follow malicious instructions, it remains unclear how likely…

Existing work on value alignment typically characterizes value relations statically, ignoring how alignment interventions, such as prompting, fine-tuning, or preference optimization, reshape the broader value system. In practice, aligning a…

人工智能 · 计算机科学 2026-04-28 Jiajun Chen , Hua Shen

People increasingly rely on Large Language Models (LLMs) for moral advice, which may influence humans' decisions. Yet, little is known about how closely LLMs align with human moral judgments. To address this, we introduce the Moral Dilemma…

计算与语言 · 计算机科学 2025-07-24 Giuseppe Russo , Debora Nozza , Paul Röttger , Dirk Hovy

Large Language Models (LLMs) are increasingly used in decision-making scenarios that involve risk assessment, yet their alignment with human economic rationality remains unclear. In this study, we investigate whether LLMs exhibit risk…

综合经济学 · 经济学 2025-09-16 Jiaxin Liu , Yixuan Tang , Yi Yang , Kar Yan Tam

Large Language Model (LLM)-based agents have significantly impacted Task-Oriented Dialog Systems (TODS) but continue to face notable performance challenges, especially in zero-shot scenarios. While prior work has noted this performance gap,…

计算与语言 · 计算机科学 2025-06-17 Avinash Baidya , Kamalika Das , Xiang Gao

Evaluating the value alignment of large language models (LLMs) has traditionally relied on single-sentence adversarial prompts, which directly probe models with ethically sensitive or controversial questions. However, with the rapid…

计算与语言 · 计算机科学 2025-03-31 Yazhou Zhang , Qimeng Liu , Qiuchi Li , Peng Zhang , Jing Qin

Value alignment problems arise in scenarios where the specified objectives of an AI agent don't match the true underlying objective of its users. The problem has been widely argued to be one of the central safety problems in AI.…

人工智能 · 计算机科学 2023-02-10 Malek Mechergui , Sarath Sreedharan

As LLMs integrate into our daily lives, understanding their behavior becomes essential. In this work, we focus on behavioral dispositions$-$the underlying tendencies that shape responses in social contexts$-$and introduce a framework to…

Large Language Model (LLM)-based agentic systems have shown growing promise in tackling complex, multi-step tasks through autonomous planning, reasoning, and interaction with external environments. However, the stochastic nature of LLM…

人机交互 · 计算机科学 2026-03-31 Shuo Yan , Xiaolin Wen , Shaolun Ruan , Yanjie Zhang , Jiaming Mi , Yushi Sun , Huamin Qu , Rui Sheng

Multi-agent large language model (LLM) systems increasingly consist of agents that observe and respond to one another's outputs. While value alignment is typically evaluated for isolated models, how value perturbations propagate through…

多智能体系统 · 计算机科学 2026-05-29 Jinnuo Liu , Chuke Liu , Hua Shen

Some prior work has shown that LLMs perform well in NLG evaluation for different tasks. However, we discover that LLMs seem to confuse different evaluation criteria, which reduces their reliability. For further verification, we first…

计算与语言 · 计算机科学 2024-07-01 Xinyu Hu , Mingqi Gao , Sen Hu , Yang Zhang , Yicheng Chen , Teng Xu , Xiaojun Wan

Large Language Models (LLMs) have emerged as potent tools for advancing the United Nations' Sustainable Development Goals (SDGs). However, the attitudinal disparities between LLMs and humans towards these goals can pose significant…

计算机与社会 · 计算机科学 2025-01-17 Qingyang Wu , Ying Xu , Tingsong Xiao , Yunze Xiao , Yitong Li , Tianyang Wang , Yichi Zhang , Shanghai Zhong , Yuwei Zhang , Wei Lu , Yifan Yang

The proliferation of large language models (LLMs) requires robust evaluation of their alignment with local values and ethical standards, especially as existing benchmarks often reflect the cultural, legal, and ideological values of their…

计算机与社会 · 计算机科学 2024-08-06 Gwenyth Isobel Meadows , Nicholas Wai Long Lau , Eva Adelina Susanto , Chi Lok Yu , Aditya Paul

Large Language Models (LLMs) have made significant strides in various intelligent tasks but still struggle with complex action reasoning tasks that require systematic search. To address this limitation, we propose a method that bridges the…

计算与语言 · 计算机科学 2025-02-05 Adam Ishay , Joohyung Lee

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Large language models (LLMs) have become increasingly pivotal in various domains due the recent advancements in their performance capabilities. However, concerns persist regarding biases in LLMs, including gender, racial, and cultural…

人工智能 · 计算机科学 2024-12-03 Mijntje Meijer , Hadi Mohammadi , Ayoub Bagheri

Large language models (LLMs) are increasingly proposed as agents in strategic decision environments, yet their behavior in structured geopolitical simulations remains under-researched. We evaluate six popular state-of-the-art LLMs alongside…

计算与语言 · 计算机科学 2026-03-03 Veronika Solopova , Viktoria Skorik , Maksym Tereshchenko , Alina Haidun , Ostap Vykhopen