English
Related papers

Related papers: Dual Optimal: Make Your LLM Peer-like with Dignity

200 papers

Recent years have witnessed extensive efforts to enhance Large Language Models (LLMs) across various domains, alongside growing attention to their ethical implications. However, a critical challenge remains largely overlooked: LLMs must…

Computation and Language · Computer Science 2025-02-28 Yiyi Zhang , Xingyu Chen , Kexin Chen , Yuyang Du , Xilin Dang , Pheng-Ann Heng

While large language models (LLMs) afford new possibilities for user modeling and approximation of human behaviors, they often fail to capture the multidimensional nuances of individual users. In this work, we introduce PersonaTwin, a…

Computation and Language · Computer Science 2025-08-18 Sihan Chen , John P. Lalor , Yi Yang , Ahmed Abbasi

This paper introduces a simple yet effective data-centric approach for the task of improving persona-conditioned dialogue agents. Prior model-centric approaches unquestioningly depend on the raw crowdsourced benchmark datasets such as…

Computation and Language · Computer Science 2022-02-17 Minju Kim , Beong-woo Kwak , Youngwook Kim , Hong-in Lee , Seung-won Hwang , Jinyoung Yeo

Language model alignment is crucial for ensuring that large language models (LLMs) align with human preferences, yet it often involves sensitive user data, raising significant privacy concerns. While prior work has integrated differential…

Cryptography and Security · Computer Science 2025-05-15 Keyu Chen , Hao Tang , Qinglin Liu , Yizhao Xu

Natural language processing (NLP) has seen remarkable advancements with the development of large language models (LLMs). Despite these advancements, LLMs often produce socially biased outputs. Recent studies have mainly addressed this…

Computation and Language · Computer Science 2025-02-13 Zhenjie Xu , Wenqing Chen , Yi Tang , Xuanying Li , Cheng Hu , Zhixuan Chu , Kui Ren , Zibin Zheng , Zhichao Lu

The alignment of large language models with human values presents a critical challenge, particularly when balancing conflicting objectives like helpfulness and harmlessness. Existing approaches, such as Reinforcement Learning from Human…

Computation and Language · Computer Science 2025-03-04 Yuxuan Liu

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

Computational Engineering, Finance, and Science · Computer Science 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Procedural content generation has enabled vast virtual worlds through levels, maps, and quests, but large-scale character generation remains underexplored. We identify two alignment-induced biases in existing methods: a positive moral bias,…

Computation and Language · Computer Science 2026-05-05 Maan Qraitem , Kate Saenko , Bryan A. Plummer

Evaluating large language models typically relies on human-authored benchmarks, reference answers, and human or single-model judgments, approaches that scale poorly, become quickly outdated, and mismatch open-world deployments that depend…

Artificial Intelligence · Computer Science 2026-02-04 Yanki Margalit , Erni Avram , Ran Taig , Oded Margalit , Nurit Cohen-Inger

Large language models (LLMs) have shown remarkable abilities in diverse natural language processing (NLP) tasks. The LLMs generally undergo supervised fine-tuning (SFT) followed by preference alignment to be usable in downstream…

Computation and Language · Computer Science 2024-06-27 Shiva Kumar Pentyala , Zhichao Wang , Bin Bi , Kiran Ramnath , Xiang-Bo Mao , Regunathan Radhakrishnan , Sitaram Asur , Na , Cheng

Bilateral bargaining under incomplete information provides a controlled testbed for evaluating large language model (LLM) agent capabilities. Bilateral trade demands individual rationality, strategic surplus maximization, and cooperation to…

Computer Science and Game Theory · Computer Science 2026-04-21 Dirk Bergemann , Soheil Ghili , Xinyang Hu , Chuanhao Li , Zhuoran Yang

Agents built on large language models (LLMs) have excelled in turn-by-turn human-AI collaboration but struggle with simultaneous tasks requiring real-time interaction. Latency issues and the challenge of inferring variable human strategies…

Artificial Intelligence · Computer Science 2025-05-29 Shao Zhang , Xihuai Wang , Wenhao Zhang , Chaoran Li , Junru Song , Tingyu Li , Lin Qiu , Xuezhi Cao , Xunliang Cai , Wen Yao , Weinan Zhang , Xinbing Wang , Ying Wen

We investigate how peer pressure influences the opinions of Large Language Model (LLM) agents across a spectrum of cognitive commitments by embedding them in social networks where they update opinions based on peer perspectives. Our…

Computers and Society · Computer Science 2025-10-23 Aliakbar Mehdizadeh , Martin Hilbert

Collaborative multi-agent large language models (LLMs) can solve complex reasoning tasks by decomposing roles, but reinforcement learning for such systems is limited by credit assignment: shared terminal rewards obscure individual…

Artificial Intelligence · Computer Science 2026-05-27 Zhongyi Li , Wan Tian , Yikun Ban , Jinju Chen , Huiming Zhang , Yang Liu , Fuzhen Zhuang

Large Language Models (LLMs) can struggle to balance gullibility to misinformation and resistance to valid corrections in persuasive dialogues, a critical challenge for reliable deployment. We introduce DuET-PD (Dual Evaluation for Trust in…

Computation and Language · Computer Science 2025-09-10 Bryan Chen Zhengyu Tan , Daniel Wai Kit Chin , Zhengyuan Liu , Nancy F. Chen , Roy Ka-Wei Lee

Recent agent-based recommendation frameworks aim to simulate user behaviors by incorporating memory mechanisms and prompting strategies, but they struggle with hallucinating non-existent items and full-catalog ranking. Besides, a largely…

Information Retrieval · Computer Science 2026-02-25 Mingdai Yang , Nurendra Choudhary , Jiangshu Du , Edward W. Huang , Philip S. Yu , Karthik Subbian , Danai Koutra

Mathematical reasoning is a fundamental capability for large language models (LLMs), yet achieving high performance in this domain remains a significant challenge. The auto-regressive generation process often makes LLMs susceptible to…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoxuan Lou , Chaojie Wang , Bo An

Large language models (LLMs) are increasingly used for qualitative data analysis (QDA), yet their outputs often miss the depth and nuance of human analysis. We argue this gap reflects a missing credibility practice from human QDA: peer…

Artificial Intelligence · Computer Science 2026-05-26 Zhimin Lin , Kun Cheng , Fan Bai , Jie Gao

Persona agents, which are LLM agents conditioned to act according to an assigned persona, enable contextually rich and user aligned interactions across domains like education and healthcare. However, evaluating how faithfully these agents…

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Model (LLM) reasoning have been hindered by a persistent challenge: exploration collapse. The semantic homogeneity of random rollouts often traps…

Machine Learning · Computer Science 2026-01-12 Huilin Deng , Hongchen Luo , Yue Zhu , Long Li , Zhuoyue Chen , Xinghao Zhao , Ming Li , Jihai Zhang , Mengchang Wang , Yang Cao , Yu Kang