中文
相关论文

相关论文: From Classification to Ranking: Enhancing LLM Reas…

200 篇论文

Reinforcement Learning from Human Feedback (\textbf{RLHF}) has emerged as a dominant approach for aligning LLM outputs with human preferences. Inspired by the success of RLHF, we study the performance of multiple algorithms that learn from…

Multimodal Large Language Models (MLLMs) are increasingly deployed in human-facing roles where personality perception is critical, yet existing benchmarks evaluate this capability solely on numerical Big Five score prediction, leaving open…

With large language models (LLMs) like GPT-4 appearing to behave increasingly human-like in text-based interactions, it has become popular to attempt to evaluate personality traits of LLMs using questionnaires originally developed for…

计算与语言 · 计算机科学 2024-06-06 Tom Sühr , Florian E. Dorner , Samira Samadi , Augustin Kelava

Natural Language Processing (NLP) offers new avenues for personality assessment by leveraging rich, open-ended text, moving beyond traditional questionnaires. In this study, we address the challenge of modeling long narrative interview…

计算与语言 · 计算机科学 2025-06-25 Rasiq Hussain , Jerry Ma , Rithik Khandelwal , Joshua Oltmanns , Mehak Gupta

As large language models (LLM) evolve in their capabilities, various recent studies have tried to quantify their behavior using psychological tools created to study human behavior. One such example is the measurement of "personality" of…

计算与语言 · 计算机科学 2024-01-04 Akshat Gupta , Xiaoyang Song , Gopala Anumanchipalli

Theory of Mind (ToM), the ability to attribute mental states to others, is fundamental for human social intelligence and a critical capability for advanced Artificial Intelligence. Recent advancements in Large Language Models (LLMs) have…

计算与语言 · 计算机科学 2025-05-19 Yi-Long Lu , Chunhui Zhang , Jiajun Song , Lifeng Fan , Wei Wang

Digital behaviour change systems increasingly rely on repeated, system-initiated messages to support users in everyday contexts. LLMs enable these messages to be personalised consistently across interactions, yet it remains unclear whether…

人机交互 · 计算机科学 2026-03-02 Dominik P. Hofer , David Haag , Rania Islambouli , Jan D. Smeddinck

Large Language Models (LLMs) are increasingly deployed as autonomous agents, necessitating a deeper understanding of their decision-making behaviour under risk. This study investigates the relationship between LLMs' personality traits and…

计算机与社会 · 计算机科学 2025-03-10 John Hartley , Conor Hamill , Devesh Batra , Dale Seddon , Ramin Okhrati , Raad Khraishi

Predicting human decision-making in high-stakes environments remains a central challenge for artificial intelligence. While large language models (LLMs) demonstrate strong general reasoning, they often struggle to generate consistent,…

人工智能 · 计算机科学 2026-02-20 Ben Yellin , Ehud Ezra , Mark Foreman , Shula Grinapol

Reinforcement learning from human feedback (RLHF) has emerged as an effective approach to aligning large language models (LLMs) to human preferences. RLHF contains three steps, i.e., human preference collecting, reward learning, and policy…

计算与语言 · 计算机科学 2024-03-29 Hao Lang , Fei Huang , Yongbin Li

Recent research has focused on examining Large Language Models' (LLMs) characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. The administration of personality tests…

计算与语言 · 计算机科学 2024-10-07 Jen-tse Huang , Wenxiang Jiao , Man Ho Lam , Eric John Li , Wenxuan Wang , Michael R. Lyu

Supervised fine-tuning (SFT) has emerged as a crucial method for aligning large language models (LLMs) with human-annotated demonstrations. However, SFT, being an off-policy approach similar to behavior cloning, often struggles with…

In this work, we tackle the challenge of embedding realistic human personality traits into LLMs. Previous approaches have primarily focused on prompt-based methods that describe the behavior associated with the desired personality traits,…

计算与语言 · 计算机科学 2025-07-30 Wenkai Li , Jiarui Liu , Andy Liu , Xuhui Zhou , Mona Diab , Maarten Sap

Accurate disease classification from radiology reports is essential for many applications. While supervised fine-tuning (SFT) of lightweight LLMs improves accuracy, it can degrade reasoning. We propose a two-stage approach: SFT on disease…

人工智能 · 计算机科学 2026-04-22 Yishu Wei , Yi Lin , Adam Flanders , George Shih , Yifan Peng

Can large language models reliably express a human-like personality, or are they merely mimicking surface cues without a stable underlying profile? To investigate this, we induce personality in LLMs by fine-tuning them on the long-form…

计算与语言 · 计算机科学 2026-05-19 Prateek Rajput , Yewei Song , Iyiola E. Olatunji , Jacques Klein , Tegawendé F. Bissyandé

Large language models (LLMs) are used to generate content for a wide range of tasks, and are set to reach a growing audience in coming years due to integration in product interfaces like ChatGPT or search engines like Bing. This intensifies…

计算与语言 · 计算机科学 2023-03-10 Hannah Rose Kirk , Bertie Vidgen , Paul Röttger , Scott A. Hale

For socially sensitive tasks like hate speech detection, the quality of explanations from Large Language Models (LLMs) is crucial for factors like user trust and model alignment. While Persona prompting (PP) is increasingly used as a way to…

计算与语言 · 计算机科学 2026-01-29 Jing Yang , Moritz Hechtbauer , Elisabeth Khalilov , Evelyn Luise Brinkmann , Vera Schmitt , Nils Feldhus

Personalized retrieval-augmented generation (RAG) aims to produce user-tailored responses by incorporating retrieved user profiles alongside the input query. Existing methods primarily focus on improving retrieval and rely on large language…

信息检索 · 计算机科学 2025-08-12 Kepu Zhang , Teng Shi , Weijie Yu , Jun Xu

Modern large language models (LLMs) are optimized for human-aligned responses using Reinforcement Learning from Human Feedback (RLHF). However, existing RLHF approaches assume a universal preference model and fail to account for individual…

机器学习 · 计算机科学 2025-03-11 Idan Shenfeld , Felix Faltings , Pulkit Agrawal , Aldo Pacchiano

Large Language Models (LLMs) exhibit social biases, which can lead to harmful stereotypes and unfair outcomes. We propose \textbf{Multi-Persona Thinking (MPT)}, a simple inference-time framework that reduces social bias by encouraging…

计算与语言 · 计算机科学 2026-04-22 Yuxing Chen , Guoqing Luo , Zijun Wu , Lili Mou