Comparing Rationality Between Large Language Models and Humans: Insights and Open Questions
Abstract
This paper delves into the dynamic landscape of artificial intelligence, specifically focusing on the burgeoning prominence of large language models (LLMs). We underscore the pivotal role of Reinforcement Learning from Human Feedback (RLHF) in augmenting LLMs' rationality and decision-making prowess. By meticulously examining the intricate relationship between human interaction and LLM behavior, we explore questions surrounding rationality and performance disparities between humans and LLMs, with particular attention to the Chat Generative Pre-trained Transformer. Our research employs comprehensive comparative analysis and delves into the inherent challenges of irrationality in LLMs, offering valuable insights and actionable strategies for enhancing their rationality. These findings hold significant implications for the widespread adoption of LLMs across diverse domains and applications, underscoring their potential to catalyze advancements in artificial intelligence.
Keywords
Cite
@article{arxiv.2403.09798,
title = {Comparing Rationality Between Large Language Models and Humans: Insights and Open Questions},
author = {Dana Alsagheer and Rabimba Karanjai and Nour Diallo and Weidong Shi and Yang Lu and Suha Beydoun and Qiaoning Zhang},
journal= {arXiv preprint arXiv:2403.09798},
year = {2024}
}