ChatGPT's advice drives moral judgments with or without justification
Human-Computer Interaction
2025-01-06 v1 Computers and Society
Abstract
Why do users follow moral advice from chatbots? A chatbot is not an authoritative moral advisor, but it can generate seemingly plausible arguments. Users do not follow reasoned more readily than unreasoned advice, though, we find in an experiment. However, this is also true if we attribute advice to a moral advisor, not a chatbot. Hence, it seems that advice offers users a cheap way to escape from a moral dilemma. This is a concern that chatbots do not raise, but they exacerbate it as they make advice easily accessible. We conclude that it takes ethical in addition to digital literacy to harness users against moral advice from chatbots.
Cite
@article{arxiv.2501.01897,
title = {ChatGPT's advice drives moral judgments with or without justification},
author = {Sebastian Kruegel and Andreas Ostermaier and Matthias Uhl},
journal= {arXiv preprint arXiv:2501.01897},
year = {2025}
}