English
Related papers

Related papers: The Knowledge-Behaviour Disconnect in LLM-based Ch…

200 papers

The advent of generative Large Language Models (LLMs) such as ChatGPT has catalyzed transformative advancements across multiple domains. However, alongside these advancements, they have also introduced potential threats. One critical…

Computation and Language · Computer Science 2023-09-28 Bohan Jiang , Zhen Tan , Ayushi Nirmal , Huan Liu

Recent advancements in large language models (LLMs) promise to expand mental health interventions by emulating therapeutic techniques, potentially easing barriers to care. Yet there is a lack of real-world empirical evidence evaluating the…

Human-Computer Interaction · Computer Science 2025-01-28 Yinzhou Wang , Yimeng Wang , Ye Xiao , Liabette Escamilla , Bianca Augustine , Kelly Crace , Gang Zhou , Yixuan Zhang

As LLM-powered chatbots are increasingly deployed in mental health services, detecting hallucinations and omissions has become critical for user safety. However, state-of-the-art LLM-as-a-judge methods often fail in high-risk healthcare…

Computation and Language · Computer Science 2026-04-09 Khizar Hussain , Bradley A. Malin , Zhijun Yin , Susannah Leigh Rose , Murat Kantarcioglu

Dialogue-based language models mark a huge milestone in the field of artificial intelligence, by their impressive ability to interact with users, as well as a series of challenging tasks prompted by customized instructions. However, the…

Artificial Intelligence · Computer Science 2023-04-26 Rui Hao , Linmei Hu , Weijian Qi , Qingliu Wu , Yirui Zhang , Liqiang Nie

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…

Human-Computer Interaction · Computer Science 2024-09-10 Jaekwon Park , Jiyoung Bae , Unggi Lee , Taekyung Ahn , Sookbun Lee , Dohee Kim , Aram Choi , Yeil Jeong , Jewoong Moon , Hyeoncheol Kim

The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns. As a supplement to a recent study on the behavioral Turing test, this…

Artificial Intelligence · Computer Science 2024-12-18 Yutong Xie , Yiyao Liu , Zhuang Ma , Lin Shi , Xiyuan Wang , Walter Yuan , Matthew O. Jackson , Qiaozhu Mei

Large language models (LLMs) are excellent at maintaining high-level, convincing dialogue, but it remains unclear whether their persuasive success reflects genuine understanding of the discourse. We examine this question through informal…

Computation and Language · Computer Science 2026-04-21 Adrian de Wynter , Tangming Yuan

Large Language Models (LLMs) are widely used in healthcare, but limitations like hallucinations, incomplete information, and bias hinder their reliability. To address these, researchers released the Build Your Own expert Bot (BYOeB)…

Human-Computer Interaction · Computer Science 2024-09-18 Bhuvan Sachdeva , Pragnya Ramjee , Geeta Fulari , Kaushik Murali , Mohit Jain

Although chatbots have been very popular in recent years, they still have some serious weaknesses which limit the scope of their applications. One major weakness is that they cannot learn new knowledge during the conversation process, i.e.,…

Computation and Language · Computer Science 2018-02-27 Sahisnu Mazumder , Nianzu Ma , Bing Liu

The increasing trust in large language models (LLMs), especially in the form of chatbots, is often undermined by the lack of their extrinsic evaluation. This holds particularly true in nutrition, where randomised controlled trials (RCTs)…

Human-Computer Interaction · Computer Science 2025-11-27 Karen Jia-Hui Li , Simone Balloccu , Ondrej Dusek , Ehud Reiter

LGBTQ+ individuals are increasingly turning to chatbots powered by large language models (LLMs) to meet their mental health needs. However, little research has explored whether these chatbots can adequately and safely provide tailored…

Human-Computer Interaction · Computer Science 2024-02-15 Zilin Ma , Yiyang Mei , Yinru Long , Zhaoyuan Su , Krzysztof Z. Gajos

LLMs promise to overcome limitations of rule-based mental health chatbots through improved natural language capabilities, yet their ability to deliver evidence-based psychological interventions remains largely unverified because evaluations…

Human-Computer Interaction · Computer Science 2025-12-22 Florian Onur Kuhlmeier , Leon Hanschmann , Melina Rabe , Stefan Luettke , Eva-Lotta Brakemeier , Alexander Maedche

Large language models (LLMs), including ChatGPT, Bard, and Llama, have achieved remarkable successes over the last two years in a range of different applications. In spite of these successes, there exist concerns that limit the wide…

Computation and Language · Computer Science 2024-01-17 Junliang Luo , Tianyu Li , Di Wu , Michael Jenkin , Steve Liu , Gregory Dudek

Large Language Models (LLMs) have made significant progress in recent years, achieving remarkable results in question-answering tasks (QA). However, they still face two major challenges: hallucination and outdated information after the…

Conversational agents are increasingly used in healthcare, and the integration of Large Language Models (LLMs) has significantly enhanced their capabilities. When integrated into social robots, LLMs offer the potential for more natural…

Computers and Society · Computer Science 2024-11-25 Robert Ranisch , Joschka Haltaufderheide

Multi-turn conversation has emerged as a predominant interaction paradigm for Large Language Models (LLMs). Users often employ follow-up questions to refine their intent, expecting LLMs to adapt dynamically. However, recent research reveals…

Computation and Language · Computer Science 2026-02-10 Geng Liu , Fei Zhu , Rong Feng , Changyi Ma , Shiqi Wang , Gaofeng Meng

Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health…

Computers and Society · Computer Science 2025-07-16 Jabari Kwesi , Jiaxun Cao , Riya Manchanda , Pardis Emami-Naeini

The rise of Large Language Models (LLMs) has sparked debate about whether these systems exhibit human-level cognition. In this debate, little attention has been paid to a structural component of human cognition: core beliefs, truths that…

Machine Learning · Computer Science 2026-05-06 Anna Sokol , Marianna B. Ganapini , Nitesh V. Chawla

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate…

Human-Computer Interaction · Computer Science 2024-05-24 Heinrich Peters , Moran Cerf , Sandra C. Matz

Increased sophistication of large language models (LLMs) and the consequent quality of generated multilingual text raises concerns about potential disinformation misuse. While humans struggle to distinguish LLM-generated content from…

Computation and Language · Computer Science 2026-02-05 Dominik Macko , Aashish Anantha Ramakrishnan , Jason Samuel Lucas , Robert Moro , Ivan Srba , Adaku Uchendu , Dongwon Lee