English
Related papers

Related papers: Evaluation of AI Chatbots for Patient-Specific EHR…

200 papers

People experiencing severe distress increasingly use Large Language Model (LLM) chatbots as mental health support tools. Discussions on social media have described how engagements were lifesaving for some, but evidence suggests that…

Human-Computer Interaction · Computer Science 2025-05-12 Inhwa Song , Sachin R. Pendse , Neha Kumar , Munmun De Choudhury

Historical emphasis on writing mastery has shifted with advances in generative AI, especially in scientific writing. This study analysed six AI chatbots for scholarly writing in humanities and archaeology. Using methods that assessed…

Computation and Language · Computer Science 2023-10-17 Edisa Lozić , Benjamin Štular

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between consulting clients…

Computation and Language · Computer Science 2023-09-28 June M. Liu , Donghao Li , He Cao , Tianhe Ren , Zeyi Liao , Jiamin Wu

Unstructured clinical notes contain essential patient information but are challenging for physicians to search and interpret efficiently. Although large language models (LLMs) have shown promise in question answering (QA), most existing…

Human-Computer Interaction · Computer Science 2025-05-27 Dina Albassam

Background: Large Language Models (LLMs) are transforming artificial intelligence applications in healthcare due to their ability to understand, generate, and summarize complex medical text. They offer valuable support to clinicians,…

Computation and Language · Computer Science 2026-04-14 Subin Santhosh , Farwa Abbas , Hussain Ahmad , Claudia Szabo

Effective communication within universities is crucial for addressing the diverse information needs of students, alumni, and external stakeholders. However, existing chatbot systems often fail to deliver accurate, context-specific…

Computation and Language · Computer Science 2024-10-23 Sahil Kumar , Deepa Paikar , Kiran Sai Vutukuri , Haider Ali , Shashidhar Reddy Ainala , Aditya Murli Krishnan , Youshan Zhang

Large language models (LLMs) chatbots like ChatGPT are increasingly used for mental health support. They offer accessible, therapeutic support but also raise concerns about misinformation, over-reliance, and risks in high-stakes contexts of…

Computers and Society · Computer Science 2025-12-09 Lingyao Li , Xiaoshan Huang , Renkai Ma , Ben Zefeng Zhang , Haolun Wu , Fan Yang , Chen Chen

With the rapid evolution of Natural Language Processing (NLP), Large Language Models (LLMs) like ChatGPT have emerged as powerful tools capable of transforming various sectors. Their vast knowledge base and dynamic interaction capabilities…

Computers and Society · Computer Science 2024-01-02 Kevin Wang , Jason Ramos , Ramon Lawrence

This paper introduces Med-Bot, an AI-powered chatbot designed to provide users with accurate and reliable medical information. Utilizing advanced libraries and frameworks such as PyTorch, Chromadb, Langchain and Autogptq, Med-Bot is built…

Artificial Intelligence · Computer Science 2024-11-15 Ahan Bhatt , Nandan Vaghela

Large Language Models (LLMs) have created opportunities for designing chatbots that can support complex question-answering (QA) scenarios and improve news audience engagement. However, we still lack an understanding of what roles…

Human-Computer Interaction · Computer Science 2024-03-26 Md Naimul Hoque , Ayman Mahfuz , Mayukha Kindi , Naeemul Hassan

The integration of Large Language Models (LLMs) and chatbots introduces new challenges and opportunities for decision-making in software testing. Decision-making relies on a variety of information, including code, requirements…

Software Engineering · Computer Science 2024-06-18 Francisco Gomes de Oliveira Neto

Background: Clinical guidelines are central to safe evidence-based medicine in modern healthcare, providing diagnostic criteria, treatment options and monitoring advice for a wide range of illnesses. LLM-empowered chatbots have shown great…

Computation and Language · Computer Science 2025-05-07 Julia Ive , Felix Jozsa , Nick Jackson , Paulina Bondaronek , Ciaran Scott Hill , Richard Dobson

Generative AI systems such as ChatGPT and Claude are built upon language models that are typically evaluated for accuracy on curated benchmark datasets. Such evaluation paradigms measure predictive and reasoning capabilities of language…

Human-Computer Interaction · Computer Science 2025-03-03 Shreya Rajagopal , Jae Ho Sohn , Hari Subramonyam , Shiwali Mohan

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…

Human-Computer Interaction · Computer Science 2024-09-10 Jaekwon Park , Jiyoung Bae , Unggi Lee , Taekyung Ahn , Sookbun Lee , Dohee Kim , Aram Choi , Yeil Jeong , Jewoong Moon , Hyeoncheol Kim

Large language models (LLMs) have demonstrated powerful text generation capabilities, bringing unprecedented innovation to the healthcare field. While LLMs hold immense promise for applications in healthcare, applying them to real clinical…

Computation and Language · Computer Science 2023-10-16 Rui Yang , Edison Marrese-Taylor , Yuhe Ke , Lechao Cheng , Qingyu Chen , Irene Li

Patients must possess the knowledge necessary to actively participate in their care. We present NoteAid-Chatbot, a conversational AI that promotes patient understanding via a novel 'learning as conversation' framework, built on a…

Artificial Intelligence · Computer Science 2025-10-28 Won Seok Jang , Hieu Tran , Manav Mistry , SaiKiran Gandluri , Yifan Zhang , Sharmin Sultana , Sunjae Kown , Yuan Zhang , Zonghai Yao , Hong Yu

METHODS: First, a set of evaluation criteria is designed based on a comprehensive literature review. Second, existing candidate criteria are optimized for using a Delphi method by five experts in medicine and engineering. Third, three…

Computation and Language · Computer Science 2023-05-15 Jie Xu , Lu Lu , Sen Yang , Bilin Liang , Xinwei Peng , Jiali Pang , Jinru Ding , Xiaoming Shi , Lingrui Yang , Huan Song , Kang Li , Xin Sun , Shaoting Zhang

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

Empowering chatbots in the field of mental health is receiving increasing amount of attention, while there still lacks exploration in developing and evaluating chatbots in psychiatric outpatient scenarios. In this work, we focus on…

Computation and Language · Computer Science 2023-05-24 Siyuan Chen , Mengyue Wu , Kenny Q. Zhu , Kunyao Lan , Zhiling Zhang , Lyuchun Cui

Healthcare systems continuously generate vast amounts of electronic health records (EHRs), commonly stored in the Fast Healthcare Interoperability Resources (FHIR) standard. Despite the wealth of information in these records, their…

Computation and Language · Computer Science 2025-01-24 Sara Kothari , Ayush Gupta