English
Related papers

Related papers: LLMs in social services: How does chatbot accuracy…

200 papers

This study investigates the forecasting accuracy of human experts versus Large Language Models (LLMs) in the retail sector, particularly during standard and promotional sales periods. Utilizing a controlled experimental setup with 123 human…

Machine Learning · Computer Science 2024-05-20 MAhdi Abolghasemi , Odkhishig Ganbold , Kristian Rotaru

Recent research has shown that hallucinations, omissions, and biases are prevalent in everyday use-cases of LLMs. However, chatbots used in medical contexts must provide consistent advice in situations where non-medical factors are…

Computation and Language · Computer Science 2025-11-05 Jonathan Liu , Haoling Qiu , Jonathan Lasko , Damianos Karakos , Mahsa Yarmohammadi , Mark Dredze

Artificial intelligence (AI), particularly in the form of large language models (LLMs) or chatbots, has become increasingly integrated into our daily lives. In the past five years, several LLMs have been introduced, including ChatGPT by…

Human-Computer Interaction · Computer Science 2026-05-06 Mouhacine Benosman

LLMs promise to overcome limitations of rule-based mental health chatbots through improved natural language capabilities, yet their ability to deliver evidence-based psychological interventions remains largely unverified because evaluations…

Human-Computer Interaction · Computer Science 2025-12-22 Florian Onur Kuhlmeier , Leon Hanschmann , Melina Rabe , Stefan Luettke , Eva-Lotta Brakemeier , Alexander Maedche

This paper reports on a real-world case study in which over 100 network engineers assessed how a Large Language Model (LLM) can assist in building and operating a network. The versatility of LLMs has accelerated their adoption across a wide…

Networking and Internet Architecture · Computer Science 2026-05-20 Ryo Nakamura , Koshi Eguchi

Conversational AI chatbots have become increasingly common within the customer service industry. Despite improvements in their emotional development, they often lack the authenticity of real customer service interactions or the competence…

Human-Computer Interaction · Computer Science 2025-02-14 Antonin Brun , Ruying Liu , Aryan Shukla , Frances Watson , Jonathan Gratch

Much research on LLMs has focused on increasing benchmark performance. However, the evaluation of such models in real-world collaborative human-AI workflows has stayed behind. This work evaluates a chatbot-style assistant based on…

Information Retrieval · Computer Science 2026-05-05 Lennard C. Froma , Tom Kouwenhoven , Maaike H. T. de Boer , Catholijn M. Jonker , Max J. van Duijn

Background: Clinical guidelines are central to safe evidence-based medicine in modern healthcare, providing diagnostic criteria, treatment options and monitoring advice for a wide range of illnesses. LLM-empowered chatbots have shown great…

Computation and Language · Computer Science 2025-05-07 Julia Ive , Felix Jozsa , Nick Jackson , Paulina Bondaronek , Ciaran Scott Hill , Richard Dobson

Manually annotating data for computational social science tasks can be costly, time-consuming, and emotionally draining. While recent work suggests that LLMs can perform such annotation tasks in zero-shot settings, little is known about how…

Artificial Intelligence · Computer Science 2025-06-30 Shubham Atreja , Joshua Ashkinaze , Lingyao Li , Julia Mendelsohn , Libby Hemphill

Student commitment towards a learning recommendation is not separable from their understanding of the reasons it was recommended to them; and their ability to modify it based on that understanding. Among explainability approaches, chatbots…

Artificial Intelligence · Computer Science 2024-01-25 Hasan Abu-Rasheed , Mohamad Hussam Abdulsalam , Christian Weber , Madjid Fathi

Recently, the fast development of Large Language Models (LLMs) such as ChatGPT has significantly advanced NLP tasks by enhancing the capabilities of conversational models. However, the application of LLMs in the recommendation domain has…

Information Retrieval · Computer Science 2023-08-24 Junling Liu , Chao Liu , Peilin Zhou , Qichen Ye , Dading Chong , Kang Zhou , Yueqi Xie , Yuwei Cao , Shoujin Wang , Chenyu You , Philip S. Yu

Providing sufficient support for students requires substantial resources, especially considering the growing enrollment numbers. Students need help in a variety of tasks, ranging from information-seeking to requiring support with course…

Computers and Society · Computer Science 2024-10-18 Leonardo Pasquarelli , Charles Koutcheme , Arto Hellas

LGBTQ+ individuals are increasingly turning to chatbots powered by large language models (LLMs) to meet their mental health needs. However, little research has explored whether these chatbots can adequately and safely provide tailored…

Human-Computer Interaction · Computer Science 2024-02-15 Zilin Ma , Yiyang Mei , Yinru Long , Zhaoyuan Su , Krzysztof Z. Gajos

Human-LLM conversations are increasingly becoming more pervasive in peoples' professional and personal lives, yet many users still struggle to elicit helpful responses from LLM Chatbots. One of the reasons for this issue is users' lack of…

Computation and Language · Computer Science 2025-06-26 Rupak Sarkar , Bahareh Sarrafzadeh , Nirupama Chandrasekaran , Nagu Rangan , Philip Resnik , Longqi Yang , Sujay Kumar Jauhar

Many users interact with AI tools like ChatGPT using a mental model that treats the system as human-like, which we call Model H. According to goal-setting theory, increased specificity in goals should reduce performance variance. If Model H…

Computers and Society · Computer Science 2025-10-09 Mrityunjay Kumar

Increasingly powerful Large Language Model (LLM) based chatbots, like ChatGPT and Bard, are becoming available to users that have the potential to revolutionize the quality of decision-making achieved by the public. In this context, we set…

Computation and Language · Computer Science 2023-07-17 Kausik Lakkaraju , Sai Krishna Revanth Vuruma , Vishal Pallagani , Bharath Muppasani , Biplav Srivastava

Providing scaffolding through educational chatbots built on Large Language Models (LLM) has potential risks and benefits that remain an open area of research. When students navigate impasses, they ask for help by formulating impasse-driven…

Human-Computer Interaction · Computer Science 2026-02-23 Alexandra Neagu , Marcus Messer , Peter Johnson , Rhodri Nelson

Users can discuss a wide range of topics with large language models (LLMs), but they do not always prefer solving problems or getting information through lengthy conversations. This raises an intriguing HCI question: How does instructing…

Human-Computer Interaction · Computer Science 2024-04-29 Shih-Hong Huang , Ya-Fang Lin , Zeyu He , Chieh-Yang Huang , Ting-Hao 'Kenneth' Huang

We explore the use of Large Language Model (LLM-based) chatbots to power recommender systems. We observe that the chatbots respond poorly when they encounter under-specified requests (e.g., they make incorrect assumptions, hedge with a long…

Information Retrieval · Computer Science 2024-06-05 Christine Herlihy , Jennifer Neville , Tobias Schnabel , Adith Swaminathan

Large Language Models (LLMs) have transformed human-computer interaction by enabling natural language-based communication with AI-powered chatbots. These models are designed to be intuitive and user-friendly, allowing users to articulate…