English
Related papers

Related papers: A Novel Nuanced Conversation Evaluation Framework …

200 papers

Large Language Models (LLMs) are increasingly deployed in real-world applications where users engage in extended, mixed-topic conversations that depend on prior context. Yet, their reliability under realistic multi-turn interactions remains…

Computation and Language · Computer Science 2026-03-03 Jiyoon Myung

Large Language Models (LLMs) have showcased remarkable capabilities in various Natural Language Processing tasks. For automatic open-domain dialogue evaluation in particular, LLMs have been seamlessly integrated into evaluation frameworks,…

Computation and Language · Computer Science 2024-07-08 John Mendonça , Alon Lavie , Isabel Trancoso

Large Language Models (LLMs) have emerged as powerful generative Artificial Intelligence solutions which can be applied to several fields and areas of work. This paper presents results and reflection of an experiment done to use the model…

Computation and Language · Computer Science 2023-12-12 Stefano De Paoli

Conversational agents based on Large Language Models (LLMs) have recently emerged as powerful tools for human-computer interaction. Nevertheless, their black-box nature implies challenges in predictability and a lack of personalization,…

Computation and Language · Computer Science 2026-04-07 Barbara Gendron , Gaël Guibon , Mathieu d'Aquin

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

Computation and Language · Computer Science 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

While Large Language Models (LLMs) demonstrate significant potential in providing accessible mental health support, their practical deployment raises critical trustworthiness concerns due to the domains high-stakes and safety-sensitive…

Computation and Language · Computer Science 2026-03-04 Zixin Xiong , Ziteng Wang , Haotian Fan , Xinjie Zhang , Wenxuan Wang

The latest large language models (LLMs) such as ChatGPT, exhibit strong capabilities in automated mental health analysis. However, existing relevant studies bear several limitations, including inadequate evaluations, lack of prompting…

Computation and Language · Computer Science 2024-10-03 Kailai Yang , Shaoxiong Ji , Tianlin Zhang , Qianqian Xie , Ziyan Kuang , Sophia Ananiadou

As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and…

Software Engineering · Computer Science 2024-04-02 Zeeshan Rasheed , Muhammad Waseem , Kari Systä , Pekka Abrahamsson

The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings. This research evaluates the performance of seven…

Computation and Language · Computer Science 2024-06-14 Millicent Ochieng , Varun Gumma , Sunayana Sitaram , Jindong Wang , Vishrav Chaudhary , Keshet Ronen , Kalika Bali , Jacki O'Neill

Large language models (LLMs) hold potential for mental healthcare applications, particularly in cognitive behavioral therapy (CBT)-based counseling, where reward models play a critical role in aligning LLMs with preferred therapeutic…

Databases · Computer Science 2026-03-13 Yougen Zhou , Qin Chen , Ningning Zhou , Jie Zhou , Liang He

The rapid advancement of artificial intelligence, particularly with the development of Large Language Models (LLMs) built on the transformer architecture, has redefined the capabilities of natural language processing. These models now…

Computation and Language · Computer Science 2025-02-11 Andrea Matarazzo , Riccardo Torlone

Mental health is increasingly critical in contemporary healthcare, with psychotherapy demanding dynamic, context-sensitive interactions that traditional NLP methods struggle to capture. Large Language Models (LLMs) offer significant…

Computation and Language · Computer Science 2025-06-30 Hongbin Na , Yining Hua , Zimu Wang , Tao Shen , Beibei Yu , Lilin Wang , Wei Wang , John Torous , Ling Chen

Background: Advancements in large language models (LLMs) have opened new possibilities in psychiatric interviews, an underexplored area where LLMs could be valuable. This study focuses on enhancing psychiatric interviews by analyzing…

Artificial Intelligence · Computer Science 2025-02-11 Jae-hee So , Joonhwan Chang , Eunji Kim , Junho Na , JiYeon Choi , Jy-yong Sohn , Byung-Hoon Kim , Sang Hui Chu

Understanding the dynamics of counseling conversations is an important task, yet it is a challenging NLP problem regardless of the recent advance of Transformer-based pre-trained language models. This paper proposes a systematic approach to…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Dan Goldwasser , Laura Schwab Reese

Large language models (LLMs) excel at solving problems with clear and complete statements, but often struggle with nuanced environments or interactive tasks which are common in most real-world scenarios. This highlights the critical need…

This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between consulting clients…

Computation and Language · Computer Science 2023-09-28 June M. Liu , Donghao Li , He Cao , Tianhe Ren , Zeyi Liao , Jiamin Wu

Objectives: While Large Language Models (LLMs) have been widely used to assist clinicians and support patients, no existing work has explored dialogue systems for standard diagnostic interviews and assessments. This study aims to bridge the…

Computation and Language · Computer Science 2025-05-01 Sichang Tu , Abigail Powers , Stephen Doogan , Jinho D. Choi

Large language models (LLMs) are increasingly used in decision-making tasks like r\'esum\'e screening and content moderation, giving them the power to amplify or suppress certain perspectives. While previous research has identified…

Computation and Language · Computer Science 2025-05-28 Naba Rizvi , Harper Strickland , Saleha Ahmedi , Aekta Kallepalli , Isha Khirwadkar , William Wu , Imani N. S. Munyaka , Nedjma Ousidhoum

Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT). When these language models are applied in the field of psychological counseling,…

Computation and Language · Computer Science 2023-11-02 Yirong Chen , Xiaofen Xing , Jingkai Lin , Huimin Zheng , Zhenyu Wang , Qi Liu , Xiangmin Xu

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

Computers and Society · Computer Science 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli