English
Related papers

Related papers: Assessing Risks of Large Language Models in Mental…

200 papers

Key global challenges of our times are characterized by complex interdependencies and can only be effectively addressed through an integrated, participatory effort. Conventional risk analysis frameworks often reduce complexity to ensure…

Large language models (LLMs) are emerging as promising tools for mental health care, offering scalable support through their ability to generate human-like responses. However, the effectiveness of these models in clinical settings remains…

Artificial Intelligence · Computer Science 2024-08-22 Yining Hua , Hongbin Na , Zehan Li , Fenglin Liu , Xiao Fang , David Clifton , John Torous

Artificial Intelligence (AI) is revolutionizing scientific research, yet its growing integration into laboratory environments presents critical safety challenges. Large language models (LLMs) and vision language models (VLMs) now assist in…

Recent breakthroughs in natural language processing (NLP) have permitted the synthesis and comprehension of coherent text in an open-ended way, therefore translating the theoretical algorithms into practical applications. The large language…

Computation and Language · Computer Science 2023-05-30 Terry Yue Zhuo , Yujin Huang , Chunyang Chen , Zhenchang Xing

Access to mental health support remains limited, particularly in marginalized communities where structural and cultural barriers hinder timely care. This paper explores the potential of AI-enabled chatbots as a scalable solution, focusing…

Computers and Society · Computer Science 2024-10-07 Rawan AlMakinah , Andrea Norcini-Pala , Lindsey Disney , M. Abdullah Canbaz

The demand for psychological counselling has grown significantly in recent years, particularly with the global outbreak of COVID-19, which has heightened the need for timely and professional mental health support. Online psychological…

Computation and Language · Computer Science 2023-09-04 Tin Lai , Yukun Shi , Zicong Du , Jiajie Wu , Ken Fu , Yichao Dou , Ziqi Wang

Background: Emerging reports of "AI psychosis" are on the rise, where user-LLM interactions may exacerbate or induce psychosis or adverse psychological symptoms. Whilst the sycophantic and agreeable nature of LLMs can be beneficial, it…

Machine Learning · Computer Science 2025-09-18 Joshua Au Yeung , Jacopo Dalmasso , Luca Foschini , Richard JB Dobson , Zeljko Kraljevic

Demand for mental health support through AI chatbots is surging, though current systems present several limitations, like sycophancy or overvalidation, and reinforcement of maladaptive beliefs. A core obstacle to the creation of better…

Computation and Language · Computer Science 2025-12-08 José Pombal , Maya D'Eon , Nuno M. Guerreiro , Pedro Henrique Martins , António Farinhas , Ricardo Rei

We investigate the role of large language models (LLMs) in supporting mental health by analyzing Reddit posts and comments about mental health conversations with ChatGPT. Our findings reveal that users value ChatGPT as a safe,…

Human-Computer Interaction · Computer Science 2025-10-28 Kyuha Jung , Gyuho Lee , Yuanhui Huang , Yunan Chen

As large language models (LLMs) increasingly mediate emotionally sensitive conversations, especially in mental health contexts, their ability to recognize and respond to high-risk situations becomes a matter of public safety. This study…

Individuals are increasingly utilizing large language model (LLM)based tools for mental health guidance and crisis support in place of human experts. While AI technology has great potential to improve health outcomes, insufficient empirical…

Efforts to ensure the safety of large language models (LLMs) include safety fine-tuning, evaluation, and red teaming. However, despite the widespread use of the Retrieval-Augmented Generation (RAG) framework, AI safety work focuses on…

Computation and Language · Computer Science 2025-04-28 Bang An , Shiyue Zhang , Mark Dredze

Large language models (LLMs) are increasingly applied in mental health support systems, where reliable recognition of high-risk states such as suicidal ideation and self-harm is safety-critical. However, existing evaluations primarily rely…

Artificial Intelligence · Computer Science 2026-03-12 Yihe Zhang , Cheyenne N Mohawk , Kaiying Han , Vijay Srinivas Tida , Manyu Li , Xiali Hei

Mental disorders represent a critical global health challenge, and social media is increasingly viewed as a vital resource for real-time digital phenotyping and intervention. To leverage this data, large language models (LLMs) have been…

Computation and Language · Computer Science 2025-12-23 Zhuohan Ge , Darian Li , Yubo Wang , Nicole Hu , Xinyi Zhu , Haoyang Li , Xin Zhang , Mingtao Zhang , Shihao Qi , Yuming Xu , Han Shi , Chen Jason Zhang , Qing Li

Large Language Models (LLMs) are increasingly used for mental health support, yet little is known about how people with mental health challenges engage with them, how they evaluate their usefulness, and what design opportunities they…

Human-Computer Interaction · Computer Science 2026-02-12 Aditya Kumar Purohit , Hendrik Heuer

There is a significant gap between patient needs and available mental health support today. In this paper, we aim to thoroughly examine the potential of using Large Language Models (LLMs) to assist professional psychotherapy. To this end,…

Computation and Language · Computer Science 2025-01-28 Mian Zhang , Xianjun Yang , Xinlu Zhang , Travis Labrum , Jamie C. Chiu , Shaun M. Eack , Fei Fang , William Yang Wang , Zhiyu Zoey Chen

Large language models are being deployed as mental health support agents at scale, yet only 16% of LLM-based chatbot interventions have undergone rigorous clinical efficacy testing, and simulations reveal psychological deterioration in over…

Computation and Language · Computer Science 2026-04-28 Suhas BN , Andrew M. Sherrill , Rosa I. Arriaga , Chris W. Wiese , Saeed Abdullah

Large language model-powered chatbots have transformed how people seek information, especially in high-stakes contexts like mental health. Despite their support capabilities, safe detection and response to crises such as suicidal ideation…

Computation and Language · Computer Science 2026-04-09 Adrian Arnaiz-Rodriguez , Miguel Baidal , Erik Derner , Jenn Layton Annable , Mark Ball , Mark Ince , Elvira Perez Vallejos , Nuria Oliver

The growing demand for accessible mental health support, compounded by workforce shortages and logistical barriers, has led to increased interest in utilizing Large Language Models (LLMs) for scalable and real-time assistance. However,…

Human-Computer Interaction · Computer Science 2025-05-27 Ugur Kursuncu , Trilok Padhi , Gaurav Sinha , Abdulkadir Erol , Jaya Krishna Mandivarapu , Christopher R. Larrison

Mental health is a growing global concern, prompting interest in AI-driven solutions to expand access to psychosocial support. \emph{Peer support}, grounded in lived experience, offers a valuable complement to professional care. However,…

Human-Computer Interaction · Computer Science 2026-04-10 Kellie Yu Hui Sim , Roy Ka-Wei Lee , Kenny Tsu Wei Choo