English
Related papers

Related papers: AI Content Moderation in Therapy Conversations

200 papers

The past decade has been transformative for mental health research and practice. The ability to harness large repositories of data, whether from electronic health records (EHR), mobile devices, or social media, has revealed a potential for…

Computation and Language · Computer Science 2023-11-28 Munmun De Choudhury , Sachin R. Pendse , Neha Kumar

Mental health is a growing global concern, prompting interest in AI-driven solutions to expand access to psychosocial support. \emph{Peer support}, grounded in lived experience, offers a valuable complement to professional care. However,…

Human-Computer Interaction · Computer Science 2026-04-10 Kellie Yu Hui Sim , Roy Ka-Wei Lee , Kenny Tsu Wei Choo

Large language models (LLMs) have exploded in popularity due to their ability to perform a wide array of natural language tasks. Text-based content moderation is one LLM use case that has received recent enthusiasm, however, there is little…

Human-Computer Interaction · Computer Science 2024-01-18 Deepak Kumar , Yousef AbuHashem , Zakir Durumeric

As the volume of video content online grows exponentially, the demand for moderation of unsafe videos has surpassed human capabilities, posing both operational and mental health challenges. While recent studies demonstrated the merits of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Adi Levi , Or Levi , Sardhendu Mishra , Jonathan Morra

The development and popularization of large language models (LLMs) have raised concerns that they will be used to create tailor-made, convincing arguments to push false or misleading narratives online. Early work has found that language…

Computers and Society · Computer Science 2025-05-21 Francesco Salvi , Manoel Horta Ribeiro , Riccardo Gallotti , Robert West

The global mental health crisis is looming with a rapid increase in mental disorders, limited resources, and the social stigma of seeking treatment. As the field of artificial intelligence (AI) has witnessed significant advancements in…

Computation and Language · Computer Science 2023-11-27 Neo Christopher Chung , George Dyer , Lennart Brocki

Mental health remains a major public health concern, while access to timely psychological support is often limited. AI-based dialogue systems have emerged as promising tools to address these barriers, and recent advances in large language…

Computers and Society · Computer Science 2026-03-16 Daeun Lee , Dongje Yoo , Migyeong Yang , Jihyun An , Christine B. Cha , Jinyoung Han

Recent advancements in Large Language Models (LLMs), such as ChatGPT and LLaMA, have significantly transformed Natural Language Processing (NLP) with their outstanding abilities in text generation, summarization, and classification.…

Computation and Language · Computer Science 2024-08-12 Md Nazmus Sakib , Md Athikul Islam , Royal Pathak , Md Mashrur Arifin

Limited access to mental health care has motivated the use of digital tools and conversational agents powered by large language models (LLMs), yet their quality and reception remain unclear. We present a study comparing therapist-written…

Human-Computer Interaction · Computer Science 2025-09-16 Synthia Wang , Yuwei Cheng , Austin Song , Sarah Keedy , Marc Berman , Nick Feamster

Social media platforms utilize Machine Learning (ML) and Artificial Intelligence (AI) powered recommendation algorithms to maximize user engagement, which can result in inadvertent exposure to harmful content. Current moderation efforts,…

Computation and Language · Computer Science 2025-05-30 Rajvardhan Oak , Muhammad Haroon , Claire Jo , Magdalena Wojcieszak , Anshuman Chhabra

The integration of Large Language Models (LLMs) into healthcare settings has gained significant attention, particularly for question-answering tasks. Given the high-stakes nature of healthcare, it is essential to ensure that LLM-generated…

The AI era has ushered in Large Language Models (LLM) to the technological forefront, which has been much of the talk in 2023, and is likely to remain as such for many years to come. LLMs are the AI models that are the power house behind…

Cryptography and Security · Computer Science 2026-01-22 Anjanava Biswas , Wrick Talukdar

Millions of people now use non-clinical Large Language Model (LLM) tools like ChatGPT for mental well-being support. This paper investigates what it means to design such tools responsibly, and how to operationalize that responsibility in…

Human-Computer Interaction · Computer Science 2026-02-23 Ned Cooper , Jose A. Guridi , Angel Hsing-Chi Hwang , Beth Kolko , Emma Elizabeth McGinty , Qian Yang

With the rapid progress of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. Though model developers and researchers work hard on dialog safety to avoid generating harmful content from…

Computation and Language · Computer Science 2023-11-02 Haoran Li , Dadi Guo , Wei Fan , Mingshi Xu , Jie Huang , Fanpu Meng , Yangqiu Song

The interactive nature of Large Language Models (LLMs), which closely track user data and context, has prompted users to share personal and private information in unprecedented ways. Even when users opt out of allowing their data to be used…

Cryptography and Security · Computer Science 2025-08-26 GodsGift Uzor , Hasan Al-Qudah , Ynes Ineza , Abdul Serwadda

Large language models (LLMs) are increasingly used to assist computational social science research. While prior efforts have focused on text, the potential of leveraging multimodal LLMs (MLLMs) for online video studies remains…

Human-Computer Interaction · Computer Science 2025-03-10 Jiaying "Lizzy" Liu , Yiheng Su , Praneel Seth

This study investigates the efficacy of Large Language Models (LLMs) in interactive language therapy for high-functioning autistic adolescents. With the rapid advancement of artificial intelligence, particularly in natural language…

Human-Computer Interaction · Computer Science 2023-11-17 Yujin Cho , Mingeon Kim , Seojin Kim , Oyun Kwon , Ryan Donghan Kwon , Yoonha Lee , Dohyun Lim

The primary aim of this research was to address the limitations observed in the medical knowledge of prevalent large language models (LLMs) such as ChatGPT, by creating a specialized language model with enhanced accuracy in medical advice.…

Computation and Language · Computer Science 2023-06-27 Yunxiang Li , Zihan Li , Kai Zhang , Ruilong Dan , Steve Jiang , You Zhang

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Large-scale language models (LLMs), such as ChatGPT, are becoming increasingly sophisticated and exhibit human-like capabilities, playing an essential role in assisting humans in a variety of everyday tasks. An important application of AI…

Computers and Society · Computer Science 2023-12-07 Yugen Sato , Taisei Nakajima , Tatsuki Kawamoto , Tomohiro Takagi