English
Related papers

Related papers: Toxicity in ChatGPT: Analyzing Persona-assigned La…

200 papers

Large Language Models (LLMs) are increasingly being used in learning environments to support teaching-be it as learning companions or as tutors. With our contribution, we aim to discuss the implications of the anthropomorphization of LLMs…

Computation and Language · Computer Science 2024-08-09 Kristina Schaaff , Marc-André Heidelmann

The remarkable capabilities of Large Language Models (LLMs) make them increasingly compelling for adoption in real-world healthcare applications. However, the risks associated with using LLMs in medical applications have not been…

Recent research has shown that large language models (LLMs) are particularly vulnerable to adversarial attacks. Since the release of ChatGPT, various industries are adopting LLM-based chatbots and virtual assistants in their data workflows.…

Cryptography and Security · Computer Science 2024-12-11 Ivan A. Fernandez , Subash Neupane , Sudip Mittal , Shahram Rahimi

We present this article as a small gesture in an attempt to counter what appears to be exponentially growing hype around Artificial Intelligence (AI) and its capabilities, and the distraction provided by the associated talk of…

Computation and Language · Computer Science 2023-07-12 Michael O'Neill , Mark Connor

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains challenging, as it draws on a breadth of general knowledge and…

Computation and Language · Computer Science 2023-09-14 Sarah E. Finch , Ellie S. Paek , Jinho D. Choi

Recent advancements in Large Language Models (LLMs), such as ChatGPT and LLaMA, have significantly transformed Natural Language Processing (NLP) with their outstanding abilities in text generation, summarization, and classification.…

Computation and Language · Computer Science 2024-08-12 Md Nazmus Sakib , Md Athikul Islam , Royal Pathak , Md Mashrur Arifin

Large Language Models (LLMs) have recently showcased their remarkable capacities, not only in natural language processing tasks but also across diverse domains such as clinical medicine, legal consultation, and education. LLMs become more…

Computation and Language · Computer Science 2024-01-23 Jen-tse Huang , Wenxuan Wang , Eric John Li , Man Ho Lam , Shujie Ren , Youliang Yuan , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

Empathetic dialogue is an indispensable part of building harmonious social relationships and contributes to the development of a helpful AI. Previous approaches are mainly based on fine small-scale language models. With the advent of…

Computation and Language · Computer Science 2024-07-29 Yushan Qian , Wei-Nan Zhang , Ting Liu

Large Language Model (LLM) chatbots like ChatGPT have emerged as cognitive scaffolding for autistic users, yet the tension between their utility and risk remains under-articulated. Through an inductive thematic analysis of 3,984 social…

Human-Computer Interaction · Computer Science 2026-03-26 Renkai Ma , Ben Zefeng Zhang , Chen Chen , Fan Yang , Xiaoshan Huang , Haolun Wu , Lingyao Li

With the development of large language models (LLMs) like ChatGPT, both their vast applications and potential vulnerabilities have come to the forefront. While developers have integrated multiple safety mechanisms to mitigate their misuse,…

Computation and Language · Computer Science 2024-07-23 Xiao Liu , Liangzhi Li , Tong Xiang , Fuying Ye , Lu Wei , Wangyue Li , Noa Garcia

In recent years, significant concern has emerged regarding the potential threat that Large Language Models (LLMs) pose to democratic societies through their persuasive capabilities. We expand upon existing research by conducting two survey…

Computation and Language · Computer Science 2025-05-02 Zhongren Chen , Joshua Kalla , Quan Le , Shinpei Nakamura-Sakai , Jasjeet Sekhon , Ruixiao Wang

Large Language Models (LLMs) are increasingly deployed in interactions where they are prompted to adopt personas. This paper investigates whether such persona conditioning affects model safety under bullying, an adversarial manipulation…

Artificial Intelligence · Computer Science 2025-05-20 Ziwei Xu , Udit Sanghi , Mohan Kankanhalli

This study explores ChatGPT's capabilities, stability, and risks in simulating psychological counseling sessions in a school counseling context. Using scripted role-plays between a human counselor and an AI client, we examine how a large…

Human-Computer Interaction · Computer Science 2025-12-08 Yang Ni , Yanzhuo Cao

Recent Large Language Model (LLM) based AI can exhibit recognizable and measurable personality traits during conversations to improve user experience. However, as human understandings of their personality traits can be affected by their…

Human-Computer Interaction · Computer Science 2026-01-21 Jingshu Li , Tianqi Song , Nattapat Boonprakong , Zicheng Zhu , Yitian Yang , Yi-Chieh Lee

Large Language Models (LLMs) have the potential to significantly enhance threat intelligence by automating the collection, preprocessing, and analysis of threat data. However, the usability of these tools is critical to ensure their…

Cryptography and Security · Computer Science 2024-09-24 Sanchana Srikanth , Mohammad Hasanuzzaman , Farah Tasnur Meem

This paper investigates the challenges associated with bias, toxicity, unreliability, and lack of robustness in large language models (LLMs) such as ChatGPT. It emphasizes that these issues primarily stem from the quality and diversity of…

Computers and Society · Computer Science 2024-10-21 Federico Torrielli

AI Large Language Models (LLMs) like ChatGPT are set to reshape some aspects of policymaking processes. Policy practitioners are already using ChatGPT for help with a variety of tasks: from drafting statements, submissions, and…

Computers and Society · Computer Science 2025-06-18 Matt Ziegler , Sarah Lothian , Brian O'Neill , Richard Anderson , Yoshitaka Ota

Conversation with chatbots based on Large Language Models (LLMs) such as ChatGPT has become one of the major forms of interaction with Artificial Intelligence (AI) in everyday life. What makes this interaction so convenient is that…

Human-Computer Interaction · Computer Science 2026-03-18 Sarah Diefenbach , Daniel Ullrich

Large Language Models (LLMs),such as ChatGPT, are increasingly used in research, ranging from simple writing assistance to complex data annotation tasks. Recently, some research has suggested that LLMs may even be able to simulate human…

Artificial Intelligence · Computer Science 2025-08-14 Sarah Schröder , Thekla Morgenroth , Ulrike Kuhl , Valerie Vaquet , Benjamin Paaßen

Individuals are increasingly relying on large language model (LLM)-enabled conversational agents for emotional support. While prior research has examined privacy and security issues in chatbots specifically designed for mental health…

Computers and Society · Computer Science 2025-07-16 Jabari Kwesi , Jiaxun Cao , Riya Manchanda , Pardis Emami-Naeini