English
Related papers

Related papers: PsychEthicsBench: Evaluating Large Language Models…

200 papers

Large language models (LLMs) have been actively applied in the mental health field. Recent research shows the promise of LLMs in applying psychotherapy, especially motivational interviewing (MI). However, there is a lack of studies…

Computation and Language · Computer Science 2025-04-01 Haein Kong , Seonghyeon Moon

As Large Language Models (LLMs) are increasingly deployed in healthcare field, it becomes essential to carefully evaluate their medical safety before clinical use. However, existing safety benchmarks remain predominantly English-centric,…

Computation and Language · Computer Science 2026-05-28 Junyu Liu , Zirui Li , Qian Niu , Zequn Zhang , Yue Xun , Wenlong Hou , Shujun Wang , Yusuke Iwasawa , Yutaka Matsuo , Kan Hatakeyama-Sato

Evaluating the safety alignment of LLM responses in high-risk mental health dialogues is particularly difficult due to missing gold-standard answers and the ethically sensitive nature of these interactions. To address this challenge, we…

Computation and Language · Computer Science 2026-02-16 Yunna Cai , Fan Wang , Haowei Wang , Kun Wang , Kailai Yang , Sophia Ananiadou , Moyan Li , Mingming Fan

Large language models (LLMs) are increasingly applied in financial scenarios. However, they may produce harmful outputs, including facilitating illegal activities or unethical behavior, posing serious compliance risks. To systematically…

Computation and Language · Computer Science 2026-05-04 Yutao Hou , Yihan Jiang , Yuhan Xie , Jian Yang , Liwen Zhang , Hailiang Huang , Guanhua Chen , Yun Chen

Refusal behavior in large language models (LLMs) enables them to decline responding to harmful, unethical, or inappropriate prompts, ensuring alignment with ethical standards. This paper investigates refusal behavior across six LLMs from…

Computation and Language · Computer Science 2025-01-15 Fabian Hildebrandt , Andreas Maier , Patrick Krauss , Achim Schilling

Large Language Models (LLMs) such as ChatGPT, have gained significant attention due to their impressive natural language processing capabilities. It is crucial to prioritize human-centered principles when utilizing these models.…

Computation and Language · Computer Science 2023-06-21 Yue Huang , Qihui Zhang , Philip S. Y , Lichao Sun

Large language models (LLMs) are increasingly considered for deployment as the control component of robotic health attendants, yet their safety in this context remains poorly characterized. We introduce a dataset of 270 harmful instructions…

Artificial Intelligence · Computer Science 2026-04-30 Mahiro Nakao , Kazuhiro Takemoto

Large language models (LLMs) are increasingly used for medical consultation and health information support. In this high-stakes setting, safety depends not only on medical knowledge, but also on how models respond when patient inputs are…

Computation and Language · Computer Science 2026-04-01 Yahan Li , Xinyi Jie , Wanjia Ruan , Xubei Zhang , Huaijie Zhu , Yicheng Gao , Chaohao Du , Ruishan Liu

Generative large language models present significant potential but also raise critical ethical concerns, including issues of safety, fairness, robustness, and reliability. Most existing ethical studies, however, are limited by their narrow…

Computation and Language · Computer Science 2026-01-09 Yıldırım Özen , Burak Erinç Çetin , Kaan Engür , Elif Naz Demiryılmaz , Cagri Toraman

Psychological support hotlines serve as critical lifelines for crisis intervention but encounter significant challenges due to rising demand and limited resources. Large language models (LLMs) offer potential support in crisis assessments,…

Computation and Language · Computer Science 2025-12-19 Guifeng Deng , Shuyin Rao , Tianyu Lin , Anlu Dai , Pan Wang , Junyi Xie , Haidong Song , Ke Zhao , Dongwu Xu , Zhengdong Cheng , Tao Li , Haiteng Jiang

The rapid integration of Large Vision-Language Models (LVLMs) into critical domains necessitates comprehensive moral evaluation to ensure their alignment with human values. While extensive research has addressed moral evaluation in LLMs,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Bei Yan , Jie Zhang , Zhiyuan Chen , Shiguang Shan , Xilin Chen

Large language models (LLMs) have attracted significant attention for potential applications in digital health, while their application in mental health is subject to ongoing debate. This systematic review aims to evaluate the usage of LLMs…

Computers and Society · Computer Science 2024-08-14 Zhijun Guo , Alvina Lai , Johan Hilge Thygesen , Joseph Farrington , Thomas Keen , Kezhi Li

Large Language Models (LLMs) are increasingly integrated into software engineering (SE) tools for tasks that extend beyond code synthesis, including judgment under uncertainty and reasoning in ethically significant contexts. We present a…

Software Engineering · Computer Science 2025-10-02 Patrizio Migliarini , Mashal Afzal Memon , Marco Autili , Paola Inverardi

We present an ethical decision-making framework that refines a pre-trained reinforcement learning (RL) model using a task-agnostic ethical layer. Following initial training, the RL model undergoes ethical fine-tuning, where human feedback…

Computers and Society · Computer Science 2026-05-05 Rohit K. Dubey , Damian Dailisan , Sachit Mahajan

With the rise and widespread use of Large Language Models (LLMs), ensuring their safety is crucial to prevent harm to humans and promote ethical behaviors. However, directly assessing value valence (i.e., support or oppose) by leveraging…

Computers and Society · Computer Science 2025-04-10 Yuxi Sun , Wei Gao , Jing Ma , Hongzhan Lin , Ziyang Luo , Wenxuan Zhang

As Large Language Models (LLMs) become more prevalent, concerns about their safety, ethics, and potential biases have risen. Systematically evaluating LLMs' risk decision-making tendencies and attitudes, particularly in the ethical domain,…

Computers and Society · Computer Science 2025-05-09 Yifan Zeng , Liang Kairong , Fangzhou Dong , Peijia Zheng

Large language models are increasingly deployed to simulate patients for clinical training, research, and mental health tools, yet population-level validity remains largely untested. We introduce PsychBench, the first epidemiological audit…

Computers and Society · Computer Science 2026-04-21 Patrick Keough

With the profound development of large language models(LLMs), their safety concerns have garnered increasing attention. However, there is a scarcity of Chinese safety benchmarks for LLMs, and the existing safety taxonomies are inadequate,…

Computation and Language · Computer Science 2024-09-04 Wenjing Zhang , Xuejiao Lei , Zhaoxiang Liu , Meijuan An , Bikun Yang , KaiKai Zhao , Kai Wang , Shiguo Lian

Prompt design significantly impacts the moral competence and safety alignment of large language models (LLMs), yet empirical comparisons remain fragmented across datasets and models.We introduce ProMoral-Bench, a unified benchmark…

Artificial Intelligence · Computer Science 2026-02-17 Rohan Subramanian Thomas , Shikhar Shiromani , Abdullah Chaudhry , Ruizhe Li , Vasu Sharma , Kevin Zhu , Sunishchal Dev

Mental health has attracted substantial attention in recent years and LLM can be an effective technology for alleviating this problem owing to its capability in text understanding and dialogue. However, existing research in this domain…

Computation and Language · Computer Science 2024-12-09 Jinpeng Hu , Tengteng Dong , Luo Gang , Hui Ma , Peng Zou , Xiao Sun , Dan Guo , Xun Yang , Meng Wang