English
Related papers

Related papers: Safety Evaluation of DeepSeek Models in Chinese Co…

200 papers

Explainable AI (XAI) has gained significant attention for providing insights into the decision-making processes of deep learning models, particularly for image classification tasks through visual explanations visualized by saliency maps.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifei Zhang , James Song , Siyi Gu , Tianxu Jiang , Bo Pan , Guangji Bai , Liang Zhao

Understanding what constitutes safe text is an important issue in natural language processing and can often prevent the deployment of models deemed harmful and unsafe. One such type of safety that has been scarcely studied is commonsense…

Computation and Language · Computer Science 2022-10-19 Sharon Levy , Emily Allaway , Melanie Subbiah , Lydia Chilton , Desmond Patton , Kathleen McKeown , William Yang Wang

As AI models scale to billions of parameters and operate with increasing autonomy, ensuring their safe, reliable operation demands engineering-grade security and assurance frameworks. This paper presents an enterprise-level, risk-aware,…

Cryptography and Security · Computer Science 2025-05-13 Krti Tallam

Large Reasoning Models (LRMs) have significantly improved problem-solving through explicit Chain-of-Thought (CoT) reasoning. However, this capability creates a Safety-Helpfulness Paradox: the reasoning process itself can be misused to…

Artificial Intelligence · Computer Science 2026-01-27 Xin Gao , Shaohan Yu , Zerui Chen , Yueming Lyu , Weichen Yu , Guanghao Li , Jiyao Liu , Jianxiong Gao , Jian Liang , Ziwei Liu , Chenyang Si

The validity of AI safety evaluations depends on models behaving consistently across controlled and deployment settings. Prior work has identified test-time contextual cues, such as hypothetical scenarios, as a source of verbalized…

Computation and Language · Computer Science 2026-05-28 Katharina Deckenbach , Haritz Puerto , Jonas Geiping , Sahar Abdelnabi

Suicide is a pressing global issue, demanding urgent and effective preventive interventions. Among the various strategies in place, psychological support hotlines had proved as a potent intervention method. Approximately two million people…

Computation and Language · Computer Science 2024-09-11 Yining Chen , Jianqiang Li , Changwei Song , Qing Zhao , Yongsheng Tong , Guanghui Fu

The creation of benchmarks to evaluate the safety of Large Language Models is one of the key activities within the trusted AI community. These benchmarks allow models to be compared for different aspects of safety such as toxicity, bias,…

Artificial Intelligence · Computer Science 2025-06-23 Lina Berrayana , Sean Rooney , Luis Garcés-Erice , Ioana Giurgiu

Culture is a core component of human-to-human interaction and plays a vital role in how we perceive and interact with others. Advancements in the effectiveness of Large Language Models (LLMs) in generating human-sounding text have greatly…

Computation and Language · Computer Science 2025-12-15 James Luther , Donald Brown

Evaluating the safety alignment of LLM responses in high-risk mental health dialogues is particularly difficult due to missing gold-standard answers and the ethically sensitive nature of these interactions. To address this challenge, we…

Computation and Language · Computer Science 2026-02-16 Yunna Cai , Fan Wang , Haowei Wang , Kun Wang , Kailai Yang , Sophia Ananiadou , Moyan Li , Mingming Fan

As artificial intelligence (AI) systems are increasingly deployed across critical domains, their security vulnerabilities pose growing risks of high-profile exploits and consequential system failures. Yet systematic approaches to evaluating…

Cryptography and Security · Computer Science 2026-04-28 Mikko Lempinen , Joni Kemppainen , Niklas Raesalmi

Thanks to advancements in deep learning, speech generation systems now power a variety of real-world applications, such as text-to-speech for individuals with speech disorders, voice chatbots in call centers, cross-linguistic speech…

Early suicide risk detection in adolescents is critical yet hindered by scalability challenges of current assessments. This paper presents our approach to the first SpeechWellness Challenge (SW1), which aims to assess suicide risk in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Filomene Roquefort , Alexandre Ducorroy , Rachid Riad

The widespread adoption of microservice architectures has given rise to a new set of software security challenges. These challenges stem from the unique features inherent in microservices. It is important to systematically assess and…

Software Engineering · Computer Science 2024-03-25 Majid Abdulsatar , Hussain Ahmad , Diksha Goel , Faheem Ullah

The widespread application of Deep Learning across diverse domains hinges critically on the quality and composition of training datasets. However, the common lack of disclosure regarding their usage raises significant privacy and copyright…

Cryptography and Security · Computer Science 2025-12-16 Shuo Shao , Yiming Li , Mengren Zheng , Zhiyang Hu , Yukun Chen , Boheng Li , Yu He , Junfeng Guo , Dacheng Tao , Zhan Qin

Large language models are typically trained on vast amounts of data during the pre-training phase, which may include some potentially harmful information. Fine-tuning attacks can exploit this by prompting the model to reveal such…

Cryptography and Security · Computer Science 2025-02-04 Zhiyuan Xu , Joseph Gardiner , Sana Belguith

While various multimodal multi-image evaluation datasets have been emerged, but these datasets are primarily based on English, and there has yet to be a Chinese multi-image dataset. To fill this gap, we introduce RealBench, the first…

Computation and Language · Computer Science 2025-09-23 Fei Zhao , Chengqiang Lu , Yufan Shen , Qimeng Wang , Yicheng Qian , Haoxin Zhang , Yan Gao , Yi Wu , Yao Hu , Zhen Wu , Shangyu Xing , Xinyu Dai

Despite the remarkable advances of Large Language Models (LLMs) across diverse cognitive tasks, the rapid enhancement of these capabilities also introduces emergent deceptive behaviors that may induce severe risks in high-stakes…

Computation and Language · Computer Science 2025-11-18 Yao Huang , Yitong Sun , Yichi Zhang , Ruochen Zhang , Yinpeng Dong , Xingxing Wei

Chinese Spelling Check (CSC) aims to detect and correct error tokens in Chinese contexts, which has a wide range of applications. However, it is confronted with the challenges of insufficient annotated data and the issue that previous…

Computation and Language · Computer Science 2024-02-27 Xunjian Yin , Xinyu Hu , Jin Jiang , Xiaojun Wan

Deep neural networks have become widely used, obtaining remarkable results in domains such as computer vision, speech recognition, natural language processing, audio recognition, social network filtering, machine translation, and…

Neural and Evolutionary Computing · Computer Science 2020-02-03 Divya Gopinath , Guy Katz , Corina S. Pasareanu , Clark Barrett

The widespread adoption of large language models (LLMs) across various regions underscores the urgent need to evaluate their alignment with human values. Current benchmarks, however, fall short of effectively uncovering safety…

Computation and Language · Computer Science 2024-05-31 Kexin Huang , Xiangyang Liu , Qianyu Guo , Tianxiang Sun , Jiawei Sun , Yaru Wang , Zeyang Zhou , Yixu Wang , Yan Teng , Xipeng Qiu , Yingchun Wang , Dahua Lin