English
Related papers

Related papers: Do Large Language Models Reflect Demographic Plura…

200 papers

With the profound development of large language models(LLMs), their safety concerns have garnered increasing attention. However, there is a scarcity of Chinese safety benchmarks for LLMs, and the existing safety taxonomies are inadequate,…

Computation and Language · Computer Science 2024-09-04 Wenjing Zhang , Xuejiao Lei , Zhaoxiang Liu , Meijuan An , Bikun Yang , KaiKai Zhao , Kai Wang , Shiguo Lian

Safety evaluation of Large Language Models (LLMs) has largely focused on high-resource languages, leaving low-resource languages critically underserved. We present AlbanianLLMSafety, the first publicly available safety evaluation dataset…

Computation and Language · Computer Science 2026-05-29 Wajdi Zaghouani , Kholoud K. Aldous , Isra Fejzullaj

In this work, we designed unbiased prompts to systematically evaluate the psychological safety of large language models (LLMs). First, we tested five different LLMs by using two personality tests: Short Dark Triad (SD-3) and Big Five…

Computation and Language · Computer Science 2024-03-01 Xingxuan Li , Yutong Li , Lin Qiu , Shafiq Joty , Lidong Bing

With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and…

Computation and Language · Computer Science 2024-11-04 Xin Qiu , Risto Miikkulainen

As Large Language Models (LLMs) become more prevalent, concerns about their safety, ethics, and potential biases have risen. Systematically evaluating LLMs' risk decision-making tendencies and attitudes, particularly in the ethical domain,…

Computers and Society · Computer Science 2025-05-09 Yifan Zeng , Liang Kairong , Fangzhou Dong , Peijia Zheng

Large Language Models increasingly power critical infrastructure from healthcare to finance, yet their vulnerability to adversarial manipulation threatens system integrity and user safety. Despite growing deployment, no comprehensive…

Cryptography and Security · Computer Science 2026-03-19 Taiwo Onitiju , Iman Vakilinia

Large Language Models (LLMs) are increasingly vulnerable to a sophisticated form of adversarial prompting known as camouflaged jailbreaking. This method embeds malicious intent within seemingly benign language to evade existing safety…

Cryptography and Security · Computer Science 2025-09-09 Youjia Zheng , Mohammad Zandsalimy , Shanu Sushmita

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

Large Language Models (LLMs) are increasingly integrated into vehicle-based digital assistants, where unsafe, ambiguous, or legally incorrect responses can lead to serious safety, ethical, and regulatory consequences. Despite growing…

Artificial Intelligence · Computer Science 2026-03-25 Abhishek Kumar , Riya Tapwal , Carsten Maple

As AI systems become more integrated into daily life, the need for safer and more reliable moderation has never been greater. Large Language Models (LLMs) have demonstrated remarkable capabilities, surpassing earlier models in complexity…

Artificial Intelligence · Computer Science 2026-01-13 Naseem Machlovi , Maryam Saleki , Innocent Ababio , Ruhul Amin

Multi-modal Large Language Models (MLLMs) are increasingly deployed in interactive applications. However, their safety vulnerabilities become pronounced in multi-turn multi-modal scenarios, where harmful intent can be gradually…

Computation and Language · Computer Science 2026-01-09 Han Zhu , Jiale Chen , Chengkun Cai , Shengjie Sun , Haoran Li , Yujin Zhou , Chi-Min Chan , Pengcheng Wen , Lei Li , Sirui Han , Yike Guo

Large Language Models (LLMs) demonstrate complex responses to threat-based manipulations, revealing both vulnerabilities and unexpected performance enhancement opportunities. This study presents a comprehensive analysis of 3,390…

Cryptography and Security · Computer Science 2025-07-30 Atil Samancioglu

Large language models (LLMs) are often assumed to contain ``safety regions'' -- parameter subsets whose modification directly influences safety behaviors. We conduct a systematic evaluation of four safety region identification methods…

Machine Learning · Computer Science 2026-02-23 Zongmin Li , Jian Su , Farah Benamara , Aixin Sun

Large language models (LLMs) are being integrated into socially assistive robots (SARs) and other conversational agents providing mental health and well-being support. These agents are often designed to sound empathic and supportive in…

Human-Computer Interaction · Computer Science 2026-02-05 Himanshi Lalwani , Hanan Salam

Generative large language models (LLMs) have been shown to exhibit harmful biases and stereotypes. While safety fine-tuning typically takes place in English, if at all, these models are being used by speakers of many different languages.…

Computation and Language · Computer Science 2024-07-18 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

The overarching research direction of this work is the development of a ''Responsible Intelligence'' framework designed to reconcile the immense generative power of Large Language Models (LLMs) with the stringent requirements of real-world…

Computation and Language · Computer Science 2026-02-17 Somnath Banerjee

The rapid advancement of Large Language Models (LLMs) has intensified the need for robust dialogue system evaluation, yet comprehensive assessment remains challenging. Traditional metrics often prove insufficient, and safety considerations…

Computation and Language · Computer Science 2025-09-18 John Mendonça , Lining Zhang , Rahul Mallidi , Alon Lavie , Isabel Trancoso , Luis Fernando D'Haro , João Sedoc

Large language models (LLMs) have achieved impressive performance, leading to their widespread adoption as decision-support tools in resource-constrained contexts like hiring and admissions. There is, however, scientific consensus that AI…

Large Language Models (LLMs) excel in various natural language processing tasks but remain vulnerable to generating harmful content or being exploited for malicious purposes. Although safety alignment datasets have been introduced to…

Computation and Language · Computer Science 2026-04-20 Xiaorui Wu , Xiaofeng Mao , Fei Li , Xin Zhang , Xuanhong Li , Chong Teng , Donghong Ji , Zhuang Li

While the safety risks of image-based large language models (Image LLMs) have been extensively studied, their video-based counterparts (Video LLMs) remain critically under-examined. To systematically study this problem, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yiwei Sun , Peiqi Jiang , Chuanbin Liu , Luohao Lin , Zhiying Lu , Hongtao Xie