English
Related papers

Related papers: How Toxic Can You Get? Search-based Toxicity Testi…

200 papers

In the pursuit of developing Large Language Models (LLMs) that adhere to societal standards, it is imperative to detect the toxicity in the generated text. The majority of existing toxicity metrics rely on encoder models trained on specific…

Computation and Language · Computer Science 2024-11-15 Hyukhun Koh , Dohyung Kim , Minwoo Lee , Kyomin Jung

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Large Language Models (LLMs) have become integral to Software Engineering (SE), increasingly used in development workflows. However, their widespread adoption raises concerns about the presence and propagation of toxic language - harmful or…

Machine Learning · Computer Science 2026-01-21 Hao Zhuo , Yicheng Yang , Kewen Peng

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Computation and Language · Computer Science 2025-10-20 Zhiqiang Kou , Junyang Chen , Xin-Qiang Cai , Ming-Kun Xie , Biao Liu , Changwei Wang , Lei Feng , Yuheng Jia , Gang Niu , Masashi Sugiyama , Xin Geng

Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale:…

The open-endedness of large language models (LLMs) combined with their impressive capabilities may lead to new safety issues when being exploited for malicious use. While recent studies primarily focus on probing toxic outputs that can be…

Computation and Language · Computer Science 2023-11-30 Jiaxin Wen , Pei Ke , Hao Sun , Zhexin Zhang , Chengfei Li , Jinfeng Bai , Minlie Huang

Drug toxicity remains a major challenge in pharmaceutical development. Recent machine learning models have improved in silico toxicity prediction, but their reliance on annotated data and lack of interpretability limit their applicability.…

Machine Learning · Computer Science 2025-11-06 Jueon Park , Yein Park , Minju Song , Soyon Park , Donghyeon Lee , Seungheun Baek , Jaewoo Kang

Large Language Models (LLMs) and Vision Language Models (VLMs) have recently shown promising capabilities in various scientific domain. In particular, these advances have opened new opportunities in drug discovery, where the ability to…

Artificial Intelligence · Computer Science 2026-05-13 Jueon Park , Wonjune Jang , Jiwoo Lee , Yein Park , Jaewoo Kang

Despite the substantial advancements in artificial intelligence, large language models (LLMs) remain being challenged by generation safety. With adversarial jailbreaking prompts, one can effortlessly induce LLMs to output harmful content,…

Computation and Language · Computer Science 2025-02-18 Yuhao Du , Zhuo Li , Pengyu Cheng , Xiang Wan , Anningzhe Gao

Large language models (LLMs) have demonstrated remarkable capabilities in natural language processing tasks. However, their practical application in high-stake domains, such as fraud and abuse detection, remains an area that requires…

Computation and Language · Computer Science 2024-09-11 Joymallya Chakraborty , Wei Xia , Anirban Majumder , Dan Ma , Walid Chaabene , Naveed Janvekar

Large Language Models (LLMs) are powerful text generators, yet they can produce toxic or harmful content even when given seemingly harmless prompts. This presents a serious safety challenge and can cause real-world harm. Toxicity is often…

Computation and Language · Computer Science 2026-02-09 Himanshu Singh , Ziwei Xu , A. V. Subramanyam , Mohan Kankanhalli

Large language models (LLMs) are increasingly popular but are also prone to generating bias, toxic or harmful language, which can have detrimental effects on individuals and communities. Although most efforts is put to assess and mitigate…

Computation and Language · Computer Science 2024-06-26 Caroline Brun , Vassilina Nikoulina

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

Computation and Language · Computer Science 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Caution: this paper may include material that could be offensive or distressing. The advent of Large Language Models (LLMs) necessitates the development of training approaches that mitigate the generation of unethical language and aptly…

Computation and Language · Computer Science 2023-12-01 Sungjoo Byun , Dongjun Jang , Hyemi Jo , Hyopil Shin

Large language models (LLMs) frequently generate toxic content, posing significant risks for safe deployment. Current mitigation strategies often degrade generation quality or require costly human annotation. We propose CAUSALDETOX, a…

Computation and Language · Computer Science 2026-04-17 Yian Wang , Yuen Chen , Agam Goyal , Hari Sundaram

Large Language Models (LLMs) have demonstrated great capabilities in natural language understanding and generation, largely attributed to the intricate alignment process using human feedback. While alignment has become an essential training…

Computation and Language · Computer Science 2024-09-04 Bocheng Chen , Hanqing Guo , Guangjing Wang , Yuanda Wang , Qiben Yan

Recent advances in large language models (LLMs) have led to their extensive global deployment, and ensuring their safety calls for comprehensive and multilingual toxicity evaluations. However, existing toxicity benchmarks are overwhelmingly…

Computation and Language · Computer Science 2024-08-13 Devansh Jain , Priyanshu Kumar , Samuel Gehman , Xuhui Zhou , Thomas Hartvigsen , Maarten Sap

Large Language Models remain vulnerable to adversarial prompts that elicit toxic content even after safety alignment. We present ToxSearch, a black-box evolutionary framework that tests model safety by evolving prompts in a synchronous…

Neural and Evolutionary Computing · Computer Science 2026-01-27 Onkar Shelar , Travis Desell

We introduce aligned probing, a novel interpretability framework that aligns the behavior of language models (LMs), based on their outputs, and their internal representations (internals). Using this framework, we examine over 20 OLMo,…

Computation and Language · Computer Science 2025-09-25 Andreas Waldis , Vagrant Gautam , Anne Lauscher , Dietrich Klakow , Iryna Gurevych
‹ Prev 1 2 3 10 Next ›