English
Related papers

Related papers: FrenchToxicityPrompts: a Large Benchmark for Evalu…

200 papers

Recent advances in large language models (LLMs) have led to their extensive global deployment, and ensuring their safety calls for comprehensive and multilingual toxicity evaluations. However, existing toxicity benchmarks are overwhelmingly…

Computation and Language · Computer Science 2024-08-13 Devansh Jain , Priyanshu Kumar , Samuel Gehman , Xuhui Zhou , Thomas Hartvigsen , Maarten Sap

Large language models (LLMs) and small language models (SLMs) are being adopted at remarkable speed, although their safety still remains a serious concern. With the advent of multilingual S/LLMs, the question now becomes a matter of scale:…

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Large Language Models (LLMs) are powerful text generators, yet they can produce toxic or harmful content even when given seemingly harmless prompts. This presents a serious safety challenge and can cause real-world harm. Toxicity is often…

Computation and Language · Computer Science 2026-02-09 Himanshu Singh , Ziwei Xu , A. V. Subramanyam , Mohan Kankanhalli

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

Computation and Language · Computer Science 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Detecting toxic content using language models is crucial yet challenging. While substantial progress has been made in English, toxicity detection in French remains underdeveloped, primarily due to the lack of culturally relevant,…

Computation and Language · Computer Science 2026-04-21 Axel Delaval , Shujian Yang , Haicheng Wang , Han Qiu , Jialiang Lu

In the pursuit of developing Large Language Models (LLMs) that adhere to societal standards, it is imperative to detect the toxicity in the generated text. The majority of existing toxicity metrics rely on encoder models trained on specific…

Computation and Language · Computer Science 2024-11-15 Hyukhun Koh , Dohyung Kim , Minwoo Lee , Kyomin Jung

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Computation and Language · Computer Science 2025-10-20 Zhiqiang Kou , Junyang Chen , Xin-Qiang Cai , Ming-Kun Xie , Biao Liu , Changwei Wang , Lei Feng , Yuheng Jia , Gang Niu , Masashi Sugiyama , Xin Geng

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

Computation and Language · Computer Science 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

In recent years, the advent of the attention mechanism has significantly advanced the field of natural language processing (NLP), revolutionizing text processing and text generation. This has come about through transformer-based…

Computation and Language · Computer Science 2026-01-13 Zhiyao Zhang , Yazan Mash'Al , Yuhan Wu

The widespread of generative artificial intelligence has heightened concerns about the potential harms posed by AI-generated texts, primarily stemming from factoid, unfair, and toxic content. Previous researchers have invested much effort…

Computation and Language · Computer Science 2024-12-24 Shiyao Cui , Zhenyu Zhang , Yilong Chen , Wenyuan Zhang , Tianyun Liu , Siqi Wang , Tingwen Liu

The last two years have seen a rapid growth in concerns around the safety of large language models (LLMs). Researchers and practitioners have met these concerns by creating an abundance of datasets for evaluating and improving LLM safety.…

Computation and Language · Computer Science 2025-01-13 Paul Röttger , Fabio Pernisi , Bertie Vidgen , Dirk Hovy

Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the risks posed by LLMs,…

Computation and Language · Computer Science 2024-08-06 Yuxia Wang , Zenan Zhai , Haonan Li , Xudong Han , Lizhi Lin , Zhenxuan Zhang , Jingru Zhao , Preslav Nakov , Timothy Baldwin

Language models (LMs) can reproduce (or amplify) toxic language seen during training, which poses a risk to their practical application. In this paper, we conduct extensive experiments to study this phenomenon. We analyze the impact of…

Computation and Language · Computer Science 2022-03-08 Canwen Xu , Zexue He , Zhankui He , Julian McAuley

We leverage generative large language models for language learning applications, focusing on estimating the difficulty of foreign language texts and simplifying them to lower difficulty levels. We frame both tasks as prediction problems and…

Computation and Language · Computer Science 2024-07-26 Henri Jamet , Yash Raj Shrestha , Michalis Vlachos

Moderating offensive, hateful, and toxic language has always been an important but challenging topic in the domain of safe use in NLP. The emerging large language models (LLMs), such as ChatGPT, can potentially further accentuate this…

Computers and Society · Computer Science 2023-11-28 Boyang Zhang , Xinyue Shen , Wai Man Si , Zeyang Sha , Zeyuan Chen , Ahmed Salem , Yun Shen , Michael Backes , Yang Zhang

Language is a deep-rooted means of perpetration of stereotypes and discrimination. Large Language Models (LLMs), now a pervasive technology in our everyday lives, can cause extensive harm when prone to generating toxic responses. The…

Software Engineering · Computer Science 2026-02-06 Simone Corbo , Luca Bancale , Valeria De Gennaro , Livia Lestingi , Vincenzo Scotti , Matteo Camilli

Large Language Models (LLMs) have become integral to Software Engineering (SE), increasingly used in development workflows. However, their widespread adoption raises concerns about the presence and propagation of toxic language - harmful or…

Machine Learning · Computer Science 2026-01-21 Hao Zhuo , Yicheng Yang , Kewen Peng

Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic,…

‹ Prev 1 2 3 10 Next ›