English
Related papers

Related papers: Toxicity Inspector: A Framework to Evaluate Ground…

200 papers

Large language models (LLMs) are increasingly embedded into recommender systems, where they operate across multiple functional roles such as data augmentation, profiling, and decision making. While prior work emphasizes recommendation…

Human-Computer Interaction · Computer Science 2026-02-10 Donguk Park , Dongwon Lee , Yeon-Chang Lee

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment.…

Computation and Language · Computer Science 2024-03-05 Mohammad Dehghani

Existing studies have investigated the tendency of autoregressive language models to generate contexts that exhibit undesired biases and toxicity. Various debiasing approaches have been proposed, which are primarily categorized into…

Computation and Language · Computer Science 2022-05-03 Yoon A Park , Frank Rudzicz

Biased associations have been a challenge in the development of classifiers for detecting toxic language, hindering both fairness and accuracy. As potential solutions, we investigate recently introduced debiasing methods for text…

Computation and Language · Computer Science 2021-02-02 Xuhui Zhou , Maarten Sap , Swabha Swayamdipta , Noah A. Smith , Yejin Choi

Though generative dialogue modeling is widely seen as a language modeling task, the task demands an agent to have a complex natural language understanding of its input text to carry a meaningful interaction with an user. The automatic…

Computation and Language · Computer Science 2020-08-25 Prasanna Parthasarathi , Joelle Pineau , Sarath Chandar

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

Computation and Language · Computer Science 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

In an era of rapidly evolving internet technology, the surge in multimodal content, including videos, has expanded the horizons of online communication. However, the detection of toxic content in this diverse landscape, particularly in…

Artificial Intelligence · Computer Science 2024-07-16 Krishanu Maity , A. S. Poornash , Sriparna Saha , Pushpak Bhattacharyya

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

Computation and Language · Computer Science 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

Interpretability is a topic that has been in the spotlight for the past few years. Most existing interpretability techniques produce interpretations in the form of rules or feature importance. These interpretations, while informative, may…

Computation and Language · Computer Science 2024-10-15 Nikolaos Mylonas , Nikolaos Stylianou , Theodora Tsikrika , Stefanos Vrochidis , Ioannis Kompatsiaris

Recent advances in large language models (LLMs) have enabled molecular reasoning for property prediction. However, toxicity arises from complex biological mechanisms beyond chemical structure, necessitating mechanistic reasoning for…

Quantitative Methods · Quantitative Biology 2026-04-09 Jueon Park , Wonjune Jang , Chanhwi Kim , Yein Park , Jaewoo Kang

Toxic speech detection has become a crucial challenge in maintaining safe online communication environments. However, existing approaches to toxic speech detection often neglect the contribution of paralinguistic cues, such as emotion,…

Sound · Computer Science 2026-05-18 Zhongjie Ba , Liang Yi , Peng Cheng , Qingcao Li , Qinglong Wang , Li Lu

On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area.…

Computation and Language · Computer Science 2022-02-24 Alyssa Lees , Vinh Q. Tran , Yi Tay , Jeffrey Sorensen , Jai Gupta , Donald Metzler , Lucy Vasserman

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

Computation and Language · Computer Science 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

Artificial Intelligence · Computer Science 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

Computation and Language · Computer Science 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

Machine Translation systems can produce different types of errors, some of which are characterized as critical or catastrophic due to the specific negative impact that they can have on users. In this paper we focus on one type of critical…

Computation and Language · Computer Science 2023-04-07 Marta R. Costa-jussà , Eric Smith , Christophe Ropers , Daniel Licht , Jean Maillard , Javier Ferrando , Carlos Escolano

Recent NLP literature pays little attention to the robustness of toxicity language predictors, while these systems are most likely to be used in adversarial contexts. This paper presents a novel adversarial attack, \texttt{ToxicTrap},…

Computation and Language · Computer Science 2024-04-16 Dmitriy Bespalov , Sourav Bhabesh , Yi Xiang , Liutong Zhou , Yanjun Qi

The traditional mode of recording faults in heavy factory equipment has been via hand marked inspection sheets, wherein a machine engineer manually marks the faulty machine regions on a paper outline of the machine. Over the years, millions…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Rohit Rahul , Arindam Chowdhury , Animesh , Samarth Mittal , Lovekesh Vig

Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluation is that there is a clear divergence between existing…

Computation and Language · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Shining Liang , Daxin Jiang

Not all topics are equally "flammable" in terms of toxicity: a calm discussion of turtles or fishing less often fuels inappropriate toxic dialogues than a discussion of politics or sexual minorities. We define a set of sensitive topics that…

Computation and Language · Computer Science 2021-03-10 Nikolay Babakov , Varvara Logacheva , Olga Kozlova , Nikita Semenov , Alexander Panchenko