中文
相关论文

相关论文: Toxicity Inspector: A Framework to Evaluate Ground…

200 篇论文

Large language models (LLMs) are increasingly embedded into recommender systems, where they operate across multiple functional roles such as data augmentation, profiling, and decision making. While prior work emphasizes recommendation…

人机交互 · 计算机科学 2026-02-10 Donguk Park , Dongwon Lee , Yeon-Chang Lee

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment.…

计算与语言 · 计算机科学 2024-03-05 Mohammad Dehghani

Existing studies have investigated the tendency of autoregressive language models to generate contexts that exhibit undesired biases and toxicity. Various debiasing approaches have been proposed, which are primarily categorized into…

计算与语言 · 计算机科学 2022-05-03 Yoon A Park , Frank Rudzicz

Biased associations have been a challenge in the development of classifiers for detecting toxic language, hindering both fairness and accuracy. As potential solutions, we investigate recently introduced debiasing methods for text…

计算与语言 · 计算机科学 2021-02-02 Xuhui Zhou , Maarten Sap , Swabha Swayamdipta , Noah A. Smith , Yejin Choi

Though generative dialogue modeling is widely seen as a language modeling task, the task demands an agent to have a complex natural language understanding of its input text to carry a meaningful interaction with an user. The automatic…

计算与语言 · 计算机科学 2020-08-25 Prasanna Parthasarathi , Joelle Pineau , Sarath Chandar

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

计算与语言 · 计算机科学 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

In an era of rapidly evolving internet technology, the surge in multimodal content, including videos, has expanded the horizons of online communication. However, the detection of toxic content in this diverse landscape, particularly in…

人工智能 · 计算机科学 2024-07-16 Krishanu Maity , A. S. Poornash , Sriparna Saha , Pushpak Bhattacharyya

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

计算与语言 · 计算机科学 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

Interpretability is a topic that has been in the spotlight for the past few years. Most existing interpretability techniques produce interpretations in the form of rules or feature importance. These interpretations, while informative, may…

计算与语言 · 计算机科学 2024-10-15 Nikolaos Mylonas , Nikolaos Stylianou , Theodora Tsikrika , Stefanos Vrochidis , Ioannis Kompatsiaris

Recent advances in large language models (LLMs) have enabled molecular reasoning for property prediction. However, toxicity arises from complex biological mechanisms beyond chemical structure, necessitating mechanistic reasoning for…

定量方法 · 定量生物学 2026-04-09 Jueon Park , Wonjune Jang , Chanhwi Kim , Yein Park , Jaewoo Kang

Toxic speech detection has become a crucial challenge in maintaining safe online communication environments. However, existing approaches to toxic speech detection often neglect the contribution of paralinguistic cues, such as emotion,…

声音 · 计算机科学 2026-05-18 Zhongjie Ba , Liang Yi , Peng Cheng , Qingcao Li , Qinglong Wang , Li Lu

On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area.…

计算与语言 · 计算机科学 2022-02-24 Alyssa Lees , Vinh Q. Tran , Yi Tay , Jeffrey Sorensen , Jai Gupta , Donald Metzler , Lucy Vasserman

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

计算与语言 · 计算机科学 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

人工智能 · 计算机科学 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

Transformer-based language models are able to generate fluent text and be efficiently adapted across various natural language generation tasks. However, language models that are pretrained on large unlabeled web text corpora have been shown…

计算与语言 · 计算机科学 2022-07-28 Farshid Faal , Ketra Schmitt , Jia Yuan Yu

Machine Translation systems can produce different types of errors, some of which are characterized as critical or catastrophic due to the specific negative impact that they can have on users. In this paper we focus on one type of critical…

Recent NLP literature pays little attention to the robustness of toxicity language predictors, while these systems are most likely to be used in adversarial contexts. This paper presents a novel adversarial attack, \texttt{ToxicTrap},…

计算与语言 · 计算机科学 2024-04-16 Dmitriy Bespalov , Sourav Bhabesh , Yi Xiang , Liutong Zhou , Yanjun Qi

The traditional mode of recording faults in heavy factory equipment has been via hand marked inspection sheets, wherein a machine engineer manually marks the faulty machine regions on a paper outline of the machine. Over the years, millions…

计算机视觉与模式识别 · 计算机科学 2018-12-19 Rohit Rahul , Arindam Chowdhury , Animesh , Samarth Mittal , Lovekesh Vig

Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluation is that there is a clear divergence between existing…

计算与语言 · 计算机科学 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Shining Liang , Daxin Jiang

Not all topics are equally "flammable" in terms of toxicity: a calm discussion of turtles or fishing less often fuels inappropriate toxic dialogues than a discussion of politics or sexual minorities. We define a set of sensitive topics that…

计算与语言 · 计算机科学 2021-03-10 Nikolay Babakov , Varvara Logacheva , Olga Kozlova , Nikita Semenov , Alexander Panchenko