English
Related papers

Related papers: Real-Time Toxicity Filtering for Open-Source Code …

200 papers

Large Language Models (LLMs) demonstrate strong capabilities in general coding tasks but encounter two key challenges when optimizing code: (i) the complexity of writing optimized code (such as performant CUDA kernels and competition-level…

Machine Learning · Computer Science 2026-01-12 Jiefu Ou , Sapana Chaudhary , Kaj Bostrom , Nathaniel Weir , Shuai Zhang , Huzefa Rangwala , George Karypis

Toxic comment classification has become an active research field with many recently proposed approaches. However, while these approaches address some of the task's challenges others still remain unsolved and directions for further research…

Computation and Language · Computer Science 2018-09-21 Betty van Aken , Julian Risch , Ralf Krestel , Alexander Löser

Now-a-days, derogatory comments are often made by one another, not only in offline environment but also immensely in online environments like social networking websites and online communities. So, an Identification combined with Prevention…

Computation and Language · Computer Science 2019-03-19 Navoneel Chakrabarty

Toxicity detection is crucial for maintaining the peace of the society. While existing methods perform well on normal toxic contents or those generated by specific perturbation methods, they are vulnerable to evolving perturbation patterns.…

Cryptography and Security · Computer Science 2025-03-05 Hankun Kang , Jianhao Chen , Yongqi Li , Xin Miao , Mayi Xu , Ming Zhong , Yuanyuan Zhu , Tieyun Qian

Large language models frequently generate toxic, hateful, or harmful content, yet existing mitigation methods rely on costly retraining or output-level filtering with no mechanistic insight into where toxicity originates internally. We…

Computation and Language · Computer Science 2026-05-28 Himanshu Beniwal , Mayank Singh

To foster collaboration and inclusivity in Open Source Software (OSS) projects, it is crucial to understand and detect patterns of toxic language that may drive contributors away, especially those from underrepresented communities. Although…

Software Engineering · Computer Science 2023-07-31 Ramtin Ehsani , Rezvaneh Rezapour , Preetha Chatterjee

Large language models can produce toxic or inappropriate text even for benign inputs, creating risks when deployed at scale. Detoxification is therefore important for safety and user trust, particularly when we want to reduce harmful…

Computation and Language · Computer Science 2026-02-04 Baturay Saglam , Dionysis Kalogerias

The spread of toxic content online is an important problem that has adverse effects on user experience online and in our society at large. Motivated by the importance and impact of the problem, research focuses on developing solutions to…

Computation and Language · Computer Science 2023-08-11 Xinlei He , Savvas Zannettou , Yun Shen , Yang Zhang

Toxicity is pervasive in social media and poses a major threat to the health of online communities. The recent introduction of pre-trained language models, which have achieved state-of-the-art results in many NLP tasks, has transformed the…

Computation and Language · Computer Science 2021-10-11 Erik Yan , Harish Tayyar Madabushi

Large Language Models (LLMs) applied to code-related applications have emerged as a prominent field, attracting significant interest from both academia and industry. However, as new and improved LLMs are developed, existing evaluation…

Software Engineering · Computer Science 2024-06-07 Naman Jain , King Han , Alex Gu , Wen-Ding Li , Fanjia Yan , Tianjun Zhang , Sida Wang , Armando Solar-Lezama , Koushik Sen , Ion Stoica

Recent NLP literature pays little attention to the robustness of toxicity language predictors, while these systems are most likely to be used in adversarial contexts. This paper presents a novel adversarial attack, \texttt{ToxicTrap},…

Computation and Language · Computer Science 2024-04-16 Dmitriy Bespalov , Sourav Bhabesh , Yi Xiang , Liutong Zhou , Yanjun Qi

This paper describes our system for SemEval-2021 Task 5 on Toxic Spans Detection. We developed ensemble models using BERT-based neural architectures and post-processing to combine tokens into spans. We evaluated several pre-trained language…

Computation and Language · Computer Science 2021-08-30 Mikhail Kotyushev , Anna Glazkova , Dmitry Morozov

Toxicity classification in textual content remains a significant problem. Data with labels from a single annotator fall short of capturing the diversity of human perspectives. Therefore, there is a growing need to incorporate crowdsourced…

Artificial Intelligence · Computer Science 2024-11-11 Zelei Cheng , Xian Wu , Jiahao Yu , Shuo Han , Xin-Qiang Cai , Xinyu Xing

The rapid deployment of Large Language Models (LLMs) requires careful consideration of their effect on cybersecurity. Our work aims to improve the selection process of LLMs that are suitable for facilitating Secure Coding (SC). This raises…

Cryptography and Security · Computer Science 2024-08-30 Anton Rydén , Erik Näslund , Elad Michael Schiller , Magnus Almgren

The rise of hate speech on online platforms has led to an urgent need for effective content moderation. However, the subjective and multi-faceted nature of hateful online content, including implicit hate speech, poses significant challenges…

Computation and Language · Computer Science 2023-03-17 Uma Gunturi , Xiaohan Ding , Eugenia H. Rho

Online media aim for reaching ever bigger audience and for attracting ever longer attention span. This competition creates an environment that rewards sensational, fake, and toxic news. To help limit their spread and impact, we propose and…

Computation and Language · Computer Science 2019-08-27 Yoan Dinkov , Ivan Koychev , Preslav Nakov

The presence of toxic and gender-identity derogatory language in open-source software (OSS) communities has recently become a focal point for researchers. Such comments not only lead to frustration and disengagement among developers but may…

Software Engineering · Computer Science 2024-03-18 Sayma Sultana , Gias Uddin , Amiangshu Bosu

Augmenting toxic language data in a controllable and class-specific manner is crucial for improving robustness in toxicity classification, yet remains challenging due to limited supervision and distributional skew. We propose ToxiGAN, a…

Computation and Language · Computer Science 2026-01-07 Peiran Li , Jan Fillies , Adrian Paschke

Toxic language includes content that is offensive, abusive, or that promotes harm. Progress in preventing toxic output from large language models (LLMs) is hampered by inconsistent definitions of toxicity. We introduce TRuST, a large-scale…

Computation and Language · Computer Science 2026-01-07 Berk Atil , Namrata Sureddy , Rebecca J. Passonneau

This paper describes our system for the EEUCA 2026 Shared Task on Understanding Toxic Behavior in Gaming Communities. The task involves classifying World of Tanks chat messages into six toxicity categories: Non-toxic, Insults/Flaming, Other…

Computation and Language · Computer Science 2026-05-11 Srikar Kashyap Pulipaka
‹ Prev 1 3 4 5 6 7 10 Next ›