English
Related papers

Related papers: Real-Time Toxicity Filtering for Open-Source Code …

200 papers

Large Language Models (LLMs) can generate content spanning ideological rhetoric to explicit instructions for violence. However, existing safety evaluations often rely on simplistic binary labels (safe and unsafe), overlooking the nuanced…

Computation and Language · Computer Science 2025-06-03 Vadivel Abishethvarman , Bhavik Chandna , Pratik Jalan , Usman Naseem

Automated filtering of toxic conversations may help an Open-source software (OSS) community to maintain healthy interactions among the project participants. Although, several general purpose tools exist to identify toxic contents, those may…

Software Engineering · Computer Science 2020-09-22 Jaydeb Sarker , Asif Kamal Turzo , Amiangshu Bosu

Background: Despite the widespread use of automated security defect detection tools, software projects still contain many security defects that could result in serious damage. Such tools are largely context-insensitive and may not cover all…

Software Engineering · Computer Science 2023-07-06 Jiaxin Yu , Liming Fu , Peng Liang , Amjed Tahir , Mojtaba Shahin

Detecting which parts of a sentence contribute to that sentence's toxicity -- rather than providing a sentence-level verdict of hatefulness -- would increase the interpretability of models and allow human moderators to better understand the…

Computation and Language · Computer Science 2021-04-13 Alireza Salemi , Nazanin Sabri , Emad Kebriaei , Behnam Bahrak , Azadeh Shakery

Toxic content detection is crucial for online services to remove inappropriate content that violates community standards. To automate the detection process, prior works have proposed varieties of machine learning (ML) approaches to train…

Computation and Language · Computer Science 2023-12-14 Jiang Zhang , Qiong Wu , Yiming Xu , Cheng Cao , Zheng Du , Konstantinos Psounis

Code smells are symptoms of poor design quality. Since code review is a process that also aims at improving code quality, we investigate whether and how code review influences the severity of code smells. In this study, we analyze more than…

Software Engineering · Computer Science 2019-12-24 Luca Pascarella , Davide Spadini , Fabio Palomba , Alberto Bacchelli

Large Language Models (LLMs) are increasingly integrated into software systems for diverse purposes, due to their versatility, flexibility, and ability to simulate human reasoning to some extent. However, poor integration of LLM inference…

Software Engineering · Computer Science 2026-05-25 Zacharie Chenail-Larcher , Brahim Mahmoudi , Naouel Moha , Quentin Stiévenart , Florent Avellaneda

Toxicity detection has become core safety infrastructure for online moderation, dataset filtering, and deployed language-model systems. Yet most detectors still treat toxicity as an intrinsic property of isolated text. This position paper…

Machine Learning · Computer Science 2026-05-13 Sergei Berezin , Reza Farahbakhsh , Noel Crespi

Existing toxic detection models face significant limitations, such as lack of transparency, customization, and reproducibility. These challenges stem from the closed-source nature of their training data and the paucity of explanations for…

Computation and Language · Computer Science 2025-01-24 Tinh Son Luong , Thanh-Thien Le , Thang Viet Doan , Linh Ngo Van , Thien Huu Nguyen , Diep Thi-Ngoc Nguyen

Large Language Models (LLMs) have revolutionized code generation, achieving exceptional results on various established benchmarking frameworks. However, concerns about data contamination - where benchmark data inadvertently leaks into…

Hardware Architecture · Computer Science 2025-06-13 Zeng Wang , Minghao Shao , Jitendra Bhandari , Likhitha Mankali , Ramesh Karri , Ozgur Sinanoglu , Muhammad Shafique , Johann Knechtel

We present two novel unsupervised methods for eliminating toxicity in text. Our first method combines two recent ideas: (1) guidance of the generation process with small style-conditional language models and (2) use of paraphrasing models…

Computation and Language · Computer Science 2021-11-04 David Dale , Anton Voronov , Daryna Dementieva , Varvara Logacheva , Olga Kozlova , Nikita Semenov , Alexander Panchenko

Even with various regulations in place across countries and social media platforms (Government of India, 2021; European Parliament and Council of the European Union, 2022, digital abusive speech remains a significant issue. One potential…

Lack of moderation in online communities enables participants to incur in personal aggression, harassment or cyberbullying, issues that have been accentuated by extremist radicalisation in the contemporary post-truth politics scenario. This…

Computation and Language · Computer Science 2018-01-08 Nestor Rodriguez , Sergio Rojas-Galeano

Programming language detection is a common need in the analysis of large source code bases. It is supported by a number of existing tools that rely on several features, and most notably file extensions, to determine file types. We consider…

Software Engineering · Computer Science 2021-03-02 Francesca Del Bonifro , Maurizio Gabbrielli , Stefano Zacchiroli

Toxicity detection mitigates the dissemination of toxic content (e.g., hateful comments, posts, and messages within online social actions) to safeguard a healthy online social environment. However, malicious users persistently develop…

Computation and Language · Computer Science 2026-03-17 Hankun Kang , Xin Miao , Jianhao Chen , Jintao Wen , Mayi Xu , Weiyu Zhang , Wenpeng Lu , Tieyun Qian

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

Artificial Intelligence · Computer Science 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

Large language models (LLMs) have become integral to our professional workflows and daily lives. Nevertheless, these machine companions of ours have a critical flaw: the huge amount of data which endows them with vast and diverse knowledge,…

Computation and Language · Computer Science 2024-05-21 Tinh Son Luong , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

This paper describes our approach to the Toxic Spans Detection problem (SemEval-2021 Task 5). We propose BERToxic, a system that fine-tunes a pre-trained BERT model to locate toxic text spans in a given text and utilizes additional…

Computation and Language · Computer Science 2021-07-29 Yakoob Khan , Weicheng Ma , Soroush Vosoughi

The widespread adoption of code language models in software engineering tasks has exposed vulnerabilities to adversarial attacks, especially the identifier substitution attacks. Although existing identifier substitution attackers…

Software Engineering · Computer Science 2025-04-29 Wenhan Mu , Ling Xu , Shuren Pei , Le Mi , Huichi Zhou

In recent years, the application of large language models (LLMs) to code-related tasks has gained significant attention. However, existing evaluation benchmarks often focus on limited scenarios, such as code generation or completion, which…

Software Engineering · Computer Science 2024-09-17 Jia Feng , Jiachen Liu , Cuiyun Gao , Chun Yong Chong , Chaozheng Wang , Shan Gao , Xin Xia