English
Related papers

Related papers: ToxiShield: Promoting Inclusive Developer Communic…

200 papers

The proliferation of harmful online content--e.g., toxicity, spam, and negative sentiment--demands robust and adaptable moderation systems. However, prevailing moderation systems are centralized and task-specific, offering limited…

Computation and Language · Computer Science 2025-11-11 Rufan Zhang , Lin Zhang , Xianghang Mi

State-of-the-art large language models (LLMs) have demonstrated impressive code generation capabilities but struggle with real-world software engineering tasks, such as revising source code to address code reviews, hindering their practical…

Software Engineering · Computer Science 2025-06-03 Hong Yi Lin , Chunhua Liu , Haoyu Gao , Patanamon Thongtanunam , Christoph Treude

As Large Language Models (LLMs) achieve remarkable success across a wide range of applications, such as chatbots and code copilots, concerns surrounding the generation of harmful content have come increasingly into focus. Despite…

Computation and Language · Computer Science 2025-09-30 Wenjie Fu , Huandong Wang , Junyao Gao , Guoan Wan , Tao Jiang

The Contrastive Language-Image Pretraining (CLIP) model has significantly advanced vision-language modeling by aligning image-text pairs from large-scale web data through self-supervised contrastive learning. Yet, its reliance on uncurated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xin Yao , Haiyang Zhao , Yimin Chen , Jiawei Guo , Kecheng Huang , Ming Zhao

Detecting toxicity in online spaces is challenging and an ever more pressing problem given the increase in social media and gaming consumption. We introduce ToxBuster, a simple and scalable model trained on a relatively large dataset of…

Computation and Language · Computer Science 2023-05-24 Zachary Yang , Yasmine Maricar , MohammadReza Davari , Nicolas Grenon-Godbout , Reihaneh Rabbany

Large Language Models (LLMs) can generate code but often introduce security vulnerabilities, logical inconsistencies, and compilation errors. Prior work demonstrates that LLMs benefit substantially from structured feedback, static analysis,…

Cryptography and Security · Computer Science 2026-01-05 Vidyut Sriram , Sawan Pandita , Achintya Lakshmanan , Aneesh Shamraj , Suman Saha

Detecting hateful content is a challenging and important problem. Automated tools, like machine-learning models, can help, but they require continuous training to adapt to the ever-changing landscape of social media. In this work, we…

Computation and Language · Computer Science 2025-11-06 Jay Patel , Hrudayangam Mehta , Jeremy Blackburn

We present REMARK-LLM, a novel efficient, and robust watermarking framework designed for texts generated by large language models (LLMs). Synthesizing human-like content using LLMs necessitates vast computational resources and extensive…

Cryptography and Security · Computer Science 2024-04-09 Ruisi Zhang , Shehzeen Samarah Hussain , Paarth Neekhara , Farinaz Koushanfar

Existing approaches for Large language model (LLM) detoxification generally rely on training on large-scale non-toxic or human-annotated preference data, designing prompts to instruct the LLM to generate safe content, or modifying the model…

Computation and Language · Computer Science 2025-06-03 Yuanhe Tian , Mingjie Deng , Guoqing Jin , Yan Song

Recommender systems (RS) are widely used in e-commerce for personalized suggestions, yet their openness makes them susceptible to shilling attacks, where adversaries inject fake behaviors to manipulate recommendations. Most existing…

Computation and Language · Computer Science 2025-09-30 Kaihong Li , Huichi Zhou , Bin Ma , Fangjun Huang

The increment of toxic comments on online space is causing tremendous effects on other vulnerable users. For this reason, considerable efforts are made to deal with this, and SemEval-2021 Task 5: Toxic Spans Detection is one of those. This…

Computation and Language · Computer Science 2021-04-16 Phu Gia Hoang , Luan Thanh Nguyen , Kiet Van Nguyen

This paper describes our system for SemEval-2021 Task 5 on Toxic Spans Detection. We developed ensemble models using BERT-based neural architectures and post-processing to combine tokens into spans. We evaluated several pre-trained language…

Computation and Language · Computer Science 2021-08-30 Mikhail Kotyushev , Anna Glazkova , Dmitry Morozov

Although there have been automated approaches and tools supporting toxicity censorship for social posts, most of them focus on detection. Toxicity censorship is a complex process, wherein detection is just an initial task and a user can…

Human-Computer Interaction · Computer Science 2025-05-23 Yaqiong Li , Peng Zhang , Hansu Gu , Tun Lu , Siyuan Qiao , Yubo Shu , Yiyang Shao , Ning Gu

To date, toxicity mitigation in language models has almost entirely been focused on single-language settings. As language models embrace multilingual capabilities, it's crucial our safety measures keep pace. Recognizing this research gap,…

Computation and Language · Computer Science 2024-05-31 Luiza Pozzobon , Patrick Lewis , Sara Hooker , Beyza Ermis

This study introduces a prescriptive annotation benchmark grounded in humanities research to ensure consistent, unbiased labeling of offensive language, particularly for casual and non-mainstream language uses. We contribute two newly…

Computation and Language · Computer Science 2024-10-18 Xinmeng Hou

JavaScript's widespread adoption has made it an attractive target for malicious attackers who employ sophisticated obfuscation techniques to conceal harmful code. Current deobfuscation tools suffer from critical limitations that severely…

Cryptography and Security · Computer Science 2025-12-17 Dongchao Zhou , Lingyun Ying , Huajun Chai , Dongbin Wang

Security of software supply chains is necessary to ensure that software updates do not contain maliciously injected code or introduce vulnerabilities that may compromise the integrity of critical infrastructure. Verifying the integrity of…

Automating the decision of whether a code change requires manual review is vital for maintaining software quality in modern development workflows. However, the emergence of new programming languages and frameworks creates a critical…

Software Engineering · Computer Science 2025-09-08 Yogev Cohen , Dudi Ohayon , Romy Somkin , Yehudit Aperstein , Alexander Apartsin

Various robustness evaluation methodologies from different perspectives have been proposed for different natural language processing (NLP) tasks. These methods have often focused on either universal or task-specific generalization…

Large language models (LLMs) have emerged as a new paradigm for Text-to-SQL task. However, the absence of a systematical benchmark inhibits the development of designing effective, efficient and economic LLM-based Text-to-SQL solutions. To…

Databases · Computer Science 2023-11-21 Dawei Gao , Haibin Wang , Yaliang Li , Xiuyu Sun , Yichen Qian , Bolin Ding , Jingren Zhou