English
Related papers

Related papers: ContiGuard: A Framework for Continual Toxicity Det…

200 papers

With the exponential rise in user-generated web content on social media, the proliferation of abusive languages towards an individual or a group across the different sections of the internet is also rapidly increasing. It is very…

Computation and Language · Computer Science 2021-03-24 Prashant Kapil , Asif Ekbal

What should a malicious user write next to fool a detection model? Identifying malicious users is critical to ensure the safety and integrity of internet platforms. Several deep learning-based detection models have been created. However,…

Machine Learning · Computer Science 2021-10-20 Bing He , Mustaque Ahamad , Srijan Kumar

WARNING: This paper contains examples of offensive materials. To address the proliferation of toxic content on social media, we introduce SMARTER, we introduce SMARTER, a data-efficient two-stage framework for explainable content moderation…

Computation and Language · Computer Science 2026-04-23 Huy Nghiem , Advik Sachdeva , Hal Daumé

Social network platforms are generally used to share positive, constructive, and insightful content. However, in recent times, people often get exposed to objectionable content like threat, identity attacks, hate speech, insults, obscene…

Computation and Language · Computer Science 2021-05-31 Sreyan Ghosh , Sonal Kumar

Recent advances in open-vocabulary object detection focus primarily on two aspects: scaling up datasets and leveraging contrastive learning to align language and vision modalities. However, these approaches often neglect internal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Bozhao Li , Shaocong Wu , Tong Shao , Senqiao Yang , Qiben Shan , Zhuotao Tian , Jingyong Su

Lack of moderation in online communities enables participants to incur in personal aggression, harassment or cyberbullying, issues that have been accentuated by extremist radicalisation in the contemporary post-truth politics scenario. This…

Computation and Language · Computer Science 2018-01-08 Nestor Rodriguez , Sergio Rojas-Galeano

Diffusion-based image generation models have advanced rapidly but pose a safety risk due to their potential to generate Not-Safe-For-Work (NSFW) content. Existing NSFW detection methods mainly operate either before or after image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jinghan Yang , Yihe Fan , Xudong Pan , Min Yang

With the increasing growth of social media, people have started relying heavily on the information shared therein to form opinions and make decisions. While such a reliance is motivation for a variety of parties to promote information, it…

Computation and Language · Computer Science 2019-12-17 Rahul Radhakrishnan Iyer , Katia Sycara

Advanced Persistent Threat (APT) is challenging to detect due to prolonged duration, infrequent occurrence, and adept concealment techniques. Existing approaches primarily concentrate on the observable traits of attack behaviors, neglecting…

Cryptography and Security · Computer Science 2024-04-05 Xiaoxiao Liu , Fan Xu , Nan Wang , Qinxin Zhao , Dalin Zhang , Xibin Zhao , Jiqiang Liu

Content moderation is the process of screening and monitoring user-generated content online. It plays a crucial role in stopping content resulting from unacceptable behaviors such as hate speech, harassment, violence against specific…

Computation and Language · Computer Science 2023-01-02 Álvaro Huertas-García , Alejandro Martín , Javier Huertas Tato , David Camacho

What matters for contrastive learning? We argue that contrastive learning heavily relies on informative features, or "hard" (positive or negative) features. Early works include more informative features by applying complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Hui Xiong

The rapid advancement of large language models (LLMs) has resulted in increasingly sophisticated AI-generated content, posing significant challenges in distinguishing LLM-generated text from human-written language. Existing detection…

Computation and Language · Computer Science 2025-08-12 Siyuan Li , Xi Lin , Guangyan Li , Zehao Liu , Aodu Wulianghai , Li Ding , Jun Wu , Jianhua Li

Knowledge distillation from proprietary LLM APIs poses a growing threat to model providers, yet defenses against this attack remain fragmented and unevaluated. We present DistillGuard, a framework for systematically evaluating output-level…

Cryptography and Security · Computer Science 2026-03-10 Bo Jiang

Hate, derogatory, and offensive speech remains a persistent challenge in online platforms and public discourse. While automated detection systems are widely used, most focus on censorship or removal, raising concerns for transparency and…

Computation and Language · Computer Science 2026-04-17 Jason Liartis , Eirini Kaldeli , Lambrini Gyftokosta , Eleftherios Chelioudakis , Orfeas Menis Mastromichalakis

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

Computation and Language · Computer Science 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

Collaborative learning allows multiple clients to train a joint model without sharing their data with each other. Each client performs training locally and then submits the model updates to a central server for aggregation. Since the server…

Cryptography and Security · Computer Science 2020-03-11 Lingchen Zhao , Shengshan Hu , Qian Wang , Jianlin Jiang , Chao Shen , Xiangyang Luo , Pengfei Hu

Video classification is a challenging task in computer vision. Although Deep Neural Networks (DNNs) have achieved excellent performance in video classification, recent research shows adding imperceptible perturbations to clean videos can…

Machine Learning · Computer Science 2019-09-12 Xiaojun Jia , Xingxing Wei , Xiaochun Cao

The increasing prevalence of large language models (LLMs) has significantly advanced text generation, but the human-like quality of LLM outputs presents major challenges in reliably distinguishing between human-authored and LLM-generated…

Computation and Language · Computer Science 2024-12-18 Zhen Tao , Yanfang Chen , Dinghao Xi , Zhiyu Li , Wei Xu

Conversational models that are generative and open-domain are particularly susceptible to generating unsafe content since they are trained on web-based social data. Prior approaches to mitigating this issue have drawbacks, such as…

Computation and Language · Computer Science 2023-04-26 Leila Khalatbari , Yejin Bang , Dan Su , Willy Chung , Saeed Ghadimi , Hossein Sameti , Pascale Fung

Existing deepfake detection techniques struggle to keep-up with the ever-evolving novel, unseen forgeries methods. This limitation stems from their reliance on statistical artifacts learned during training, which are often tied to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Guangyu Shen , Zhihua Li , Xiang Xu , Tianchen Zhao , Zheng Zhang , Dongsheng An , Zhuowen Tu , Yifan Xing , Qin Zhang