English
Related papers

Related papers: Demoting Racial Bias in Hate Speech Detection

200 papers

As Machine Learning models continue to be relied upon for making automated decisions, the issue of model bias becomes more and more prevalent. In this paper, we approach training a text classifica-tion model and optimize on bias…

Computation and Language · Computer Science 2019-08-19 Apik Ashod Zorian , Chandra Shekar Bikkanur

Recent advances in Representation Learning and Adversarial Training seem to succeed in removing unwanted features from the learned representation. We show that demographic information of authors is encoded in -- and can be recovered from --…

Computation and Language · Computer Science 2018-09-05 Yanai Elazar , Yoav Goldberg

While much attention has been paid to identifying explicit hate speech, implicit hateful expressions that are disguised in coded or indirect language are pervasive and remain a major challenge for existing hate speech detection systems.…

Computation and Language · Computer Science 2023-01-02 Jessica Lin

Hate speech detection is a critical problem in social media platforms, being often accused for enabling the spread of hatred and igniting physical violence. Hate speech detection requires overwhelming resources including high-performance…

Computation and Language · Computer Science 2020-05-14 Tomer Wullach , Amir Adler , Einat Minkov

Content warning: This work displays examples of explicit and/or strongly offensive language. Fueled by a surge of anti-Asian xenophobia and prejudice during the COVID-19 pandemic, many have taken to social media to express these negative…

Computation and Language · Computer Science 2022-06-29 Huy Nghiem , Fred Morstatter

When building a predictive model, it is often difficult to ensure that application-specific requirements are encoded by the model that will eventually be deployed. Consider researchers working on hate speech detection. They will have an…

Computation and Language · Computer Science 2025-01-14 Urja Khurana , Eric Nalisnick , Antske Fokkens

Online presence on social media platforms such as Facebook and Twitter has become a daily habit for internet users. Despite the vast amount of services the platforms offer for their users, users suffer from cyber-bullying, which further…

Computation and Language · Computer Science 2022-07-19 Ahmad Shapiro , Ayman Khalafallah , Marwan Torki

Adversarial training is a common approach for bias mitigation in natural language processing. Although most work on debiasing is motivated by equal opportunity, it is not explicitly captured in standard adversarial training. In this paper,…

Computation and Language · Computer Science 2022-05-17 Xudong Han , Timothy Baldwin , Trevor Cohn

Social media platforms provide users the freedom of expression and a medium to exchange information and express diverse opinions. Unfortunately, this has also resulted in the growth of abusive content with the purpose of discriminating…

Computation and Language · Computer Science 2021-07-01 Sohail Akhtar , Valerio Basile , Viviana Patti

Natural Language Processing (NLP) models risk overfitting to specific terms in the training data, thereby reducing their performance, fairness, and generalizability. E.g., neural hate speech detection models are strongly influenced by…

Computation and Language · Computer Science 2022-03-18 Giuseppe Attanasio , Debora Nozza , Dirk Hovy , Elena Baralis

Sentiment analysis focuses on identifying the emotional polarity expressed in textual data, typically categorized as positive, negative, or neutral. Hate speech detection, on the other hand, aims to recognize content that incites violence,…

Computation and Language · Computer Science 2026-01-07 Meysam Shirdel Bilehsavar , Negin Mahmoudi , Mohammad Jalili Torkamani , Kiana Kiashemshaki

With the growth of social media, the spread of hate speech is also increasing rapidly. Social media are widely used in many countries. Also Hate Speech is spreading in these countries. This brings a need for multilingual Hate Speech…

Deep neural network-based classifiers are prone to errors when processing adversarial examples (AEs). AEs are minimally perturbed input data undetectable to humans posing significant risks to security-dependent applications. Hence,…

Cryptography and Security · Computer Science 2026-01-05 Fumiya Morimoto , Ryuto Morita , Satoshi Ono

Hate speech online targets individuals or groups based on identity attributes and spreads rapidly, posing serious social risks. Memes, which combine images and text, have emerged as a nuanced vehicle for disseminating hate speech, often…

Multiagent Systems · Computer Science 2026-03-26 Rui Xing , Qi Chai , Jie Ma , Jing Tao , Pinghui Wang , Shuming Zhang , Xinping Wang , Hao Wang

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

Social and Information Networks · Computer Science 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

The detection of hate speech online has become an important task, as offensive language such as hurtful, obscene and insulting content can harm marginalized people or groups. This paper presents TU Berlin team experiments and results on the…

Computation and Language · Computer Science 2022-01-13 Salar Mohtaj , Vera Schmitt , Sebastian Möller

Toxicity text detectors can be vulnerable to adversarial examples - small perturbations to input text that fool the systems into wrong detection. Existing attack algorithms are time-consuming and often produce invalid or ambiguous…

Cryptography and Security · Computer Science 2025-05-02 Xuan Zhu , Dmitriy Bespalov , Liwen You , Ninad Kulkarni , Yanjun Qi

We present a human-and-model-in-the-loop process for dynamically generating datasets and training better performing and more robust hate detection models. We provide a new dataset of ~40,000 entries, generated and labelled by trained…

Computation and Language · Computer Science 2021-06-04 Bertie Vidgen , Tristan Thrush , Zeerak Waseem , Douwe Kiela

Speech-based AI models are emerging as powerful tools for detecting depression and the presence of Post-traumatic stress disorder (PTSD), offering a non-invasive and cost-effective way to assess mental health. However, these models often…

Artificial Intelligence · Computer Science 2025-05-07 June-Woo Kim , Haram Yoon , Wonkyo Oh , Dawoon Jung , Sung-Hoon Yoon , Dae-Jin Kim , Dong-Ho Lee , Sang-Yeol Lee , Chan-Mo Yang

Well-annotated data is a prerequisite for good Natural Language Processing models. Too often, though, annotation decisions are governed by optimizing time or annotator agreement. We make a case for nuanced efforts in an interdisciplinary…

Computation and Language · Computer Science 2022-10-31 Federico Bianchi , Stefanie Anja Hills , Patricia Rossini , Dirk Hovy , Rebekah Tromble , Nava Tintarev