English
Related papers

Related papers: Auditing Gender Analyzers on Text Data

200 papers

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

Artificial Intelligence · Computer Science 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

Social bias in language - towards genders, ethnicities, ages, and other social groups - poses a problem with ethical impact for many NLP applications. Recent research has shown that machine learning models trained on respective data may not…

Computation and Language · Computer Science 2020-11-25 Maximilian Spliethöver , Henning Wachsmuth

The rapid development of AI tools and implementation of LLMs within downstream tasks has been paralleled by a surge in research exploring how the outputs of such AI/LLM systems embed biases, a research topic which was already being…

Computers and Society · Computer Science 2025-08-18 Sourojit Ghosh , Kyra Wilson

In the era of rapid technological advancement, social media platforms such as Twitter (X) have emerged as indispensable tools for gathering consumer insights, capturing diverse opinions, and understanding public attitudes. This research…

Human-Computer Interaction · Computer Science 2025-10-23 S M Rakib Ul Karim , Rownak Ara Rasul , Tunazzina Sultana

This study aims to develop an efficient and accurate model for detecting malicious comments, addressing the increasingly severe issue of false and harmful content on social media platforms. We propose a deep learning model that combines…

Computation and Language · Computer Science 2025-03-17 Zhou Fang , Hanlu Zhang , Jacky He , Zhen Qi , Hongye Zheng

The interaction between social norms and gender roles prescribes gender-specific behaviors that influence moral judgments. Here, we study how moral judgments are biased by the gender of the protagonist of a story. Using data from r/AITA, a…

Computers and Society · Computer Science 2025-07-08 Lorenzo Betti , Paolo Bajardi , Gianmarco De Francisci Morales

While civilized users employ social media to stay informed and discuss daily occurrences, haters perceive these platforms as fertile ground for attacking groups and individuals. The prevailing approach to counter this phenomenon involves…

Computation and Language · Computer Science 2024-05-24 Andrés Carvallo , Tamara Quiroga , Carlos Aspillaga , Marcelo Mendoza

Large pre-trained language models have become a crucial backbone for many downstream tasks in natural language processing (NLP), and while they are trained on a plethora of data containing a variety of biases, such as gender biases, it has…

Machine Learning · Computer Science 2026-01-22 Rick Wilming , Artur Dox , Hjalmar Schulz , Marta Oliveira , Benedict Clark , Stefan Haufe

The rise of social media has significantly increased the prevalence of cyberbullying (CB), posing serious risks to both mental and physical well-being. Effective detection systems are essential for mitigating its impact. While several…

Machine Learning · Computer Science 2025-04-16 Tabia Tanzin Prama , Jannatul Ferdaws Amrin , Md. Mushfique Anwar , Iqbal H. Sarker

Artificial intelligence (AI)-powered recommender systems play a crucial role in determining the content that users are exposed to on social media platforms. However, the behavioural patterns of these systems are often opaque, complicating…

Social and Information Networks · Computer Science 2023-09-20 Giulio Corsi

We investigate the effect of automatically generated counter-stereotypes on gender bias held by users of various demographics on social media. Building on recent NLP advancements and social psychology literature, we evaluate two…

Computers and Society · Computer Science 2025-10-28 Svetlana Kiritchenko , Anna Kerkhof , Isar Nejadgholi , Kathleen C. Fraser

Recommender systems are indispensable because they influence our day-to-day behavior and decisions by giving us personalized suggestions. Services like Kindle, Youtube, and Netflix depend heavily on the performance of their recommender…

Information Retrieval · Computer Science 2021-12-07 Shrikant Saxena , Shweta Jain

The task of image captioning implicitly involves gender identification. However, due to the gender bias in data, gender identification by an image captioning model suffers. Also, the gender-activity bias, owing to the word-by-word…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Shruti Bhargava , David Forsyth

Homelessness is a persistent social challenge, impacting millions worldwide. Over 876,000 people experienced homelessness (PEH) in the U.S. in 2025. Social bias is a significant barrier to alleviation, shaping public perception and…

Computers and Society · Computer Science 2026-01-30 Jonathan A. Karr , Benjamin F. Herbst , Matthew L. Sisk , Xueyun Li , Ting Hua , Matthew Hauenstein , Georgina Curto , Nitesh V. Chawla

Reference texts such as encyclopedias and news articles can manifest biased language when objective reporting is substituted by subjective writing. Existing methods to detect bias mostly rely on annotated data to train machine learning…

Computation and Language · Computer Science 2021-12-20 Timo Spinde , David Krieger , Manuel Plank , Bela Gipp

Hate speech is a challenging issue plaguing the online social media. While better models for hate speech detection are continuously being developed, there is little research on the bias and interpretability aspects of hate speech. In this…

Computation and Language · Computer Science 2022-04-13 Binny Mathew , Punyajoy Saha , Seid Muhie Yimam , Chris Biemann , Pawan Goyal , Animesh Mukherjee

Social media is considered a democratic space in which people connect and interact with each other regardless of their gender, race, or any other demographic aspect. Despite numerous efforts that explore demographic aspects in social media,…

Social and Information Networks · Computer Science 2018-04-03 Johnnatan Messias

This study evaluates the effectiveness of ChatGPT, an advanced AI model for natural language processing, in identifying targeting and inappropriate language in online comments. With the increasing challenge of moderating vast volumes of…

Computation and Language · Computer Science 2025-05-29 Barbarestani Baran , Maks Isa , Vossen Piek

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

Sentiment Analysis provides an opportunity to understand the subject(s), especially in the digital age, due to an abundance of public data and effective algorithms. Cybersecurity is a subject where opinions are plentiful and differing in…

Computation and Language · Computer Science 2022-04-27 Bipun Thapa