English
Related papers

Related papers: Harmful Speech Detection by Language Models Exhibi…

200 papers

Large language models (LLMs) often inherit and amplify social biases embedded in their training data. A prominent social bias is gender bias. In this regard, prior work has mainly focused on gender stereotyping bias - the association of…

Computation and Language · Computer Science 2025-06-18 Erik Derner , Sara Sansalvador de la Fuente , Yoan Gutiérrez , Paloma Moreda , Nuria Oliver

Humor holds up a mirror to social perception: what we find funny often reflects who we are and how we judge others. When language models engage with humor, their reactions expose the social assumptions they have internalized from training…

Computation and Language · Computer Science 2026-04-22 Shubin Kim , Yejin Son , Junyeong Park , Keummin Ka , Seungbeen Lee , Jaeyoung Lee , Hyeju Jang , Alice Oh , Youngjae Yu

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

Social and Information Networks · Computer Science 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

Data filtering strategies are a crucial component to develop safe Large Language Models (LLM), since they support the removal of harmful contents from pretraining datasets. There is a lack of research on the actual impact of these…

Computation and Language · Computer Science 2026-03-24 Marco Antonio Stranisci , Christian Hardmeier

Hate speech has grown significantly on social media, causing serious consequences for victims of all demographics. Despite much attention being paid to characterize and detect discriminatory speech, most work has focused on explicit or…

Computation and Language · Computer Science 2021-09-14 Mai ElSherief , Caleb Ziems , David Muchlinski , Vaishnavi Anupindi , Jordyn Seybolt , Munmun De Choudhury , Diyi Yang

The training of large language models (LLMs) on extensive, unfiltered corpora sourced from the internet is a common and advantageous practice. Consequently, LLMs have learned and inadvertently reproduced various types of biases, including…

Computation and Language · Computer Science 2023-11-20 Ambri Ma , Arnav Kumar , Brett Zeligson

In recent years, online social networks have allowed worldwide users to meet and discuss. As guarantors of these communities, the administrators of these platforms must prevent users from adopting inappropriate behaviors. This verification…

Information Retrieval · Computer Science 2019-06-17 Noé Cecillon , Vincent Labatut , Richard Dufour , Georges Linarès

Technologies for abusive language detection are being developed and applied with little consideration of their potential biases. We examine racial bias in five different sets of Twitter data annotated for hate speech and abusive language.…

Computation and Language · Computer Science 2019-05-30 Thomas Davidson , Debasmita Bhattacharya , Ingmar Weber

With the growth of online services, the need for advanced text classification algorithms, such as sentiment analysis and biased text detection, has become increasingly evident. The anonymous nature of online services often leads to the…

Computation and Language · Computer Science 2023-11-14 Dasol Choi , Jooyoung Song , Eunsun Lee , Jinwoo Seo , Heejune Park , Dongbin Na

The spread of fake news, polarizing, politically biased, and harmful content on online platforms has been a serious concern. With large language models becoming a promising approach, however, no study has properly benchmarked their…

Computation and Language · Computer Science 2025-09-10 Michele Joshua Maggini , Dhia Merzougui , Rabiraj Bandyopadhyay , Gaël Dias , Fabrice Maurel , Pablo Gamallo

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

The age of social media is rife with memes. Understanding and detecting harmful memes pose a significant challenge due to their implicit meaning that is not explicitly conveyed through the surface text and image. However, existing harmful…

Computation and Language · Computer Science 2023-12-12 Hongzhan Lin , Ziyang Luo , Jing Ma , Long Chen

Online social media platforms are central to everyday communication and information seeking. While these platforms serve positive purposes, they also provide fertile ground for the spread of hate speech, offensive language, and bullying…

Computation and Language · Computer Science 2025-10-03 Md Arid Hasan , Firoj Alam , Md Fahad Hossain , Usman Naseem , Syed Ishtiaque Ahmed

Large Language Models (LLMs) are increasingly being used to autonomously evaluate the quality of content in communication systems, e.g., to assess responses in telecom customer support chatbots. However, the impartiality of these AI…

Artificial Intelligence · Computer Science 2026-03-03 Jiaxin Gao , Chen Chen , Yanwen Jia , Xueluan Gong , Kwok-Yan Lam , Qian Wang

Conversation forecasting tasks a model with predicting the outcome of an unfolding conversation. For instance, it can be applied in social media moderation to predict harmful user behaviors before they occur, allowing for preventative…

Computation and Language · Computer Science 2024-10-22 Anthony Sicilia , Malihe Alikhani

Detecting hateful content is a challenging and important problem. Automated tools, like machine-learning models, can help, but they require continuous training to adapt to the ever-changing landscape of social media. In this work, we…

Computation and Language · Computer Science 2025-11-06 Jay Patel , Hrudayangam Mehta , Jeremy Blackburn

This paper aims to help structure the risk landscape associated with large-scale Language Models (LMs). In order to foster advances in responsible innovation, an in-depth understanding of the potential risks posed by these models is needed.…

Large Language Models (LLMs) are increasingly deployed as gateways to information, yet their content moderation practices remain underexplored. This work investigates the extent to which LLMs refuse to answer or omit information when…

Computation and Language · Computer Science 2025-04-08 Sander Noels , Guillaume Bied , Maarten Buyl , Alexander Rogiers , Yousra Fettach , Jefrey Lijffijt , Tijl De Bie

In the era of social media and networking platforms, Twitter has been doomed for abuse and harassment toward users specifically women. Monitoring the contents including sexism and sexual harassment in traditional media is easier than…

Computation and Language · Computer Science 2020-04-20 Christos Karatsalos , Yannis Panagiotakis

Individuals who identify as sexual and gender minorities, including lesbian, gay, bisexual, transgender, queer, and others (LGBTQ+) are more likely to experience poorer health than their heterosexual and cisgender counterparts. One primary…

Computation and Language · Computer Science 2024-11-21 S. Chapagain , Y. Zhao , T. K. Rohleen , S. M. Hamdi , S. F. Boubrahimi , R. E. Flinn , E. M. Lund , D. Klooster , J. R. Scheer , C. J. Cascalheira