English
Related papers

Related papers: Deceiving Google's Perspective API Built for Detec…

200 papers

Hate speech is increasingly prevalent online, and its negative outcomes include increased prejudice, extremism, and even offline hate crime. Automatic detection of online hate speech can help us to better understand these impacts. However,…

Computation and Language · Computer Science 2021-02-10 John D Gallacher

Toxic language detection systems often falsely flag text that contains minority group mentions as toxic, as those groups are often the targets of online hate. Such over-reliance on spurious correlations also causes systems to struggle with…

Computation and Language · Computer Science 2022-07-15 Thomas Hartvigsen , Saadia Gabriel , Hamid Palangi , Maarten Sap , Dipankar Ray , Ece Kamar

Detecting toxic language including sexism, harassment and abusive behaviour, remains a critical challenge, particularly in its subtle and context-dependent forms. Existing approaches largely focus on isolated message-level classification,…

This paper presents a framework which enables a user to more easily make corrections to adversarial texts. While attack algorithms have been demonstrated to automatically build adversaries, changes made by the algorithms can often have poor…

Human-Computer Interaction · Computer Science 2020-12-21 Brandon Laughlin , Christopher Collins , Karthik Sankaranarayanan , Khalil El-Khatib

Online texts with toxic content are a clear threat to the users on social media in particular and society in general. Although many platforms have adopted various measures (e.g., machine learning-based hate-speech detection systems) to…

Machine Learning · Computer Science 2025-04-29 Yiran Ye , Thai Le , Dongwon Lee

Social media and the internet have become an integral part of how people spread and consume information. Over a period of time, social media evolved dramatically, and almost half of the population is using social media to express their…

Computation and Language · Computer Science 2021-08-03 Anjum , Rahul Katarya

Due to the subtleness, implicity, and different possible interpretations perceived by different people, detecting undesirable content from text is a nuanced difficulty. It is a long-known risk that language models (LMs), once trained on…

Computation and Language · Computer Science 2022-05-26 Yau-Shian Wang , Yingshan Chang

Toxic contents in online product review are a common phenomenon. A content is perceived to be toxic when it is rude, disrespectful, or unreasonable and make individuals leave the discussion. Machine learning algorithms helps the sell side…

Human-Computer Interaction · Computer Science 2022-01-11 Mayukh Mukhopadhyay , Sangeeta Sahney

The proliferation of hate speech on social media platforms has necessitated the development of effective detection and moderation tools. This study evaluates the efficacy of various machine learning models in identifying hate speech and…

Computation and Language · Computer Science 2026-02-25 Saurabh Mishra , Shivani Thakur , Radhika Mamidi

With surge in online platforms, there has been an upsurge in the user engagement on these platforms via comments and reactions. A large portion of such textual comments are abusive, rude and offensive to the audience. With machine learning…

Computation and Language · Computer Science 2021-08-17 Ayush Kumar , Pratik Kumar

Machine Learning (ML) is increasingly applied in real-life scenarios, raising concerns about bias in automatic decision making. We focus on bias as a notion of opinion exclusion, that stems from the direct application of traditional ML…

Machine Learning · Computer Science 2019-11-07 Agathe Balayn , Alessandro Bozzon

Social network platforms are generally used to share positive, constructive, and insightful content. However, in recent times, people often get exposed to objectionable content like threat, identity attacks, hate speech, insults, obscene…

Computation and Language · Computer Science 2021-05-31 Sreyan Ghosh , Sonal Kumar

Online social media has become increasingly popular in recent years due to its ease of access and ability to connect with others. One of social media's main draws is its anonymity, allowing users to share their thoughts and opinions without…

Computation and Language · Computer Science 2024-04-12 Vigneshwaran Shankaran , Rajesh Sharma

Social media platforms are deploying machine learning based offensive language classification systems to combat hateful, racist, and other forms of offensive speech at scale. However, despite their real-world deployment, we do not yet…

Computation and Language · Computer Science 2022-03-23 Jonathan Rusert , Zubair Shafiq , Padmini Srinivasan

The spread of hate speech on social media space is currently a serious issue. The undemanding access to the enormous amount of information being generated on these platforms has led people to post and react with toxic content that…

Computation and Language · Computer Science 2022-09-13 Abhishek Velankar , Hrushikesh Patil , Raviraj Joshi

In today's digital world, social media plays a significant role in facilitating communication and content sharing. However, the exponential rise in user-generated content has led to challenges in maintaining a respectful online environment.…

Computation and Language · Computer Science 2024-03-05 Mohammad Dehghani

Online memes are a powerful yet challenging medium for content moderation, often masking harmful intent behind humor, irony, or cultural symbolism. Conventional moderation systems "especially those relying on explicit text" frequently fail…

Information Retrieval · Computer Science 2025-10-20 Sayantan Adak , Somnath Banerjee , Rajarshi Mandal , Avik Halder , Sayan Layek , Rima Hazra , Animesh Mukherjee

Detecting online toxicity has always been a challenge due to its inherent subjectivity. Factors such as the context, geography, socio-political climate, and background of the producers and consumers of the posts play a crucial role in…

Social and Information Networks · Computer Science 2023-01-18 Tanmay Garg , Sarah Masud , Tharun Suresh , Tanmoy Chakraborty

Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks…

Computation and Language · Computer Science 2024-04-29 Lingyao Li , Lizhou Fan , Shubham Atreja , Libby Hemphill

Hate speech has grown into a pervasive phenomenon, intensifying during times of crisis, elections, and social unrest. Multiple approaches have been developed to detect hate speech using artificial intelligence, but a generalized model is…

Computation and Language · Computer Science 2024-10-10 Gautam Kishore Shahi , Tim A. Majchrzak