English
Related papers

Related papers: Necessity and Sufficiency for Explaining Text Clas…

200 papers

With the ever-increasing cases of hate spread on social media platforms, it is critical to design abuse detection mechanisms to proactively avoid and control such incidents. While there exist methods for hate speech detection, they…

Computation and Language · Computer Science 2020-01-17 Pinkesh Badjatiya , Manish Gupta , Vasudeva Varma

In order to ensure the reliability of the explanations of machine learning models, it is crucial to establish their advantages and limits and in which case each of these methods outperform. However, the current understanding of when and how…

Machine Learning · Computer Science 2025-02-12 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Sonali Parbhoo , Jesse Read

Optimization of offensive content moderation models for different types of hateful messages is typically achieved through continued pre-training or fine-tuning on new hate speech benchmarks. However, existing benchmarks mainly address…

Computation and Language · Computer Science 2026-04-07 Irina Proskurina , Marc-Antoine Carpentier , Julien Velcin

Many NLP tasks require to automatically identify the most significant words in a text. In this work, we derive word significance from models trained to solve semantic task: Natural Language Inference and Paraphrase Identification. Using an…

Computation and Language · Computer Science 2023-06-01 Dávid Javorský , Ondřej Bojar , François Yvon

Abusive language detection has become an increasingly important task as a means to tackle this type of harmful content in social media. There has been a substantial body of research developing models for determining if a social media post…

Computation and Language · Computer Science 2025-08-19 Raneem Alharthi , Rajwa Alharthi , Aiqi Jiang , Arkaitz Zubiaga

The large size and complex decision mechanisms of state-of-the-art text classifiers make it difficult for humans to understand their predictions, leading to a potential lack of trust by the users. These issues have led to the adoption of…

An independent ethical assessment of an artificial intelligence system is an impartial examination of the system's development, deployment, and use in alignment with ethical values. System-level qualitative frameworks that describe…

Computers and Society · Computer Science 2021-08-18 Amitoj Singh , Jingshu Chen , Lihao Zhang , Amin Rasekh , Ilana Golbin , Anand Rao

Human explanations of natural language, rationales, form a tool to assess whether models learn a label for the right reasons or rely on dataset-specific shortcuts. Sufficiency is a common metric for estimating the informativeness of…

Computation and Language · Computer Science 2025-11-21 Jonathan Kamp , Lisa Beinborn , Antske Fokkens

As the first step of automatic fact checking, claim check-worthiness detection is a critical component of fact checking systems. There are multiple lines of research which study this problem: check-worthiness ranking from political speeches…

Computation and Language · Computer Science 2020-09-17 Dustin Wright , Isabelle Augenstein

Various text analysis techniques exist, which attempt to uncover unstructured information from text. In this work, we explore using statistical dependence measures for textual classification, representing text as word vectors. Student…

Computation and Language · Computer Science 2018-08-01 Samuel Cunningham-Nelson , Mahsa Baktashmotlagh , Wageeh Boles

We investigate the problem of explainability for machine learning models, focusing on Feature Attribution Methods (FAMs) that evaluate feature importance through perturbation tests. Despite their utility, FAMs struggle to distinguish the…

Hate speech detection is complex; it relies on commonsense reasoning, knowledge of stereotypes, and an understanding of social nuance that differs from one culture to the next. It is also difficult to collect a large-scale hate speech…

Computation and Language · Computer Science 2023-05-23 Badr AlKhamissi , Faisal Ladhak , Srini Iyer , Ves Stoyanov , Zornitsa Kozareva , Xian Li , Pascale Fung , Lambert Mathias , Asli Celikyilmaz , Mona Diab

The pervasiveness of the Internet and social media have enabled the rapid and anonymous spread of Hate Speech content on microblogging platforms such as Twitter. Current EU and US legislation against hateful language, in conjunction with…

Computation and Language · Computer Science 2021-02-10 Chrysoula Themeli , George Giannakopoulos , Nikiforos Pittaras

With the recent proliferation of the use of text classifications, researchers have found that there are certain unintended biases in text classification datasets. For example, texts containing some demographic identity-terms (e.g., "gay",…

Computation and Language · Computer Science 2020-08-21 Guanhua Zhang , Bing Bai , Junqi Zhang , Kun Bai , Conghui Zhu , Tiejun Zhao

Training data influence estimation methods quantify the contribution of training documents to a model's output, making them a promising source of information for example-based explanations. As humans cannot interpret thousands of documents,…

Computation and Language · Computer Science 2026-04-10 Loris Schoenegger , Benjamin Roth

Detection of hate speech has been formulated as a standalone application of NLP and different approaches have been adopted for identifying the target groups, obtaining raw data, defining the labeling process, choosing the detection…

Computation and Language · Computer Science 2023-09-07 Vitthal Bhandari

Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we introduce a study of…

Computation and Language · Computer Science 2022-01-28 Neha Deshpande , Nicholas Farris , Vidhur Kumar

Motivated by distinct, though related, criteria, a growing number of attribution methods have been developed tointerprete deep learning. While each relies on the interpretability of the concept of "importance" and our ability to visualize…

Artificial Intelligence · Computer Science 2020-04-07 Zifan Wang , Piotr Mardziel , Anupam Datta , Matt Fredrikson

While SHAP (SHapley Additive exPlanations) and other feature attribution methods are commonly employed to explain model predictions, their application within information retrieval (IR), particularly for complex outputs such as ranked lists,…

Information Retrieval · Computer Science 2025-05-01 Maria Heuss , Maarten de Rijke , Avishek Anand

Hate speech detection on Twitter is critical for applications like controversial event extraction, building AI chatterbots, content recommendation, and sentiment analysis. We define this task as being able to classify a tweet as racist,…

Computation and Language · Computer Science 2017-06-02 Pinkesh Badjatiya , Shashank Gupta , Manish Gupta , Vasudeva Varma