English
Related papers

Related papers: Can Interpretability Layouts Influence Human Perce…

200 papers

Large Language Models (LLMs) are known to exhibit social, demographic, and gender biases, often as a consequence of the data on which they are trained. In this work, we adopt a mechanistic interpretability approach to analyze how such…

Computation and Language · Computer Science 2025-06-09 Bhavik Chandna , Zubair Bashir , Procheta Sen

Readability assessment aims to automatically classify text by the level appropriate for learning readers. Traditional approaches to this task utilize a variety of linguistically motivated features paired with simple machine learning models.…

Computation and Language · Computer Science 2020-08-04 Tovly Deutsch , Masoud Jasbi , Stuart Shieber

The proliferation of hate speech on social media platforms has necessitated the development of effective detection and moderation tools. This study evaluates the efficacy of various machine learning models in identifying hate speech and…

Computation and Language · Computer Science 2026-02-25 Saurabh Mishra , Shivani Thakur , Radhika Mamidi

During a research project in which we developed a machine learning (ML) driven visualization system for non-ML experts, we reflected on interpretability research in ML, computer-supported collaborative work and human-computer interaction.…

Human-Computer Interaction · Computer Science 2022-01-19 Jesse Josua Benjamin , Christoph Kinkeldey , Claudia Müller-Birn , Tim Korjakow , Eva-Maria Herbst

Large Language Models (LLMs) offer a lucrative promise for scalable content moderation, including hate speech detection. However, they are also known to be brittle and biased against marginalised communities and dialects. This requires…

Computation and Language · Computer Science 2025-10-14 Ananya Malik , Kartik Sharma , Shaily Bhatt , Lynnette Hui Xian Ng

Machine learning is frequently used in affective computing, but presents challenges due the opacity of state-of-the-art machine learning methods. Because of the impact affective machine learning systems may have on an individual's life, it…

Machine Learning · Computer Science 2025-10-07 David S. Johnson , Olya Hakobyan , Hanna Drimalla

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Machine Learning · Computer Science 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

Given the black-box nature and complexity of large transformer language models (LM), concerns about generalizability and robustness present ethical implications for domains such as hate speech (HS) detection. Using the content rich Social…

Computation and Language · Computer Science 2024-11-12 Jennifer L. Chen , Faisal Ladhak , Daniel Li , Noémie Elhadad

Despite the widespread adoption, there is a lack of research into how various critical aspects of pretrained language models (PLMs) affect their performance in hate speech detection. Through five research questions, our findings and…

Computation and Language · Computer Science 2024-02-06 Sarah Masud , Mohammad Aflah Khan , Vikram Goyal , Md Shad Akhtar , Tanmoy Chakraborty

The rise of online platforms exacerbated the spread of hate speech, demanding scalable and effective detection. However, the accuracy of hate speech detection systems heavily relies on human-labeled data, which is inherently susceptible to…

Computation and Language · Computer Science 2025-06-13 Tommaso Giorgi , Lorenzo Cima , Tiziano Fagni , Marco Avvenuti , Stefano Cresci

The majority of research in computational psycholinguistics has concentrated on the processing of words. This study introduces innovative methods for computing sentence-level metrics using multilingual large language models. The metrics…

Computation and Language · Computer Science 2024-04-17 Kun Sun , Rong Wang

Today, the internet is an integral part of our daily lives, enabling people to be more connected than ever before. However, this greater connectivity and access to information increase exposure to harmful content such as cyber-bullying and…

Social and Information Networks · Computer Science 2023-10-31 Lanqin Yuan , Tianyu Wang , Gabriela Ferraro , Hanna Suominen , Marian-Andrei Rizoiu

The exponential increase in the use of the Internet and social media over the last two decades has changed human interaction. This has led to many positive outcomes, but at the same time it has brought risks and harms. While the volume of…

Computation and Language · Computer Science 2020-12-23 Neeraj Vashistha , Arkaitz Zubiaga , Shanky Sharma

An essential aspect of evaluating Large Language Models (LLMs) is identifying potential biases. This is especially relevant considering the substantial evidence that LLMs can replicate human social biases in their text outputs and further…

Human-Computer Interaction · Computer Science 2024-05-21 Paula Akemi Aoyagui , Sharon Ferguson , Anastasia Kuzminykh

What makes an interaction with the LLM more preferable for the user? While it is intuitive to assume that information accuracy in the LLM's responses would be one of the influential variables, recent studies have found that inaccurate LLM's…

Computation and Language · Computer Science 2025-04-25 Rendi Chevi , Kentaro Inui , Thamar Solorio , Alham Fikri Aji

Background: What counts as violence is neither self-evident nor universally agreed upon. While physical aggression is prototypical, contemporary societies increasingly debate whether exclusion, humiliation, online harassment or symbolic…

Physics and Society · Physics 2026-02-20 Mariachiara Stellato , Francesco Lancia , Chiara Galeazzi , Nico Curti

Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we…

Computation and Language · Computer Science 2021-04-14 Shuoyang Ding , Philipp Koehn

Language models based on the Transformer architecture achieve excellent results in many language-related tasks, such as text classification or sentiment analysis. However, despite the architecture of these models being well-defined, little…

Computation and Language · Computer Science 2025-04-14 Miguel López-Otal , Jorge Gracia , Jordi Bernad , Carlos Bobed , Lucía Pitarch-Ballesteros , Emma Anglés-Herrero

Sentiment analysis focuses on identifying the emotional polarity expressed in textual data, typically categorized as positive, negative, or neutral. Hate speech detection, on the other hand, aims to recognize content that incites violence,…

Computation and Language · Computer Science 2026-01-07 Meysam Shirdel Bilehsavar , Negin Mahmoudi , Mohammad Jalili Torkamani , Kiana Kiashemshaki

Machine Learning (ML) models are often complex and difficult to interpret due to their 'black-box' characteristics. Interpretability of a ML model is usually defined as the degree to which a human can understand the cause of decisions…

Methodology · Statistics 2020-06-25 Simon Kocbek , Primoz Kocbek , Leona Cilar , Gregor Stiglic