English
Related papers

Related papers: Evaluating Saliency Explanations in NLP by Crowdso…

200 papers

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister

In the recent advances of natural language processing, the scale of the state-of-the-art models and datasets is usually extensive, which challenges the application of sample-based explanation methods in many aspects, such as explanation…

Computation and Language · Computer Science 2021-06-10 Wei Zhang , Ziming Huang , Yada Zhu , Guangnan Ye , Xiaodong Cui , Fan Zhang

One of the motivations for explainable AI is to allow humans to make better and more informed decisions regarding the use and deployment of AI models. But careful evaluations are needed to assess whether this expectation has been fulfilled.…

Artificial Intelligence · Computer Science 2023-12-12 Shawn Im , Jacob Andreas , Yilun Zhou

Modern deep learning models for NLP are notoriously opaque. This has motivated the development of methods for interpreting such models, e.g., via gradient-based saliency maps or the visualization of attention weights. Such approaches aim to…

Computation and Language · Computer Science 2020-05-15 Xiaochuang Han , Byron C. Wallace , Yulia Tsvetkov

Due to the black-box nature of deep learning models, methods for explaining the models' results are crucial to gain trust from humans and support collaboration between AIs and humans. In this paper, we consider several model-agnostic and…

Computation and Language · Computer Science 2019-08-30 Piyawat Lertvittayakumjorn , Francesca Toni

A growing effort in NLP aims to build datasets of human explanations. However, the term explanation encompasses a broad range of notions, each with different properties and ramifications. Our goal is to provide an overview of diverse types…

Computation and Language · Computer Science 2022-05-17 Chenhao Tan

Vision-language models (VLMs) have achieved remarkable success across diverse tasks. However, concerns about their trustworthiness persist, particularly regarding tendencies to lean more on textual cues than visual evidence and the risk of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Shizhan Gong , Minda Hu , Qiyuan Zhang , Chen Ma , Qi Dou

Research in interpretable machine learning proposes different computational and human subject approaches to evaluate model saliency explanations. These approaches measure different qualities of explanations to achieve diverse goals in…

Human-Computer Interaction · Computer Science 2020-06-30 Sina Mohseni , Jeremy E. Block , Eric D. Ragan

Saliency methods can make deep neural network predictions more interpretable by identifying a set of critical features in an input sample, such as pixels that contribute most strongly to a prediction made by an image classifier.…

Machine Learning · Computer Science 2021-06-15 Yang Lu , Wenbo Guo , Xinyu Xing , William Stafford Noble

In the last decade, crowdsourcing has become a popular method for conducting quantitative empirical studies in human-machine interaction. The remote work on a given task in crowdworking settings suits the character of typical…

Human-Computer Interaction · Computer Science 2024-11-19 Annalena Aicher , Stefan Hillmann , Isabel Feustel , Thilo Michael , Sebastian Möller , Wolfgang Minker

Sentiment classification is a fundamental task in content analysis. Although deep learning has demonstrated promising performance in text classification compared with shallow models, it is still not able to train a satisfying classifier for…

Human-Computer Interaction · Computer Science 2020-04-28 Keyu Yang , Yunjun Gao , Lei Liang , Song Bian , Lu Chen , Baihua Zheng

A deep feature based saliency model (DeepFeat) is developed to leverage the understanding of the prediction of human fixations. Traditional saliency models often predict the human visual attention relying on few level image cues. Although…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Ali Mahdi , Jun Qin

Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Julius Adebayo , Justin Gilmer , Michael Muelly , Ian Goodfellow , Moritz Hardt , Been Kim

Explainable AI (XAI) has gained significant attention for providing insights into the decision-making processes of deep learning models, particularly for image classification tasks through visual explanations visualized by saliency maps.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yifei Zhang , James Song , Siyi Gu , Tianxu Jiang , Bo Pan , Guangji Bai , Liang Zhao

Large Language Models (LLMs) excel at text summarization, a task that requires models to select content based on its importance. However, the exact notion of salience that LLMs have internalized remains unclear. To bridge this gap, we…

Computation and Language · Computer Science 2025-05-28 Jan Trienes , Jörg Schlötterer , Junyi Jessy Li , Christin Seifert

Recent advances in deep learning have improved the performance of many Natural Language Processing (NLP) tasks such as translation, question-answering, and text classification. However, this improvement comes at the expense of model…

Computation and Language · Computer Science 2023-11-14 Sai Gurrapu , Ajay Kulkarni , Lifu Huang , Ismini Lourentzou , Laura Freeman , Feras A. Batarseh

A fundamental bottleneck in utilising complex machine learning systems for critical applications has been not knowing why they do and what they do, thus preventing the development of any crucial safety protocols. To date, no method exist…

Machine Learning · Computer Science 2023-01-18 Jan Rosenzweig , Zoran Cvetkovic , Ivana Rosenzweig

Recently, Deep Learning (DL) approaches have been applied to solve the Sentiment Classification (SC) problem, which is a core task in reviews mining or Sentiment Analysis (SA). The performances of these approaches are affected by different…

Computation and Language · Computer Science 2024-01-01 Mohamed Kayed , Rebeca P. Díaz-Redondo , Alhassan Mabrouk

Humans work together to solve common problems by having discussions, explaining, and agreeing or disagreeing with each other. Similarly, if a system can have discussions with humans when solving tasks, it can improve the system's…

Computation and Language · Computer Science 2024-01-31 Masahiro Kaneko , Graham Neubig , Naoaki Okazaki

Learning computational models for visual attention (saliency estimation) is an effort to inch machines/robots closer to human visual cognitive abilities. Data-driven efforts have dominated the landscape since the introduction of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Navyasri Reddy , Samyak Jain , Pradeep Yarlagadda , Vineet Gandhi