English
Related papers

Related papers: The Role of Interactive Visualization in Explainin…

200 papers

Leveraging hypergraph structures to model advanced processes has gained much attention over the last few years in many areas, ranging from protein-interaction in computational biology to image retrieval using machine learning. Hypergraph…

Human-Computer Interaction · Computer Science 2021-12-07 Maximilian T. Fischer , Alexander Frings , Daniel A. Keim , Daniel Seebacher

Recent Vision-Language Pre-training (VLP) models have demonstrated significant advancements. Nevertheless, these models heavily rely on image-text pairs that capture only coarse and global information of an image, leading to a limitation in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Jungbeom Lee , Sanghyuk Chun , Sangdoo Yun

eXplanation Based Learning (XBL) is a form of Interactive Machine Learning (IML) that provides a model refining approach via user feedback collected on model explanations. Although the interactivity of XBL promotes model transparency, XBL…

Machine Learning · Computer Science 2023-07-13 Misgina Tsighe Hagos , Kathleen M. Curran , Brian Mac Namee

Natural language generation (NLG) models have emerged as a focal point of research within natural language processing (NLP), exhibiting remarkable performance in tasks such as text composition and dialogue generation. However, their…

Human-Computer Interaction · Computer Science 2025-07-04 Yunchao Wang , Guodao Sun , Zihang Fu , Ronghua Liang

When people interpret text, they rely on inferences that go beyond the observed language itself. Inspired by this observation, we introduce a method for the analysis of text that takes implicitly communicated content explicitly into…

Computation and Language · Computer Science 2025-02-25 Alexander Hoyle , Rupak Sarkar , Pranav Goel , Philip Resnik

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

We present a method for visualising the response of a deep neural network to a specific input. For image data for instance our method will highlight areas that provide evidence in favor of, and against choosing a certain class. The method…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Luisa M. Zintgraf , Taco S. Cohen , Max Welling

Although interactive learning puts the user into the loop, the learner remains mostly a black box for the user. Understanding the reasons behind queries and predictions is important when assessing how the learner works and, in turn, trust.…

Machine Learning · Statistics 2018-05-23 Stefano Teso , Kristian Kersting

Explainable AI has emerged to be a key component for black-box machine learning approaches in domains with a high demand for reliability or transparency. Examples are medical assistant systems, and applications concerned with the General…

Machine Learning · Computer Science 2021-05-18 Johannes Rabold , Gesina Schwalbe , Ute Schmid

Utilizing Visualization-oriented Natural Language Interfaces (V-NLI) as a complementary input modality to direct manipulation for visual analytics can provide an engaging user experience. It enables users to focus on their tasks rather than…

Human-Computer Interaction · Computer Science 2022-02-07 Leixian Shen , Enya Shen , Yuyu Luo , Xiaocong Yang , Xuming Hu , Xiongshuai Zhang , Zhiwei Tai , Jianmin Wang

Massive language models are the core of modern NLP modeling and have been shown to encode impressive amounts of commonsense and factual information. However, that knowledge exists only within the latent parameters of the model, inaccessible…

Computation and Language · Computer Science 2020-07-03 Pat Verga , Haitian Sun , Livio Baldini Soares , William W. Cohen

Natural Language Processing (NLP) has become a cornerstone in many critical sectors, including healthcare, finance, and customer relationship management. This is especially true with the development and use of advanced models such as…

Computation and Language · Computer Science 2025-06-06 Hadi Mohammadi , Ayoub Bagheri , Anastasia Giachanou , Daniel L. Oberski

In each of the last five years, a few dozen empirical studies appeared in visualization journals and conferences. The existing empirical studies have already featured a large number of variables. There are many more variables yet to be…

Human-Computer Interaction · Computer Science 2020-09-29 Min Chen , Alfie Abdul-Rahman , David H. Laidlaw

The introduction of Transformer neural networks has changed the landscape of Natural Language Processing (NLP) during the last years. So far, none of the visualization systems has yet managed to examine all the facets of the Transformers.…

Computation and Language · Computer Science 2021-05-27 Andrew Dunn , Diana Inkpen , Răzvan Andonie

Visual perception and language understanding are - fundamental components of human intelligence, enabling them to understand and reason about objects and their interactions. It is crucial for machines to have this capacity to reason using…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Thao Minh Le

Understanding the behavior of large language models (LLMs) is crucial for ensuring their safe and reliable use. However, existing explainable AI (XAI) methods for LLMs primarily rely on word-level explanations, which are often…

Computation and Language · Computer Science 2025-08-08 Furui Cheng , Vilém Zouhar , Robin Shing Moon Chan , Daniel Fürst , Hendrik Strobelt , Mennatallah El-Assady

Many visualization techniques have been created to explain the behavior of computer vision models, but they largely consist of static diagrams that convey limited information. Interactive visualizations allow users to more easily interpret…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Devon Ulrich , Ruth Fong

Trust and credibility in machine learning models is bolstered by the ability of a model to explain itsdecisions. While explainability of deep learning models is a well-known challenge, a further chal-lenge is clarity of the explanation…

Machine Learning · Computer Science 2020-11-30 hsan Ullah , Andre Rios , Vaibhav Gala , Susan Mckeever

Breakthroughs in transformer-based models have revolutionized not only the NLP field, but also vision and multimodal systems. However, although visualization and interpretability tools have become available for NLP models, internal…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Estelle Aflalo , Meng Du , Shao-Yen Tseng , Yongfei Liu , Chenfei Wu , Nan Duan , Vasudev Lal

Recent breakthroughs in NLP research, such as the advent of Transformer models have indisputably contributed to major advancements in several tasks. However, few works research robustness and explainability issues of their evaluation…

Computation and Language · Computer Science 2022-10-31 Maria Lymperaiou , George Manoliadis , Orfeas Menis Mastromichalakis , Edmund G. Dervakos , Giorgos Stamou