English
Related papers

Related papers: Predicting and Explaining Mobile UI Tappability wi…

200 papers

Self-supervised representation learning techniques utilize large datasets without semantic annotations to learn meaningful, universal features that can be conveniently transferred to solve a wide variety of downstream supervised tasks. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Swetava Ganguli , C. V. Krishnakumar Iyer , Vipul Pandey

As AI-based medical devices are becoming more common in imaging fields like radiology and histology, interpretability of the underlying predictive models is crucial to expand their use in clinical practice. Existing heatmap-based…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Kathryn Schutte , Olivier Moindrot , Paul Hérent , Jean-Baptiste Schiratti , Simon Jégou

In this paper, we explore the problem of interesting scene prediction for mobile robots. This area is currently underexplored but is crucial for many practical applications such as autonomous exploration and decision making. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Chen Wang , Wenshan Wang , Yuheng Qiu , Yafei Hu , Sebastian Scherer

Vision graph neural networks have emerged as a popular approach for modeling the global and spatial context for image recognition. However, a significant drawback of these methods is that they do not offer an inherent interpretation of the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Ivica Obadic , Dmitry Kangin , Adrian Höhl , Dario Oliveira , Plamen P Angelov , Xiao Xiang Zhu

Deep Neural Networks have become the dominant solution for Autonomous Driving perception, but their opacity conflicts with emerging Trustworthy AI guidelines and complicates safety assurance, debugging, and human oversight. While…

Robotics · Computer Science 2026-05-25 Till Beemelmanns , Shayan Sharifi , Manas Mehrotra , Ayushman Choudhuri , Lutz Eckstein

While a number of touch-based visualization systems have appeared in recent years, relatively little work has been done to evaluate these systems. The prevailing methods compare these systems to desktop-class applications or utilize…

Human-Computer Interaction · Computer Science 2018-06-19 Ramik Sadana , Meeshu Agnihotri , John Stasko

How interpretable are the features of leading vision models? The question is increasingly pressing as these models move from research benchmarks into high-stakes deployments, yet existing methods cannot answer it reliably. We close this gap…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Julien Colin , Lore Goetschalckx , Nuria Oliver , Thomas Serre

High-resolution tactile sensing can provide accurate information about local contact in contact-rich robotic tasks. However, the deployment of such tasks in unstructured environments remains under-investigated. To improve the robustness of…

Robotics · Computer Science 2023-08-03 Yijiong Lin , Mauro Comi , Alex Church , Dandan Zhang , Nathan F. Lepora

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a…

Machine Learning · Computer Science 2019-05-21 Mengnan Du , Ninghao Liu , Xia Hu

Model interpretability is an increasingly important component of practical machine learning. Some of the most common forms of interpretability systems are example-based, local, and global explanations. One of the main challenges in…

Machine Learning · Computer Science 2019-01-08 Gregory Plumb , Denali Molitor , Ameet Talwalkar

CLIP is one of the most popular foundational models and is heavily used for many vision-language tasks. However, little is known about the inner workings of CLIP. To bridge this gap we propose a study to quantify the interpretability in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Avinash Madasu , Yossi Gandelsman , Vasudev Lal , Phillip Howard

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ruth Fong , Andrea Vedaldi

Understanding human visual attention is important for multimedia applications. Many studies have attempted to learn from eye-tracking data and build computational saliency prediction models. However, limited efforts have been devoted to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Yujun Gu , Jie Chang , Ya Zhang , Yanfeng Wang

Interactive image segmentation enables users to interact minimally with a machine, facilitating the gradual refinement of the segmentation mask for a target of interest. Previous studies have demonstrated impressive performance in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Kun Li , Hao Cheng , George Vosselman , Michael Ying Yang

Recent efforts in Machine Learning (ML) interpretability have focused on creating methods for explaining black-box ML models. However, these methods rely on the assumption that simple approximations, such as linear models or decision-trees,…

Machine Learning · Computer Science 2019-06-13 Owen Lahav , Nicholas Mastronarde , Mihaela van der Schaar

Deep learning-based medical image analysis faces a significant barrier due to the lack of interpretability. Conventional explainable AI (XAI) techniques, such as Grad-CAM and SHAP, often highlight regions outside clinical interests. To…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuhao Zhang , Mingcheng Zhu , Zhiyao Luo

App ratings are among the most significant indicators of the quality, usability, and overall user satisfaction of mobile applications. However, existing app rating prediction models are largely limited to textual data or user interface (UI)…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Azrin Sultana , Firoz Ahmed

Deep Metric Learning (DML) approaches learn to represent inputs to a lower-dimensional latent space such that the distance between representations in this space corresponds with a predefined notion of similarity. This paper investigates how…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Niall O' Mahony , Sean Campbell , Anderson Carvalho , Lenka Krpalkova , Gustavo Velasco-Hernandez , Daniel Riordan , Joseph Walsh

Various work has suggested that the memorability of an image is consistent across people, and thus can be treated as an intrinsic property of an image. Using computer vision models, we can make specific predictions about what people will…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Coen D. Needell , Wilma A. Bainbridge