English
Related papers

Related papers: Aligning Eyes between Humans and Deep Neural Netwo…

200 papers

We examined whether embedding human attention knowledge into saliency-based explainable AI (XAI) methods for computer vision models could enhance their plausibility and faithfulness. We first developed new gradient-based XAI methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Guoyang Liu , Jindi Zhang , Antoni B. Chan , Janet H. Hsiao

Currently, attention mechanisms have garnered increasing attention in Graph Neural Networks (GNNs), such as Graph Attention Networks (GATs) and Graph Transformers (GTs). It is not only due to the commendable boost in performance they offer…

Machine Learning · Computer Science 2024-10-10 Lijie Hu , Tianhao Huang , Lu Yu , Wanyu Lin , Tianhang Zheng , Di Wang

Deep learning (DL) has substantially enhanced natural language processing (NLP) in healthcare research. However, the increasing complexity of DL-based NLP necessitates transparent model interpretability, or at least explainability, for…

Computation and Language · Computer Science 2024-10-17 Guangming Huang , Yingya Li , Shoaib Jameel , Yunfei Long , Giorgos Papanastasiou

Deep neural networks (DNNs) have proven their capabilities in many areas in the past years, such as robotics, or automated driving, enabling technological breakthroughs. DNNs play a significant role in environment perception for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Manuel Schwonberg , Joshua Niemeijer , Jan-Aike Termöhlen , Jörg P. Schäfer , Nico M. Schmidt , Hanno Gottschalk , Tim Fingscheidt

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

We present a computational explainability approach for human comparison tasks, using Alignment Importance Score (AIS) heatmaps derived from deep-vision models. The AIS reflects a feature-map's unique contribution to the alignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Nhut Truong , Dario Pesenti , Uri Hasson

Person re-identification (reID) benefits greatly from deep convolutional neural networks (CNNs) which learn robust feature embeddings. However, CNNs are inherently limited in modeling the large variations in person pose and scale due to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-22 Ruibing Hou , Bingpeng Ma , Hong Chang , Xinqian Gu , Shiguang Shan , Xilin Chen

Human visual system is modeled in engineering field providing feature-engineered methods which detect contrasted/surprising/unusual data into images. This data is "interesting" for humans and leads to numerous applications. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Phutphalla Kong , Matei Mancas , Bernard Gosselin , Kimtho Po

Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness…

Artificial Intelligence · Computer Science 2020-03-03 Kamran Alipour , Jurgen P. Schulze , Yi Yao , Avi Ziskind , Giedrius Burachas

Artificial agents that support human group interactions hold great promise, especially in sensitive contexts such as well-being promotion and therapeutic interventions. However, current systems struggle to mediate group interactions…

Human-Computer Interaction · Computer Science 2026-03-17 Giulia Huang , Maristella Matera , Micol Spitale

Social network alignment, aligning different social networks on their common users, is receiving dramatic attention from both academic and industry. All existing studies consider the social network to be static and neglect its inherent…

Social and Information Networks · Computer Science 2019-11-04 Li Sun , Zhongbao Zhang , Pengxin Ji , Jian Wen , Sen Su , Philip S. Yu

It has been observed that deep neural networks (DNNs) often use both genuine as well as spurious features. In this work, we propose "Amending Inherent Interpretability via Self-Supervised Masking" (AIM), a simple yet interestingly effective…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Eyad Alshami , Shashank Agnihotri , Bernt Schiele , Margret Keuper

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated…

Computers and Society · Computer Science 2023-06-14 Bhavya Ghai

The application of computer vision is gradually increasing across various domains. They employ deep learning models with a black-box nature. Without the ability to explain the behavior of neural networks, especially their decision-making…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Maryam Sadat Hosseini Azad , Shahriar Baradaran Shokouhi , Amir Abbas Hamidi Imani , Shahin Atakishiyev , Randy Goebel

Aligning AI systems with human values fundamentally relies on effective human feedback. While significant research has addressed training algorithms, the role of user interface is often overlooked and only treated as an implementation…

Human-Computer Interaction · Computer Science 2026-02-13 Danqing Shi

Predicting human intention is critical to facilitating safe and efficient human-robot collaboration (HRC). However, it is challenging to build data-driven models for human intention prediction. One major challenge is due to the diversity…

Machine Learning · Computer Science 2022-09-27 Ruixuan Liu , Changliu Liu

In this work, we propose a methodology for investigating the use of semantic attention to enhance the explainability of Graph Neural Network (GNN)-based models. Graph Deep Learning (GDL) has emerged as a promising field for tasks like scene…

Machine Learning · Computer Science 2023-10-24 Efimia Panagiotaki , Daniele De Martini , Lars Kunze

Scaling up robot learning is hindered by the scarcity of robotic demonstrations, whereas human videos offer a vast, untapped source of interaction data. However, bridging the embodiment gap between human hands and robot arms remains a…

Robotics · Computer Science 2026-04-14 Yifu Xu , Bokai Lin , Xinyu Zhan , Hongjie Fang , Yong-Lu Li , Cewu Lu , Lixin Yang

Rapid development of artificial intelligence (AI) systems amplify many concerns in society. These AI algorithms inherit different biases from humans due to mysterious operational flow and because of that it is becoming adverse in usage. As…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Artem Domnich , Gholamreza Anbarjafari

AI alignment refers to models acting towards human-intended goals, preferences, or ethical principles. Given that most large-scale deep learning models act as black boxes and cannot be manually controlled, analyzing the similarity between…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiyoung Lee , Seungho Kim , Seunghyun Won , Joonseok Lee , Marzyeh Ghassemi , James Thorne , Jaeseok Choi , O-Kil Kwon , Edward Choi