English
Related papers

Related papers: Not All Features Are Equal: Feature Leveling Deep …

200 papers

Recently proposed Gated Linear Networks present a tractable nonlinear network architecture, and exhibit interesting capabilities such as learning with local error signals and reduced forgetting in sequential learning. In this work, we…

Machine Learning · Computer Science 2022-12-13 Qianyi Li , Haim Sompolinsky

Graph Neural Networks (GNNs) are a popular technique for modelling graph-structured data and computing node-level representations via aggregation of information from the neighborhood of each node. However, this aggregation implies an…

Machine Learning · Computer Science 2022-08-30 Ameya Daigavane , Gagan Madan , Aditya Sinha , Abhradeep Guha Thakurta , Gaurav Aggarwal , Prateek Jain

In natural language processing (NLP), deep neural networks (DNNs) could model complex interactions between context and have achieved impressive results on a range of NLP tasks. Prior works on feature interaction attribution mainly focus on…

Computation and Language · Computer Science 2023-10-27 Xiaolei Lu , Jianghong Ma , Haode Zhang

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

One of the most prominent attributes of Neural Networks (NNs) constitutes their capability of learning to extract robust and descriptive features from high dimensional data, like images. Hence, such an ability renders their exploitation as…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Ioannis Kansizoglou , Loukas Bampis , Antonios Gasteratos

Recommender systems (RS) serve as a fundamental tool for navigating the vast expanse of online information, with deep learning advancements playing an increasingly important role in improving ranking accuracy. Among these, graph neural…

Information Retrieval · Computer Science 2025-02-18 Bin Wu , Yihang Wang , Yuanhao Zeng , Jiawei Liu , Jiashu Zhao , Cheng Yang , Yawen Li , Long Xia , Dawei Yin , Chuan Shi

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Most techniques for explainable machine learning focus on feature attribution, i.e., values are assigned to the features such that their sum equals the prediction. Example attribution is another form of explanation that assigns weights to…

Machine Learning · Computer Science 2025-02-28 Genghua Dong , Henrik Boström , Michalis Vazirgiannis , Roman Bresson

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

As machine learning becomes increasingly integral to autonomous decision-making processes involving human interaction, the necessity of comprehending the model's outputs through conversational means increases. Most recently, foundation…

Artificial Intelligence · Computer Science 2024-07-31 Sule Tekkesinoglu , Lars Kunze

DeConvNet, Guided BackProp, LRP, were invented to better understand deep neural networks. We show that these methods do not produce the theoretically correct explanation for a linear model. Yet they are used on multi-layer networks with…

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Lending decisions are usually made with proprietary models that provide minimally acceptable explanations to users. In a future world without such secrecy, what decision support tools would one want to use for justified lending decisions?…

Machine Learning · Computer Science 2021-06-07 Chaofan Chen , Kangcheng Lin , Cynthia Rudin , Yaron Shaposhnik , Sijia Wang , Tong Wang

Deep neural networks excel in mapping genomic DNA sequences to associated readouts (e.g., protein-DNA binding). Beyond prediction, the goal of these networks is to reveal to scientists the underlying motifs (and their syntax) which drive…

Genomics · Quantitative Biology 2024-10-10 Alex M. Tseng , Gokcen Eraslan , Tommaso Biancalani , Gabriele Scalia

Low dimensional structures appear ubiquitously in the eigenspectra of deep learning matrices in classification networks trained in the overparameterized regime. While theoretical advances have aimed to explain this phenomenology, they…

Machine Learning · Computer Science 2026-05-28 Connall Garrod , Jonathan P. Keating

Fine-grained image classification has emerged as a significant challenge because objects in such images have small inter-class visual differences but with large variations in pose, lighting, and viewpoints, etc. Most existing work focuses…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Xuelu Li , Vishal Monga

We discuss probabilistic neural networks with a fixed internal representation as models for machine understanding. Here understanding is intended as mapping data to an already existing representation which encodes an {\em a priori}…

Disordered Systems and Neural Networks · Physics 2023-12-07 Rongrong Xie , Matteo Marsili

Graph Neural Networks (GNNs) have shown remarkable effectiveness in capturing abundant information in graph-structured data. However, the black-box nature of GNNs hinders users from understanding and trusting the models, thus leading to…

Machine Learning · Computer Science 2022-07-25 Jiaxuan Xie , Yezi Liu , Yanning Shen

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin