English
Related papers

Related papers: Optimization and Interpretability of Graph Attenti…

200 papers

Multi-label classification aims to recognize multiple objects or attributes from images. However, it is challenging to learn from proper label graphs to effectively characterize such inter-label correlations or dependencies. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jin Yuan , Shikai Chen , Yao Zhang , Zhongchao Shi , Xin Geng , Jianping Fan , Yong Rui

Graph-based learning is a rapidly growing sub-field of machine learning with applications in social networks, citation networks, and bioinformatics. One of the most popular models is graph attention networks. They were introduced to allow a…

Machine Learning · Computer Science 2023-05-23 Kimon Fountoulakis , Amit Levi , Shenghao Yang , Aseem Baranwal , Aukosh Jagannath

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in solving graph classification tasks. However, most GNN architectures aggregate information from all nodes and edges in a graph, regardless of their relevance to the…

Machine Learning · Statistics 2024-04-19 Pablo Sanchez-Martin , Kinaan Aamir Khan , Isabel Valera

Building machine-learning models for estimating traffic flows from OD matrices requires an appropriate design of the training process and a training dataset spanning over multiple regimes and dynamics. As machine-learning models rely…

Machine Learning · Computer Science 2026-03-10 Serio Agriesti , Guido Cantelmo , Francisco Camara Pereira

Existing Graph Neural Networks (GNNs) compute the message exchange between nodes by either aggregating uniformly (convolving) the features of all the neighboring nodes, or by applying a non-uniform score (attending) to the features. Recent…

Machine Learning · Computer Science 2023-03-02 Adrián Javaloy , Pablo Sanchez-Martin , Amit Levi , Isabel Valera

Deep learning is increasingly impacting various aspects of contemporary society. Artificial neural networks have emerged as the dominant models for solving an expanding range of tasks. The introduction of Neural Architecture Search (NAS)…

Machine Learning · Computer Science 2023-07-04 Simone Sarti , Eugenio Lomurno , Matteo Matteucci

Graphs are a highly expressive data structure, but it is often difficult for humans to find patterns from a complex graph. Hence, generating human-interpretable sequences from graphs have gained interest, called graph2seq learning. It is…

Machine Learning · Computer Science 2022-01-31 Takeshi D. Itoh , Takatomi Kubo , Kazushi Ikeda

While graph neural networks (GNNs) have shown a great potential in various tasks on graph, the lack of transparency has hindered understanding how GNNs arrived at its predictions. Although few explainers for GNNs are explored, the…

Machine Learning · Computer Science 2020-04-29 Chaojie Ji , Ruxin Wang , Hongyan Wu

This study delves into the application of graph neural networks in the realm of traffic forecasting, a crucial facet of intelligent transportation systems. Accurate traffic predictions are vital for functions like trip planning, traffic…

Machine Learning · Computer Science 2023-10-30 Razib Hayat Khan , Jonayet Miah , S M Yasir Arafat , M M Mahbubul Syeed , Duc M Ca

Vision Transformers (ViTs) have redefined image classification by leveraging self-attention to capture complex patterns and long-range dependencies between image patches. However, a key challenge for ViTs is efficiently incorporating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Shravan Venkatraman , Jaskaran Singh Walia , Joe Dhanith P R

Federated training methods have gained popularity for graph learning with applications including friendship graphs of social media sites and customer-merchant interaction graphs of huge online marketplaces. However, privacy regulations…

Machine Learning · Computer Science 2024-12-23 Siddharth Ambekar , Yuhang Yao , Ryan Li , Carlee Joe-Wong

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of…

Machine Learning · Computer Science 2021-01-29 Meiqi Zhu , Xiao Wang , Chuan Shi , Houye Ji , Peng Cui

Transformers achieve strong performance across diverse domains but implicitly assume Euclidean geometry in their attention mechanisms, limiting their effectiveness on data with non-Euclidean structure. While recent extensions to hyperbolic…

Machine Learning · Computer Science 2025-10-03 Ryan Y. Lin , Siddhartha Ojha , Nicholas Bai

Predicting relaxed atomic structures of chemically complex materials remains a major computational challenge, particularly for high-entropy systems where traditional first-principles methods become prohibitively expensive. We introduce the…

Disordered Systems and Neural Networks · Physics 2025-12-09 Neethu Mohan Mangalassery , Abhishek Kumar Singh

Few-Shot Industrial Visual Anomaly Detection (FS-IVAD) comprises a critical task in modern manufacturing settings, where automated product inspection systems need to identify rare defects using only a handful of normal/defect-free training…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Aggelos Psiris , Yannis Panagakis , Maria Vakalopoulou , Georgios Th. Papadopoulos

We propose an extension to the transformer neural network architecture for general-purpose graph learning by adding a dedicated pathway for pairwise structural information, called edge channels. The resultant framework - which we call…

Machine Learning · Computer Science 2022-06-06 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

As modern wireless communication networks grow increasingly complex, network outages driven by the inconsistency between dynamic topologies and protocol configurations have become a critical concern. To solve this issue, we mathematically…

Networking and Internet Architecture · Computer Science 2026-05-20 Xin Hao , Chenhan Zhang , Massimo Piccardi , Vijaya Durga Chemalamarri , Qiwen Jiang , Wei Ni , Raymond Owen