English
Related papers

Related papers: Which Hyperparameters to Optimise? An Investigatio…

200 papers

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Hyperparameter optimization is a challenging problem in developing deep neural networks. Decision of transfer layers and trainable layers is a major task for design of the transfer convolutional neural networks (CNN). Conventional transfer…

Neural and Evolutionary Computing · Computer Science 2021-03-08 Chen Li , JinZhe Jiang , YaQian Zhao , RenGang Li , EnDong Wang , Xin Zhang , Kun Zhao

Graph neural networks (GNNs) learn the representation of graph-structured data, and their expressiveness can be further enhanced by inferring node relations for propagation. Attention-based GNNs infer neighbor importance to manipulate the…

Machine Learning · Computer Science 2023-06-06 Soo Yong Lee , Fanchen Bu , Jaemin Yoo , Kijung Shin

Graph neural network have achieved impressive results in predicting molecular properties, but they do not directly account for local and hidden structures in the graph such as functional groups and molecular geometry. At each propagation…

Machine Learning · Computer Science 2020-02-25 Daniel Flam-Shepherd , Tony Wu , Pascal Friederich , Alan Aspuru-Guzik

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity,…

Machine Learning · Computer Science 2023-10-18 Jiawang Dan , Ruofan Wu , Yunpeng Liu , Baokun Wang , Changhua Meng , Tengfei Liu , Tianyi Zhang , Ningtao Wang , Xing Fu , Qi Li , Weiqiang Wang

Deep learning models are defined in terms of a large number of hyperparameters, such as network architectures and optimiser settings. These hyperparameters must be determined separately from the model parameters such as network weights, and…

High Energy Physics - Phenomenology · Physics 2024-10-22 Juan Cruz-Martinez , Aaron Jansen , Gijs van Oord , Tanjona R. Rabemananjara , Carlos M. R. Rocha , Juan Rojo , Roy Stegeman

Graph Convolutional Networks (GCNs) have recently become the primary choice for learning from graph-structured data, superseding hash fingerprints in representing chemical compounds. However, GCNs lack the ability to take into account the…

Machine Learning · Computer Science 2020-07-03 Tomasz Danel , Przemysław Spurek , Jacek Tabor , Marek Śmieja , Łukasz Struski , Agnieszka Słowik , Łukasz Maziarka

Over the past decade, Graph Neural Networks (GNNs) have transformed graph representation learning. In the widely adopted message-passing GNN framework, nodes refine their representations by aggregating information from neighboring nodes…

Machine Learning · Computer Science 2025-11-26 Astrit Tola , Jack Myrick , Baris Coskunuzer

Prediction of molecular properties, including physico-chemical properties, is a challenging task in chemistry. Herein we present a new state-of-the-art multitask prediction method based on existing graph neural network models. We have used…

Machine Learning · Computer Science 2019-10-31 Fabio Capela , Vincent Nouchi , Ruud Van Deursen , Igor V. Tetko , Guillaume Godin

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Graph Neural Networks (GNNs) have achieved remarkable success in various graph mining tasks by aggregating information from neighborhoods for representation learning. The success relies on the homophily assumption that nearby nodes exhibit…

Machine Learning · Computer Science 2024-06-03 Zhuonan Zheng , Sheng Zhou , Hongjia Xu , Ming Gu , Yilun Xu , Ao Li , Yuhong Li , Jingjun Gu , Jiajun Bu

Graph Neural Networks (GNNs) have achieved significant success in addressing node classification tasks. However, the effectiveness of traditional GNNs degrades on heterophilic graphs, where connected nodes often belong to different labels…

Machine Learning · Computer Science 2025-11-11 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Graph Neural Networks (GNNs) have emerged as a powerful framework for modeling complex interconnected systems, hence making them particularly well-suited to address the growing challenges of next-generation Internet of Things (NG-IoT)…

Information Theory · Computer Science 2025-09-18 Nguyen Xuan Tung , Le Tung Giang , Bui Duc Son , Seon Geun Jeong , Trinh Van Chien , Won Joo Hwang , Lajos Hanzo

Graph convolution networks (GCNs) have been enormously successful in learning representations over several graph-based machine learning tasks. Specific to learning rich node representations, most of the methods have solely relied on the…

Machine Learning · Computer Science 2022-11-03 Ashish Tiwari , Sresth Tosniwal , Shanmuganathan Raman

Graph-structured data is ubiquitous throughout natural and social sciences, and Graph Neural Networks (GNNs) have recently been shown to be effective at solving prediction and inference problems on graph data. In this paper, we propose and…

Machine Learning · Computer Science 2024-01-12 Victoria M. Dax , Jiachen Li , Kevin Leahy , Mykel J. Kochenderfer

Accurate prediction of molecular properties is essential in drug discovery and related fields. However, existing graph neural networks (GNNs) often struggle to simultaneously capture both local and global molecular structures. In this work,…

Machine Learning · Computer Science 2025-08-26 XiaYu Liu , Chao Fan , Yang Liu , Hou-biao Li

Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture.…

Machine Learning · Computer Science 2019-09-11 Kaixiong Zhou , Qingquan Song , Xiao Huang , Xia Hu

Interpreting graph neural networks (GNNs) is difficult because message passing mixes signals and internal channels rarely align with human concepts. We study superposition, the sharing of directions by multiple features, directly in the…

Machine Learning · Computer Science 2026-01-19 Lukas Pertl , Han Xuanyuan , Pietro Liò

Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent years owing to their capability to model and learn from graph-structured data. Such an ability has strong implications in a wide variety of fields whose…

Machine Learning · Computer Science 2021-07-26 Sergi Abadal , Akshay Jain , Robert Guirado , Jorge López-Alonso , Eduard Alarcón