English
Related papers

Related papers: NAS-Bench-Graph: Benchmarking Graph Neural Archite…

200 papers

Neural architecture search (NAS) has gained immense popularity owing to its ability to automate neural architecture design. A number of training-free metrics are recently proposed to realize NAS without training, hence making NAS more…

Machine Learning · Computer Science 2022-10-13 Yao Shu , Zhongxiang Dai , Zhaoxuan Wu , Bryan Kian Hsiang Low

Graph Neural Networks (GNNs) are exemplary deep models designed for graph data. Message passing mechanism enables GNNs to effectively capture graph topology and push the performance boundaries across various graph tasks. However, the trend…

Neural and Evolutionary Computing · Computer Science 2025-09-29 Huizhe Zhang , Jintang Li , Yuchang Zhu , Liang Chen , Li Kuang

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

Neural and Evolutionary Computing · Computer Science 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

The advent of Graph Neural Networks (GNNs) has revolutionized the field of machine learning, offering a novel paradigm for learning on graph-structured data. Unlike traditional neural networks, GNNs are capable of capturing complex…

Hardware Architecture · Computer Science 2024-06-26 Kaustubh Shivdikar

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

Computation and Language · Computer Science 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach…

Machine Learning · Computer Science 2024-03-25 Rohan Asthana , Joschua Conrad , Youssef Dawoud , Maurits Ortmanns , Vasileios Belagiannis

Neural architecture search (NAS) relies on a good controller to generate better architectures or predict the accuracy of given architectures. However, training the controller requires both abundant and high-quality pairs of architectures…

Machine Learning · Computer Science 2020-11-04 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Despite advances in the field of Graph Neural Networks (GNNs), only a small number (~5) of datasets are currently used to evaluate new models. This continued reliance on a handful of datasets provides minimal insight into the performance…

Machine Learning · Computer Science 2022-07-11 John Palowitch , Anton Tsitsulin , Brandon Mayer , Bryan Perozzi

One of the primary challenges impeding the progress of Neural Architecture Search (NAS) is its extensive reliance on exorbitant computational resources. NAS benchmarks aim to simulate runs of NAS experiments at zero cost, remediating the…

Machine Learning · Computer Science 2024-06-19 Afzal Ahmad , Linfeng Du , Zhiyao Xie , Wei Zhang

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Wuyang Chen , Xinyu Gong , Zhangyang Wang

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Graph structured data is ubiquitous in daily life and scientific areas and has attracted increasing attention. Graph Neural Networks (GNNs) have been proved to be effective in modeling graph structured data and many variants of GNN…

Machine Learning · Computer Science 2022-04-07 Zhen Xu , Lanning Wei , Huan Zhao , Rex Ying , Quanming Yao , Wei-Wei Tu , Isabelle Guyon

Neural architecture search (NAS) has been extensively studied in the past few years. A popular approach is to represent each neural architecture in the search space as a directed acyclic graph (DAG), and then search over all DAGs by…

Machine Learning · Computer Science 2022-06-07 Colin White , Willie Neiswanger , Sam Nolen , Yash Savani

Predicting the properties of a molecule from its structure is a challenging task. Recently, deep learning methods have improved the state of the art for this task because of their ability to learn useful features from the given data. By…

Machine Learning · Computer Science 2020-08-28 Shengli Jiang , Prasanna Balaprakash

The exploration of Graph Neural Networks (GNNs) for processing graph-structured data has expanded, particularly their potential for causal analysis due to their universal approximation capabilities. Anticipated to significantly enhance…

Machine Learning · Computer Science 2024-01-30 Simi Job , Xiaohui Tao , Taotao Cai , Lin Li , Haoran Xie , Jianming Yong

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Graph classification is an important area in both modern research and industry. Multiple applications, especially in chemistry and novel drug discovery, encourage rapid development of machine learning models in this area. To keep up with…

Machine Learning · Computer Science 2022-11-08 Jakub Adamczyk