中文
相关论文

相关论文: Heterogeneous Graph Neural Architecture Search wit…

200 篇论文

To search an optimal sub-network within a general deep neural network (DNN), existing neural architecture search (NAS) methods typically rely on handcrafting a search space beforehand. Such requirements make it challenging to extend them…

机器学习 · 计算机科学 2023-10-09 Tianyi Chen , Luming Liang , Tianyu Ding , Ilya Zharkov

Deep Graph Neural Networks (GNNs) show promising performance on a range of graph tasks, yet at present are costly to run and lack many of the optimisations applied to DNNs. We show, for the first time, how to systematically quantise GNNs…

机器学习 · 计算机科学 2020-09-22 Yiren Zhao , Duo Wang , Daniel Bates , Robert Mullins , Mateja Jamnik , Pietro Lio

Neural architecture search (NAS) automatically finds the best task-specific neural network topology, outperforming many manual architecture designs. However, it can be prohibitively expensive as the search requires training thousands of…

机器学习 · 计算机科学 2020-12-21 Chris Zhang , Mengye Ren , Raquel Urtasun

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Graph neural networks (GNNs) have been successfully applied to learning representation on graphs in many relational tasks. Recently, researchers study neural architecture search (NAS) to reduce the dependence of human expertise and explore…

机器学习 · 计算机科学 2021-09-06 Shaofei Cai , Liang Li , Xinzhe Han , Zheng-jun Zha , Qingming Huang

Heterogeneous Graph Neural Network (HGNN) has been successfully employed in various tasks, but we cannot accurately know the importance of different design dimensions of HGNNs due to diverse architectures and applied scenarios. Besides, in…

机器学习 · 计算机科学 2022-05-16 Tianyu Zhao , Cheng Yang , Yibo Li , Quan Gan , Zhenyi Wang , Fengqi Liang , Huan Zhao , Yingxia Shao , Xiao Wang , Chuan Shi

Graph neural architecture search (GraphNAS) has recently aroused considerable attention in both academia and industry. However, two key challenges seriously hinder the further research of GraphNAS. First, since there is no consensus for the…

机器学习 · 计算机科学 2024-03-12 Yijian Qin , Ziwei Zhang , Xin Wang , Zeyang Zhang , Wenwu Zhu

In this paper, we present a novel multi-objective hardware-aware neural architecture search (NAS) framework, namely HSCoNAS, to automate the design of deep neural networks (DNNs) with high accuracy but low latency upon target hardware. To…

机器学习 · 计算机科学 2021-03-16 Xiangzhong Luo , Di Liu , Shuo Huai , Weichen Liu

Graph neural architecture search (GNAS) can customize high-performance graph neural network architectures for specific graph tasks or datasets. However, existing GNAS methods begin searching for architectures from a zero-knowledge state,…

神经与进化计算 · 计算机科学 2024-11-27 Chao Wang , Jiaxuan Zhao , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Shuyuan Yang

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

机器学习 · 计算机科学 2024-04-25 Haoming Zhang , Ran Cheng

Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent…

机器学习 · 计算机科学 2024-09-04 Jun Hu , Bryan Hooi , Bingsheng He

Neural architectures can be naturally viewed as computational graphs. Motivated by this perspective, we, in this paper, study neural architecture search (NAS) through the lens of learning random graph models. In contrast to existing NAS…

机器学习 · 计算机科学 2022-11-29 Muchen Li , Jeffrey Yunfan Liu , Leonid Sigal , Renjie Liao

Heterogeneous graph neural networks (HGNNs) have attracted increasing research interest in recent three years. Most existing HGNNs fall into two classes. One class is meta-path-based HGNNs which either require domain knowledge to handcraft…

机器学习 · 计算机科学 2022-09-02 Nan Wu , Chaofan Wang

Graph Neural Architecture Search (GNAS) has achieved superior performance on various graph-structured tasks. However, existing GNAS studies overlook the applications of GNAS in resource-constraint scenarios. This paper proposes to design a…

机器学习 · 计算机科学 2024-06-25 Beini Xie , Heng Chang , Ziwei Zhang , Zeyang Zhang , Simin Wu , Xin Wang , Yuan Meng , Wenwu Zhu

Architecture design has become a crucial component of successful deep learning. Recent progress in automatic neural architecture search (NAS) shows a lot of promise. However, discovered architectures often fail to generalize in the final…

机器学习 · 计算机科学 2020-04-03 Guohao Li , Guocheng Qian , Itzel C. Delgadillo , Matthias Müller , Ali Thabet , Bernard Ghanem

Approximate nearest neighbor (ANN) search in high dimensions is an integral part of several computer vision systems and gains importance in deep learning with explicit memory representations. Since PQT, FAISS, and SONG started to leverage…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Fabian Groh , Lukas Ruppert , Patrick Wieschollek , Hendrik P. A. Lensch

Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks…

机器学习 · 计算机科学 2023-09-04 Xiaocheng Yang , Mingyu Yan , Shirui Pan , Xiaochun Ye , Dongrui Fan

Convolutional neural networks (CNNs) are effective at solving difficult problems like visual recognition, speech recognition and natural language processing. However, performance gain comes at the cost of laborious trial-and-error in…

神经与进化计算 · 计算机科学 2018-12-20 Yiheng Zhu , Yichen Yao , Zili Wu , Yujie Chen , Guozheng Li , Haoyuan Hu , Yinghui Xu

Graph neural architecture search (GraphNAS) has demonstrated advantages in mitigating performance degradation of graph neural networks (GNNs) due to distribution shifts. Recent approaches introduce weight sharing across tailored…

机器学习 · 计算机科学 2025-03-07 Qiyi Wang , Yinning Shao , Yunlong Ma , Min Liu

In real-world applications, spectral Graph Neural Networks (GNNs) are powerful tools for processing diverse types of graphs. However, a single GNN often struggles to handle different graph types-such as homogeneous and heterogeneous…

机器学习 · 计算机科学 2024-12-19 Shibing Mo , Kai Wu , Qixuan Gao , Xiangyi Teng , Jing Liu