中文
相关论文

相关论文: Towards Efficient Few-shot Graph Neural Architectu…

200 篇论文

Early neural network architectures were designed by so-called "grad student descent". Since then, the field of Neural Architecture Search (NAS) has developed with the goal of algorithmically designing architectures tailored for a dataset of…

机器学习 · 计算机科学 2019-11-14 Sam Green , Craig M. Vineyard , Ryan Helinski , Çetin Kaya Koç

One-shot methods have significantly advanced the field of neural architecture search (NAS) by adopting weight-sharing strategy to reduce search costs. However, the accuracy of performance estimation can be compromised by co-adaptation.…

机器学习 · 计算机科学 2024-12-17 Jianfeng Li , Jiawen Zhang , Feng Wang , Lianbo Ma

Recent state-of-the-art methods for neural architecture search (NAS) exploit gradient-based optimization by relaxing the problem into continuous optimization over architectures and shared-weights, a noisy process that remains poorly…

机器学习 · 计算机科学 2021-03-19 Liam Li , Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Weight-sharing Neural Architecture Search (WS-NAS) provides an efficient mechanism for developing end-to-end deep recommender models. However, in complex search spaces, distinguishing between superior and inferior architectures (or paths)…

机器学习 · 计算机科学 2023-11-01 Yufan Cao , Tunhou Zhang , Wei Wen , Feng Yan , Hai Li , Yiran Chen

Automatic methods for Neural Architecture Search (NAS) have been shown to produce state-of-the-art network models. Yet, their main drawback is the computational complexity of the search process. As some primal methods optimized over a…

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Effective and efficient graph representation learning is essential for enabling critical downstream tasks, such as node classification, link prediction, and subgraph search. However, existing graph neural network (GNN) architectures often…

机器学习 · 计算机科学 2025-09-24 Sixuan Wang , Jiao Yin , Jinli Cao , MingJian Tang , Hua Wang , Yanchun Zhang

Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures.…

机器学习 · 计算机科学 2020-11-26 Han Shi , Renjie Pi , Hang Xu , Zhenguo Li , James T. Kwok , Tong Zhang

One-shot neural architecture search (NAS) applies weight-sharing supernet to reduce the unaffordable computation overhead of automated architecture designing. However, the weight-sharing technique worsens the ranking consistency of…

计算机视觉与模式识别 · 计算机科学 2021-08-13 Ziwei Yang , Ruyi Zhang , Zhi Yang , Xubo Yang , Lei Wang , Zheyang Li

Differentiable architecture search is prevalent in the field of NAS because of its simplicity and efficiency, where two paradigms, multi-path algorithms and single-path methods, are dominated. Multi-path framework (e.g. DARTS) is intuitive…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Haoxian Tan , Sheng Guo , Yujie Zhong , Matthew R. Scott , Weilin Huang

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

GNAS (Graph Neural Architecture Search) has demonstrated great effectiveness in automatically designing the optimal graph neural architectures for multiple downstream tasks, such as node classification and link prediction. However, most…

机器学习 · 计算机科学 2024-12-04 Guanghui Zhu , Zipeng Ji , Jingyan Chen , Limin Wang , Chunfeng Yuan , Yihua Huang

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

神经与进化计算 · 计算机科学 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

机器学习 · 计算机科学 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Graph classification is an important problem with applications across many domains, like chemistry and bioinformatics, for which graph neural networks (GNNs) have been state-of-the-art (SOTA) methods. GNNs are designed to learn node-level…

机器学习 · 计算机科学 2021-08-25 Lanning Wei , Huan Zhao , Quanming Yao , Zhiqiang He

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

机器学习 · 计算机科学 2024-04-25 Haoming Zhang , Ran Cheng

This paper aims at enlarging the problem of Neural Architecture Search (NAS) from Single-Path and Multi-Path Search to automated Mixed-Path Search. In particular, we model the NAS problem as a sparse supernet using a new continuous…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Yan Wu , Aoming Liu , Zhiwu Huang , Siwei Zhang , Luc Van Gool

There is a growing interest in automated neural architecture search (NAS). To improve the efficiency of NAS, previous approaches adopt weight sharing method to force all models share the same set of weights. However, it has been observed…

计算机视觉与模式识别 · 计算机科学 2019-10-08 Xiang Li , Chen Lin , Chuming Li , Ming Sun , Wei Wu , Junjie Yan , Wanli Ouyang

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

神经与进化计算 · 计算机科学 2020-10-28 Matheus Nunes , Gisele L. Pappa

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei