English
Related papers

Related papers: Towards Efficient Few-shot Graph Neural Architectu…

200 papers

Early neural network architectures were designed by so-called "grad student descent". Since then, the field of Neural Architecture Search (NAS) has developed with the goal of algorithmically designing architectures tailored for a dataset of…

Machine Learning · Computer Science 2019-11-14 Sam Green , Craig M. Vineyard , Ryan Helinski , Çetin Kaya Koç

One-shot methods have significantly advanced the field of neural architecture search (NAS) by adopting weight-sharing strategy to reduce search costs. However, the accuracy of performance estimation can be compromised by co-adaptation.…

Machine Learning · Computer Science 2024-12-17 Jianfeng Li , Jiawen Zhang , Feng Wang , Lianbo Ma

Recent state-of-the-art methods for neural architecture search (NAS) exploit gradient-based optimization by relaxing the problem into continuous optimization over architectures and shared-weights, a noisy process that remains poorly…

Machine Learning · Computer Science 2021-03-19 Liam Li , Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Weight-sharing Neural Architecture Search (WS-NAS) provides an efficient mechanism for developing end-to-end deep recommender models. However, in complex search spaces, distinguishing between superior and inferior architectures (or paths)…

Machine Learning · Computer Science 2023-11-01 Yufan Cao , Tunhou Zhang , Wei Wen , Feng Yan , Hai Li , Yiran Chen

Automatic methods for Neural Architecture Search (NAS) have been shown to produce state-of-the-art network models. Yet, their main drawback is the computational complexity of the search process. As some primal methods optimized over a…

Machine Learning · Statistics 2019-10-11 Asaf Noy , Niv Nayman , Tal Ridnik , Nadav Zamir , Sivan Doveh , Itamar Friedman , Raja Giryes , Lihi Zelnik-Manor

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

Machine Learning · Computer Science 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Effective and efficient graph representation learning is essential for enabling critical downstream tasks, such as node classification, link prediction, and subgraph search. However, existing graph neural network (GNN) architectures often…

Machine Learning · Computer Science 2025-09-24 Sixuan Wang , Jiao Yin , Jinli Cao , MingJian Tang , Hua Wang , Yanchun Zhang

Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures.…

Machine Learning · Computer Science 2020-11-26 Han Shi , Renjie Pi , Hang Xu , Zhenguo Li , James T. Kwok , Tong Zhang

One-shot neural architecture search (NAS) applies weight-sharing supernet to reduce the unaffordable computation overhead of automated architecture designing. However, the weight-sharing technique worsens the ranking consistency of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ziwei Yang , Ruyi Zhang , Zhi Yang , Xubo Yang , Lei Wang , Zheyang Li

Differentiable architecture search is prevalent in the field of NAS because of its simplicity and efficiency, where two paradigms, multi-path algorithms and single-path methods, are dominated. Multi-path framework (e.g. DARTS) is intuitive…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Haoxian Tan , Sheng Guo , Yujie Zhong , Matthew R. Scott , Weilin Huang

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

Machine Learning · Computer Science 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

GNAS (Graph Neural Architecture Search) has demonstrated great effectiveness in automatically designing the optimal graph neural architectures for multiple downstream tasks, such as node classification and link prediction. However, most…

Machine Learning · Computer Science 2024-12-04 Guanghui Zhu , Zipeng Ji , Jingyan Chen , Limin Wang , Chunfeng Yuan , Yihua Huang

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

Neural and Evolutionary Computing · Computer Science 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

Machine Learning · Computer Science 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Graph classification is an important problem with applications across many domains, like chemistry and bioinformatics, for which graph neural networks (GNNs) have been state-of-the-art (SOTA) methods. GNNs are designed to learn node-level…

Machine Learning · Computer Science 2021-08-25 Lanning Wei , Huan Zhao , Quanming Yao , Zhiqiang He

Neural Architecture Search (NAS) has emerged as a key tool in identifying optimal configurations of deep neural networks tailored to specific tasks. However, training and assessing numerous architectures introduces considerable…

Machine Learning · Computer Science 2024-04-25 Haoming Zhang , Ran Cheng

This paper aims at enlarging the problem of Neural Architecture Search (NAS) from Single-Path and Multi-Path Search to automated Mixed-Path Search. In particular, we model the NAS problem as a sparse supernet using a new continuous…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yan Wu , Aoming Liu , Zhiwu Huang , Siwei Zhang , Luc Van Gool

There is a growing interest in automated neural architecture search (NAS). To improve the efficiency of NAS, previous approaches adopt weight sharing method to force all models share the same set of weights. However, it has been observed…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Xiang Li , Chen Lin , Chuming Li , Ming Sun , Wei Wu , Junjie Yan , Wanli Ouyang

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

Neural and Evolutionary Computing · Computer Science 2020-10-28 Matheus Nunes , Gisele L. Pappa

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei