English
Related papers

Related papers: Efficient Global Neural Architecture Search

200 papers

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture.…

Machine Learning · Computer Science 2019-09-11 Kaixiong Zhou , Qingquan Song , Xiao Huang , Xia Hu

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

Machine Learning · Computer Science 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

Image and Video Processing · Electrical Eng. & Systems 2019-07-29 Nils Gessert , Alexander Schlaefer

The searching procedure of neural architecture search (NAS) is notoriously time consuming and cost prohibitive.To make the search space continuous, most existing gradient-based NAS methods relax the categorical choice of a particular…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Shoufa Chen , Yunpeng Chen , Shuicheng Yan , Jiashi Feng

Recent advances in adversarial attacks show the vulnerability of deep neural networks searched by Neural Architecture Search (NAS). Although NAS methods can find network architectures with the state-of-the-art performance, the adversarial…

Machine Learning · Computer Science 2020-11-20 Zhixiong Yue , Baijiong Lin , Xiaonan Huang , Yu Zhang

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as expert-crafted architectures. While most existing works aim at finding architectures that optimize the prediction…

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Neural Architecture Search (NAS) has attracted growing interest. To reduce the search cost, recent work has explored weight sharing across models and made major progress in One-Shot NAS. However, it has been observed that a model with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Xin Xia , Xuefeng Xiao , Xing Wang , Min Zheng

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

Machine Learning · Computer Science 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

Neural and Evolutionary Computing · Computer Science 2020-10-28 Matheus Nunes , Gisele L. Pappa

Neural Architecture Search (NAS) has received increasing attention because of its exceptional merits in automating the design of Deep Neural Network (DNN) architectures. However, the performance evaluation process, as a key part of NAS,…

Neural and Evolutionary Computing · Computer Science 2024-10-10 Xiaotian Song , Xiangning Xie , Zeqiong Lv , Gary G. Yen , Weiping Ding , Jiancheng Lv , Yanan Sun

Automatic neural architecture design has shown its potential in discovering powerful neural network architectures. Existing methods, no matter based on reinforcement learning or evolutionary algorithms (EA), conduct architecture search in a…

Machine Learning · Computer Science 2019-09-05 Renqian Luo , Fei Tian , Tao Qin , Enhong Chen , Tie-Yan Liu

Recently, the expert-crafted neural architectures is increasing overtaken by the utilization of neural architecture search (NAS) and automatic generation (and tuning) of network structures which has a close relation to the Hyperparameter…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Seyed Mahdi Shariatzadeh , Mahmood Fathy , Reza Berangi , Mohammad Shahverdy

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen
‹ Prev 1 3 4 5 6 7 10 Next ›