中文
相关论文

相关论文: GNAS: A Greedy Neural Architecture Search Method f…

200 篇论文

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

机器学习 · 计算机科学 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Differentiable architecture search is prevalent in the field of NAS because of its simplicity and efficiency, where two paradigms, multi-path algorithms and single-path methods, are dominated. Multi-path framework (e.g. DARTS) is intuitive…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Haoxian Tan , Sheng Guo , Yujie Zhong , Matthew R. Scott , Weilin Huang

We propose a new scalable method to optimize the architecture of an artificial neural network. The proposed algorithm, called Greedy Search for Neural Network Architecture, aims to determine a neural network with minimal number of layers…

机器学习 · 计算机科学 2021-04-30 Massimiliano Lupo Pasini , Junqi Yin , Ying Wai Li , Markus Eisenbach

Deep learning methods have become very successful at solving many complex tasks such as image classification and segmentation, speech recognition and machine translation. Nevertheless, manually designing a neural network for a specific…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Maria Baldeon Calisto , Susana Lai-Yuen

In this paper, we investigate a new variant of neural architecture search (NAS) paradigm -- searching with random labels (RLNAS). The task sounds counter-intuitive for most existing NAS algorithms since random label provides few information…

计算机视觉与模式识别 · 计算机科学 2021-05-26 Xuanyang Zhang , Pengfei Hou , Xiangyu Zhang , Jian Sun

Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival…

机器学习 · 计算机科学 2022-10-07 Andrea Falanti , Eugenio Lomurno , Stefano Samele , Danilo Ardagna , Matteo Matteucci

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To…

机器学习 · 计算机科学 2025-09-03 Zhao Wei , Chin Chun Ooi , Yew-Soon Ong

Neural Architecture Search (NAS) algorithms aim at finding efficient Deep Neural Network (DNN) architectures for a given application under given system constraints. DNNs are computationally-complex as well as vulnerable to adversarial…

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal

Automated machine learning (AutoML) has seen a resurgence in interest with the boom of deep learning over the past decade. In particular, Neural Architecture Search (NAS) has seen significant attention throughout the AutoML research…

神经与进化计算 · 计算机科学 2020-09-23 Min Shi , David A. Wilson , Xingquan Zhu , Yu Huang , Yuan Zhuang , Jianxun Liu , Yufei Tang

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

机器学习 · 统计学 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

The recent progress in neural architecture search (NAS) has allowed scaling the automated design of neural architectures to real-world domains, such as object detection and semantic segmentation. However, one prerequisite for the…

机器学习 · 计算机科学 2021-06-15 Thomas Elsken , Benedikt Staffler , Jan Hendrik Metzen , Frank Hutter

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

机器学习 · 计算机科学 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared with gradient-based approaches, due to the rollout…

机器学习 · 计算机科学 2021-05-28 Jihao Liu , Ming Zhang , Yangting Sun , Boxiao Liu , Guanglu Song , Yu Liu , Hongsheng Li

Recently, some Neural Architecture Search (NAS) techniques are proposed for the automatic design of Graph Convolutional Network (GCN) architectures. They bring great convenience to the use of GCN, but could hardly apply to the Federated…

机器学习 · 计算机科学 2021-04-12 Chunnan Wang , Bozhou Chen , Geng Li , Hongzhi Wang

Neural Architecture Search (NAS) has shown promising capability in learning text representation. However, existing text-based NAS neither performs a learnable fusion of neural operations to optimize the architecture, nor encodes the latent…

计算与语言 · 计算机科学 2023-07-13 Kuan-Chun Chen , Cheng-Te Li , Kuo-Jung Lee

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

机器学习 · 计算机科学 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia