中文
相关论文

相关论文: BigNAS: Scaling Up Neural Architecture Search with…

200 篇论文

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

机器学习 · 计算机科学 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Neural Architecture Search (NAS) for automatically finding the optimal network architecture has shown some success with competitive performances in various computer vision tasks. However, NAS in general requires a tremendous amount of…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Bokyeung Lee , Kyungdeuk Ko , Jonghwan Hong , Hanseok Ko

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural architecture search (NAS) has gained immense popularity owing to its ability to automate neural architecture design. A number of training-free metrics are recently proposed to realize NAS without training, hence making NAS more…

机器学习 · 计算机科学 2022-10-13 Yao Shu , Zhongxiang Dai , Zhaoxuan Wu , Bryan Kian Hsiang Low

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

机器学习 · 计算机科学 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

机器学习 · 计算机科学 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Designing complex architectures has been an essential cogwheel in the revolution deep learning has brought about in the past decade. When solving difficult problems in a datadriven manner, a well-tried approach is to take an architecture…

机器学习 · 计算机科学 2021-10-14 Attila Nagy , Ábel Boros

We present BN-NAS, neural architecture search with Batch Normalization (BN-NAS), to accelerate neural architecture search (NAS). BN-NAS can significantly reduce the time required by model training and evaluation in NAS. Specifically, for…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Boyu Chen , Peixia Li , Baopu Li , Chen Lin , Chuming Li , Ming Sun , Junjie Yan , Wanli Ouyang

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

One-shot methods have significantly advanced the field of neural architecture search (NAS) by adopting weight-sharing strategy to reduce search costs. However, the accuracy of performance estimation can be compromised by co-adaptation.…

机器学习 · 计算机科学 2024-12-17 Jianfeng Li , Jiawen Zhang , Feng Wang , Lianbo Ma

Neural Architecture Search (NAS) has been widely studied for designing discriminative deep learning models such as image classification, object detection, and semantic segmentation. As a large number of priors have been obtained through the…

计算机视觉与模式识别 · 计算机科学 2019-06-07 Jie An , Haoyi Xiong , Jinwen Ma , Jiebo Luo , Jun Huan

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

We present an elegant framework of fine-grained neural architecture search (FGNAS), which allows to employ multiple heterogeneous operations within a single layer and can even generate compositional feature maps using several different base…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Heewon Kim , Seokil Hong , Bohyung Han , Heesoo Myeong , Kyoung Mu Lee

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

机器学习 · 计算机科学 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Reinforcement learning (RL)-based neural architecture search (NAS) generally guarantees better convergence yet suffers from the requirement of huge computational resources compared with gradient-based approaches, due to the rollout…

机器学习 · 计算机科学 2021-05-28 Jihao Liu , Ming Zhang , Yangting Sun , Boxiao Liu , Guanglu Song , Yu Liu , Hongsheng Li

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo

This paper addresses the difficult problem of finding an optimal neural architecture design for a given image classification task. We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture…

计算机视觉与模式识别 · 计算机科学 2018-08-02 Juan-Manuel Perez-Rua , Moez Baccouche , Stephane Pateux

One-shot Neural Architecture Search (NAS) has been widely used to discover architectures due to its efficiency. However, previous studies reveal that one-shot performance estimations of architectures might not be well correlated with their…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Zixuan Zhou , Xuefei Ning , Yi Cai , Jiashu Han , Yiping Deng , Yuhan Dong , Huazhong Yang , Yu Wang

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

机器学习 · 计算机科学 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto