中文
相关论文

相关论文: Posterior-Guided Neural Architecture Search

200 篇论文

Neural Architecture Search (NAS) is emerging as a new research direction which has the potential to replace the hand-crafted neural architectures designed for specific tasks. Previous evolution based architecture search requires high…

神经与进化计算 · 计算机科学 2020-12-24 Nilotpal Sinha , Kuan-Wen Chen

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

We achieve very efficient deep learning model deployment that designs neural network architectures to fit different hardware constraints. Given a constraint, most neural architecture search (NAS) methods either sample a set of sub-networks…

计算机视觉与模式识别 · 计算机科学 2020-04-10 Sian-Yao Huang , Wei-Ta Chu

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo

Neural architecture search (NAS) methods have been proposed to release human experts from tedious architecture engineering. However, most current methods are constrained in small-scale search due to the issue of computational resources.…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Jiemin Fang , Yukang Chen , Xinbang Zhang , Qian Zhang , Chang Huang , Gaofeng Meng , Wenyu Liu , Xinggang Wang

Training a supernet matters for one-shot neural architecture search (NAS) methods since it serves as a basic performance estimator for different architectures (paths). Current methods mainly hold the assumption that a supernet should give a…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Shan You , Tao Huang , Mingmin Yang , Fei Wang , Chen Qian , Changshui Zhang

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural Architecture Search (NAS) that aims to automate the procedure of architecture design has achieved promising results in many computer vision fields. In this paper, we propose an AdversarialNAS method specially tailored for Generative…

计算机视觉与模式识别 · 计算机科学 2020-04-09 Chen Gao , Yunpeng Chen , Si Liu , Zhenxiong Tan , Shuicheng Yan

Neural architectures can be naturally viewed as computational graphs. Motivated by this perspective, we, in this paper, study neural architecture search (NAS) through the lens of learning random graph models. In contrast to existing NAS…

机器学习 · 计算机科学 2022-11-29 Muchen Li , Jeffrey Yunfan Liu , Leonid Sigal , Renjie Liao

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

机器学习 · 计算机科学 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

Neural architecture search (NAS) is a promising method for automatically design neural architectures. NAS adopts a search strategy to explore the predefined search space to find outstanding performance architecture with the minimum…

机器学习 · 计算机科学 2020-09-11 Chen Wei , Chuang Niu , Yiping Tang , Yue Wang , Haihong Hu , Jimin Liang

Despite the empirical success of neural architecture search (NAS) in deep learning applications, the optimality, reproducibility and cost of NAS schemes remain hard to assess. In this paper, we propose Generative Adversarial NAS (GA-NAS)…

机器学习 · 计算机科学 2021-06-24 Seyed Saeed Changiz Rezaei , Fred X. Han , Di Niu , Mohammad Salameh , Keith Mills , Shuo Lian , Wei Lu , Shangling Jui

Neural Architecture Search (NAS) represents a class of methods to generate the optimal neural network architecture and typically iterate over candidate architectures till convergence over some particular metric like validation loss. They…

机器学习 · 计算机科学 2019-10-22 Abhishek Singh , Anubhav Garg , Jinan Zhou , Shiv Ram Dubey , Debo Dutta

In one-shot NAS, sub-networks need to be searched from the supernet to meet different hardware constraints. However, the search cost is high and $N$ times of searches are needed for $N$ different constraints. In this work, we propose a…

计算机视觉与模式识别 · 计算机科学 2021-03-15 Sian-Yao Huang , Wei-Ta Chu

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Efficient search is a core issue in Neural Architecture Search (NAS). It is difficult for conventional NAS algorithms to directly search the architectures on large-scale tasks like ImageNet. In general, the cost of GPU hours for NAS grows…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Xiyang Dai , Dongdong Chen , Mengchen Liu , Yinpeng Chen , Lu Yuan

To address the weight coupling problem, certain studies introduced few-shot Neural Architecture Search (NAS) methods, which partition the supernet into multiple sub-supernets. However, these methods often suffer from computational…

机器学习 · 计算机科学 2025-06-23 Wenhao Song , Xuan Wu , Bo Yang , You Zhou , Yubin Xiao , Yanchun Liang , Hongwei Ge , Heow Pueh Lee , Chunguo Wu

Bayesian Neural Networks (BNNs) offer a mathematically grounded framework to quantify the uncertainty of model predictions but come with a prohibitive computation cost for both training and inference. In this work, we show a novel network…

机器学习 · 计算机科学 2022-02-10 Duo Wang , Yiren Zhao , Ilia Shumailov , Robert Mullins

This paper addresses the difficult problem of finding an optimal neural architecture design for a given image classification task. We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture…

计算机视觉与模式识别 · 计算机科学 2018-08-02 Juan-Manuel Perez-Rua , Moez Baccouche , Stephane Pateux