中文
相关论文

相关论文: FP-NAS: Fast Probabilistic Neural Architecture Sea…

200 篇论文

We present the first differentiable Network Architecture Search (NAS) for Graph Neural Networks (GNNs). GNNs show promising performance on a wide range of tasks, but require a large amount of architecture engineering. First, graphs are…

机器学习 · 计算机科学 2020-03-24 Yiren Zhao , Duo Wang , Xitong Gao , Robert Mullins , Pietro Lio , Mateja Jamnik

Search space design is very critical to neural architecture search (NAS) algorithms. We propose a fine-grained search space comprised of atomic blocks, a minimal search unit that is much smaller than the ones used in recent NAS algorithms.…

计算机视觉与模式识别 · 计算机科学 2020-02-25 Jieru Mei , Yingwei Li , Xiaochen Lian , Xiaojie Jin , Linjie Yang , Alan Yuille , Jianchao Yang

Efficient search is a core issue in Neural Architecture Search (NAS). It is difficult for conventional NAS algorithms to directly search the architectures on large-scale tasks like ImageNet. In general, the cost of GPU hours for NAS grows…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Xiyang Dai , Dongdong Chen , Mengchen Liu , Yinpeng Chen , Lu Yuan

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

机器学习 · 计算机科学 2019-08-01 Liam Li , Ameet Talwalkar

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

Neural architecture search (NAS) has shown promising results discovering models that are both accurate and fast. For NAS, training a one-shot model has become a popular strategy to rank the relative quality of different architectures (child…

计算机视觉与模式识别 · 计算机科学 2020-07-20 Jiahui Yu , Pengchong Jin , Hanxiao Liu , Gabriel Bender , Pieter-Jan Kindermans , Mingxing Tan , Thomas Huang , Xiaodan Song , Ruoming Pang , Quoc Le

Neural Architecture Search (NAS) has been widely adopted to design accurate and efficient image classification models. However, applying NAS to a new computer vision task still requires a huge amount of effort. This is because 1) previous…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Bichen Wu , Chaojian Li , Hang Zhang , Xiaoliang Dai , Peizhao Zhang , Matthew Yu , Jialiang Wang , Yingyan Celine Lin , Peter Vajda

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

机器学习 · 计算机科学 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Recently Neural Architecture Search (NAS) has aroused great interest in both academia and industry, however it remains challenging because of its huge and non-continuous search space. Instead of applying evolutionary algorithm or…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Xinbang Zhang , Zehao Huang , Naiyan Wang

The success of deep neural networks relies on significant architecture engineering. Recently neural architecture search (NAS) has emerged as a promise to greatly reduce manual effort in network design by automatically searching for optimal…

计算机视觉与模式识别 · 计算机科学 2020-02-26 Ning Wang , Yang Gao , Hao Chen , Peng Wang , Zhi Tian , Chunhua Shen , Yanning Zhang

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu

Conventional Neural Architecture Search (NAS) aims at finding a single architecture that achieves the best performance, which usually optimizes task related learning objectives such as accuracy. However, a single architecture may not be…

机器学习 · 计算机科学 2019-05-24 An-Chieh Cheng , Chieh Hubert Lin , Da-Cheng Juan , Wei Wei , Min Sun

Neural Architecture Search (NAS) automates neural network design, reducing dependence on human expertise. While NAS methods are computationally intensive and dataset-specific, auxiliary predictors reduce the models needing training,…

机器学习 · 计算机科学 2024-10-01 Eugenio Lomurno , Samuele Mariani , Matteo Monti , Matteo Matteucci

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Designing accurate and efficient ConvNets for mobile devices is challenging because the design space is combinatorially large. Due to this, previous neural architecture search (NAS) methods are computationally expensive. ConvNet…

计算机视觉与模式识别 · 计算机科学 2019-05-27 Bichen Wu , Xiaoliang Dai , Peizhao Zhang , Yanghan Wang , Fei Sun , Yiming Wu , Yuandong Tian , Peter Vajda , Yangqing Jia , Kurt Keutzer

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

机器学习 · 统计学 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Neural Architecture Search (NAS) has been a source of dramatic improvements in neural network design, with recent results meeting or exceeding the performance of hand-tuned architectures. However, our understanding of how to represent the…

计算机视觉与模式识别 · 计算机科学 2019-03-26 Andrew Hundt , Varun Jain , Gregory D. Hager

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

机器学习 · 计算机科学 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

Neural architectures can be naturally viewed as computational graphs. Motivated by this perspective, we, in this paper, study neural architecture search (NAS) through the lens of learning random graph models. In contrast to existing NAS…

机器学习 · 计算机科学 2022-11-29 Muchen Li , Jeffrey Yunfan Liu , Leonid Sigal , Renjie Liao