中文
相关论文

相关论文: LayerNAS: Neural Architecture Search in Polynomial…

200 篇论文

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Many studies estimate energy consumption using proxy metrics like memory usage, FLOPs, and inference latency, with the assumption that reducing these metrics will also lower energy consumption in neural networks. This paper, however, takes…

机器学习 · 计算机科学 2025-04-14 Hoang-Loc La , Phuong Hoai Ha

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

神经与进化计算 · 计算机科学 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin

Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources.…

机器学习 · 计算机科学 2024-02-13 Ruiyang Qin , Yuting Hu , Zheyu Yan , Jinjun Xiong , Ahmed Abbasi , Yiyu Shi

The design of handcrafted neural networks requires a lot of time and resources. Recent techniques in Neural Architecture Search (NAS) have proven to be competitive or better than traditional handcrafted design, although they require domain…

机器学习 · 计算机科学 2021-03-17 Cat P. Le , Mohammadreza Soltani , Robert Ravier , Vahid Tarokh

There are many research works on the designing of architectures for the deep neural networks (DNN), which are named neural architecture search (NAS) methods. Although there are many automatic and manual techniques for NAS problems, there is…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Emad Malekhosseini , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Differentiable Neural Architecture Search is one of the most popular Neural Architecture Search (NAS) methods for its search efficiency and simplicity, accomplished by jointly optimizing the model weight and architecture parameters in a…

机器学习 · 计算机科学 2021-08-11 Ruochen Wang , Minhao Cheng , Xiangning Chen , Xiaocheng Tang , Cho-Jui Hsieh

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

神经与进化计算 · 计算机科学 2020-10-28 Matheus Nunes , Gisele L. Pappa

Neural architecture search (NAS) has been proposed to automatically tune deep neural networks, but existing search algorithms, e.g., NASNet, PNAS, usually suffer from expensive computational cost. Network morphism, which keeps the…

机器学习 · 计算机科学 2019-03-27 Haifeng Jin , Qingquan Song , Xia Hu

Recent neural architecture search (NAS) based approaches have made great progress in hyperspectral image (HSI) classification tasks. However, the architectures are usually optimized independently of the network weights, increasing searching…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Di Wang , Bo Du , Liangpei Zhang , Dacheng Tao

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

机器学习 · 计算机科学 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural Architecture Search (NAS) aims to optimize deep neural networks' architecture for better accuracy or smaller computational cost and has recently gained more research interests. Despite various successful approaches proposed to solve…

机器学习 · 计算机科学 2020-11-03 Bas van Stein , Hao Wang , Thomas Bäck

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

机器学习 · 计算机科学 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

Deep learning methods have become very successful at solving many complex tasks such as image classification and segmentation, speech recognition and machine translation. Nevertheless, manually designing a neural network for a specific…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Maria Baldeon Calisto , Susana Lai-Yuen

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

机器学习 · 计算机科学 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures.…

机器学习 · 计算机科学 2020-11-26 Han Shi , Renjie Pi , Hang Xu , Zhenguo Li , James T. Kwok , Tong Zhang

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

We present the first differentiable Network Architecture Search (NAS) for Graph Neural Networks (GNNs). GNNs show promising performance on a wide range of tasks, but require a large amount of architecture engineering. First, graphs are…

机器学习 · 计算机科学 2020-03-24 Yiren Zhao , Duo Wang , Xitong Gao , Robert Mullins , Pietro Lio , Mateja Jamnik