中文
相关论文

相关论文: Understanding Neural Architecture Search Technique…

200 篇论文

Neural architecture search enables automation of architecture design. Despite its success, it is computationally costly and does not provide an insight on how to design a desirable architecture. Here we propose a new way of searching neural…

机器学习 · 计算机科学 2021-12-16 Zhenhan Huang , Chunheng Jiang , Pin-Yu Chen , Jianxi Gao

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Neural Architecture Search (NAS) methods have been shown to outperform hand-designed models and help to democratize AI. However, NAS methods often start from scratch with each new task, making them computationally expensive and limiting…

机器学习 · 计算机科学 2025-07-15 Prabhant Singh , Joaquin Vanschoren

Neural architecture search (NAS) aims to automate architecture engineering in neural networks. This often requires a high computational overhead to evaluate a number of candidate networks from the set of all possible networks in the search…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Yameng Peng , Andy Song , Vic Ciesielski , Haytham M. Fayek , Xiaojun Chang

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti

Recent works have demonstrated that deep learning (DL) based compressed sensing (CS) implementation can accelerate Magnetic Resonance (MR) Imaging by reconstructing MR images from sub-sampled k-space data. However, network architectures…

图像与视频处理 · 电气工程与系统科学 2023-11-03 Jiangpeng Yan , Shuo Chen , Yongbing Zhang , Xiu Li

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use…

分布式、并行与集群计算 · 计算机科学 2019-02-04 Weiwen Jiang , Xinyi Zhang , Edwin H. -M. Sha , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu

Neural architecture search (NAS) recently attracts much research attention because of its ability to identify better architectures than handcrafted ones. However, many NAS methods, which optimize the search process in a discrete search…

机器学习 · 计算机科学 2019-11-22 Quanming Yao , Ju Xu , Wei-Wei Tu , Zhanxing Zhu

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

计算机视觉与模式识别 · 计算机科学 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Data-driven methods have made great progress in fault diagnosis, especially deep learning method. Deep learning is suitable for processing big data, and has a strong feature extraction ability to realize end-to-end fault diagnosis systems.…

机器学习 · 计算机科学 2020-02-20 Xudong Li , Yang Hu , Jianhua Zheng , Mingtao Li

Neural Architecture Search (NAS) has received increasing attention because of its exceptional merits in automating the design of Deep Neural Network (DNN) architectures. However, the performance evaluation process, as a key part of NAS,…

神经与进化计算 · 计算机科学 2024-10-10 Xiaotian Song , Xiangning Xie , Zeqiong Lv , Gary G. Yen , Weiping Ding , Jiancheng Lv , Yanan Sun

The number of graph neural network (GNN) architectures has increased rapidly due to the growing adoption of graph analysis. Although we use GNNs in wide application scenarios, it is a laborious task to design/select optimal GNN…

机器学习 · 计算机科学 2025-11-05 Yuya Sasaki

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

Neural Architecture Search (NAS) effectively discovers new Convolutional Neural Network (CNN) architectures, particularly for accuracy optimization. However, prior approaches often require resource-intensive training on super networks or…

机器学习 · 计算机科学 2024-01-18 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang

Neural Architecture Search (NAS) automates and prospers the design of neural networks. Estimator-based NAS has been proposed recently to model the relationship between architectures and their performance to enable scalable and flexible…

人工智能 · 计算机科学 2020-09-29 Hsin-Pai Cheng , Tunhou Zhang , Yixing Zhang , Shiyu Li , Feng Liang , Feng Yan , Meng Li , Vikas Chandra , Hai Li , Yiran Chen

Many studies estimate energy consumption using proxy metrics like memory usage, FLOPs, and inference latency, with the assumption that reducing these metrics will also lower energy consumption in neural networks. This paper, however, takes…

机器学习 · 计算机科学 2025-04-14 Hoang-Loc La , Phuong Hoai Ha

Neural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information about thousands of…

机器学习 · 计算机科学 2023-03-31 Vasco Lopes , Bruno Degardin , Luís A. Alexandre

The emergence of neural architecture search (NAS) has greatly advanced the research on network design. Recent proposals such as gradient-based methods or one-shot approaches significantly boost the efficiency of NAS. In this paper, we…

机器学习 · 计算机科学 2019-12-09 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

To defend deep neural networks from adversarial attacks, adversarial training has been drawing increasing attention for its effectiveness. However, the accuracy and robustness resulting from the adversarial training are limited by the…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Yuwei Ou , Yuqi Feng , Yanan Sun