中文
相关论文

相关论文: Probeable DARTS with Application to Computational …

200 篇论文

Neural Architecture Search (NAS) is an exciting new field which promises to be as much as a game-changer as Convolutional Neural Networks were in 2012. Despite many great works leading to substantial improvements on a variety of tasks,…

机器学习 · 计算机科学 2020-02-17 Antoine Yang , Pedro M. Esperança , Fabio M. Carlucci

Neural architecture search enables automation of architecture design. Despite its success, it is computationally costly and does not provide an insight on how to design a desirable architecture. Here we propose a new way of searching neural…

机器学习 · 计算机科学 2021-12-16 Zhenhan Huang , Chunheng Jiang , Pin-Yu Chen , Jianxi Gao

In recent years, neural architecture search (NAS) has received intensive scientific and industrial interest due to its capability of finding a neural architecture with high accuracy for various artificial intelligence tasks such as image…

机器学习 · 计算机科学 2021-01-18 Martin Ferianc , Hongxiang Fan , Miguel Rodrigues

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

Recent breakthroughs in Neural Architectural Search (NAS) have achieved state-of-the-art performances in applications such as image classification and language modeling. However, these techniques typically ignore device-related objectives…

计算机视觉与模式识别 · 计算机科学 2018-07-26 Jin-Dong Dong , An-Chieh Cheng , Da-Cheng Juan , Wei Wei , Min Sun

Searching techniques in most of existing neural architecture search (NAS) algorithms are mainly dominated by differentiable methods for the efficiency reason. In contrast, we develop an efficient continuous evolutionary approach for…

计算机视觉与模式识别 · 计算机科学 2020-03-10 Zhaohui Yang , Yunhe Wang , Xinghao Chen , Boxin Shi , Chao Xu , Chunjing Xu , Qi Tian , Chang Xu

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

机器学习 · 计算机科学 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

Deep neural architectures have profound impact on achieved performance in many of today's AI tasks, yet, their design still heavily relies on human prior knowledge and experience. Neural architecture search (NAS) together with…

机器学习 · 计算机科学 2023-03-28 Jonas Seng , Pooja Prasad , Martin Mundt , Devendra Singh Dhami , Kristian Kersting

Differentiable architecture search (DARTS) is a prevailing NAS solution to identify architectures. Based on the continuous relaxation of the architecture space, DARTS learns a differentiable architecture weight and largely reduces the…

机器学习 · 计算机科学 2021-01-19 Xiangning Chen , Cho-Jui Hsieh

Neural Architecture Search (NAS) represents a class of methods to generate the optimal neural network architecture and typically iterate over candidate architectures till convergence over some particular metric like validation loss. They…

机器学习 · 计算机科学 2019-10-22 Abhishek Singh , Anubhav Garg , Jinan Zhou , Shiv Ram Dubey , Debo Dutta

Differentiable Architecture Search (DARTS) is now a widely disseminated weight-sharing neural architecture search method. However, it suffers from well-known performance collapse due to an inevitable aggregation of skip connections. In this…

机器学习 · 计算机科学 2020-07-17 Xiangxiang Chu , Tianbao Zhou , Bo Zhang , Jixiang Li

One of the key steps in Neural Architecture Search (NAS) is to estimate the performance of candidate architectures. Existing methods either directly use the validation performance or learn a predictor to estimate the performance. However,…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Yaofo Chen , Yong Guo , Qi Chen , Minli Li , Wei Zeng , Yaowei Wang , Mingkui Tan

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

音频与语音处理 · 电气工程与系统科学 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

计算机视觉与模式识别 · 计算机科学 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Differentiable Architecture Search (DARTS) is an efficient Neural Architecture Search (NAS) method but suffers from robustness, generalization, and discrepancy issues. Many efforts have been made towards the performance collapse issue…

神经与进化计算 · 计算机科学 2025-04-24 Yanlin Zhou , Mostafa El-Khamy , Kee-Bong Song

Neural Architecture Search (NAS) has emerged as a powerful approach for automating neural network design. However, existing NAS methods face critical limitations in real-world deployments: architectures lack adaptability across scenarios,…

机器学习 · 计算机科学 2025-08-29 Maolin Wang , Tianshuo Wei , Sheng Zhang , Ruocheng Guo , Wanyu Wang , Shanshan Ye , Lixin Zou , Xuetao Wei , Xiangyu Zhao

Most applications demand high-performance deep neural architectures costing limited resources. Neural architecture searching is a way of automatically exploring optimal deep neural networks in a given huge search space. However, all…

机器学习 · 计算机科学 2020-06-01 Yunhe Wang , Yixing Xu , Dacheng Tao

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…