中文
相关论文

相关论文: Multi-objective Neural Architecture Search with Al…

200 篇论文

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

机器学习 · 计算机科学 2019-07-22 Martin Wistuba

Performance prediction has been a key part of the neural architecture search (NAS) process, allowing to speed up NAS algorithms by avoiding resource-consuming network training. Although many performance predictors correlate well with ground…

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

机器学习 · 计算机科学 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

计算机视觉与模式识别 · 计算机科学 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Most existing neural architecture search (NAS) algorithms are dedicated to and evaluated by the downstream tasks, e.g., image classification in computer vision. However, extensive experiments have shown that, prominent neural architectures,…

机器学习 · 计算机科学 2021-11-18 Yuhong Li , Cong Hao , Pan Li , Jinjun Xiong , Deming Chen

Many existing neural architecture search (NAS) solutions rely on downstream training for architecture evaluation, which takes enormous computations. Considering that these computations bring a large carbon footprint, this paper aims to…

机器学习 · 计算机科学 2021-11-29 Jingjing Xu , Liang Zhao , Junyang Lin , Rundong Gao , Xu Sun , Hongxia Yang

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Conventional neural architecture search (NAS) approaches are based on reinforcement learning or evolutionary strategy, which take more than 3000 GPU hours to find a good model on CIFAR-10. We propose an efficient NAS approach learning to…

计算机视觉与模式识别 · 计算机科学 2019-10-17 Xuanyi Dong , Yi Yang

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

神经与进化计算 · 计算机科学 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

Neural Architecture Search (NAS) was first proposed to achieve state-of-the-art performance through the discovery of new architecture patterns, without human intervention. An over-reliance on expert knowledge in the search space design has…

机器学习 · 计算机科学 2021-01-05 Binxin Ru , Pedro Esperanca , Fabio Carlucci

Neural Architecture Search (NAS) is an automatic technique that can search for well-performed architectures for a specific task. Although NAS surpasses human-designed architecture in many fields, the high computational cost of architecture…

机器学习 · 计算机科学 2022-12-26 Yuqiao Liu , Haipeng Li , Yanan Sun , Shuaicheng Liu

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

图像与视频处理 · 电气工程与系统科学 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Neural Architecture Search (NAS) yields state-of-the-art neural networks that outperform their best manually-designed counterparts. However, previous NAS methods search for architectures under one set of training hyper-parameters (i.e., a…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Xiaoliang Dai , Alvin Wan , Peizhao Zhang , Bichen Wu , Zijian He , Zhen Wei , Kan Chen , Yuandong Tian , Matthew Yu , Peter Vajda , Joseph E. Gonzalez

Neural networks are powerful models that have a remarkable ability to extract patterns that are too complex to be noticed by humans or other machine learning models. Neural networks are the first class of models that can train end-to-end…

机器学习 · 计算机科学 2021-08-05 Ibrahim Alshubaily

Hardware-aware Neural Architecture Search approaches (HW-NAS) automate the design of deep learning architectures, tailored specifically to a given target hardware platform. Yet, these techniques demand substantial computational resources,…

机器学习 · 计算机科学 2024-04-22 Nilotpal Sinha , Peyman Rostami , Abd El Rahman Shabayek , Anis Kacem , Djamila Aouada

Recent years have witnessed the popularity of Graph Neural Networks (GNN) in various scenarios. To obtain optimal data-specific GNN architectures, researchers turn to neural architecture search (NAS) methods, which have made impressive…

机器学习 · 计算机科学 2020-09-08 Huan Zhao , Lanning Wei , Quanming Yao

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

This paper proposes a novel cell-based neural architecture search algorithm (NAS), which completely alleviates the expensive costs of data labeling inherited from supervised learning. Our algorithm capitalizes on the effectiveness of…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Nam Nguyen , J. Morris Chang

Efficient search is a core issue in Neural Architecture Search (NAS). It is difficult for conventional NAS algorithms to directly search the architectures on large-scale tasks like ImageNet. In general, the cost of GPU hours for NAS grows…

计算机视觉与模式识别 · 计算机科学 2020-03-30 Xiyang Dai , Dongdong Chen , Mengchen Liu , Yinpeng Chen , Lu Yuan

The fundamental problem in Neural Architecture Search (NAS) is to efficiently find high-performing architectures from a given search space. We propose a simple but powerful method which we call FEAR, for ranking architectures in any search…

机器学习 · 计算机科学 2021-06-09 Debadeepta Dey , Shital Shah , Sebastien Bubeck