中文
相关论文

相关论文: Efficient Multi-objective Neural Architecture Sear…

200 篇论文

Deep neural networks have recently become a popular solution to keyword spotting systems, which enable the control of smart devices via voice. In this paper, we apply neural architecture search to search for convolutional neural network…

音频与语音处理 · 电气工程与系统科学 2021-04-27 Tong Mo , Yakun Yu , Mohammad Salameh , Di Niu , Shangling Jui

This paper introduces a novel optimization method for differential neural architecture search, based on the theory of prediction with expert advice. Its optimization criterion is well fitted for an architecture-selection, i.e., it minimizes…

机器学习 · 计算机科学 2019-06-20 Niv Nayman , Asaf Noy , Tal Ridnik , Itamar Friedman , Rong Jin , Lihi Zelnik-Manor

Deep Learning has enabled remarkable progress over the last years on a variety of tasks, such as image recognition, speech recognition, and machine translation. One crucial aspect for this progress are novel neural architectures. Currently…

机器学习 · 统计学 2019-04-29 Thomas Elsken , Jan Hendrik Metzen , Frank Hutter

The effectiveness of Evolutionary Neural Architecture Search (ENAS) is influenced by the design of the search space. Nevertheless, common methods including the global search space, scalable search space and hierarchical search space have…

神经与进化计算 · 计算机科学 2024-03-13 Juan Zou , Han Chu , Yizhang Xia , Junwen Xu , Yuan Liu , Zhanglu Hou

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

神经与进化计算 · 计算机科学 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

To achieve excellent performance with modern neural networks, having the right network architecture is important. Neural Architecture Search (NAS) concerns the automatic discovery of task-specific network architectures. Modern NAS…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Alexander Chebykin , Tanja Alderliesten , Peter A. N. Bosman

Evolutionary computation (EC)-based neural architecture search (NAS) has achieved remarkable performance in the automatic design of neural architectures. However, the high computational cost associated with evaluating searched architectures…

神经与进化计算 · 计算机科学 2025-05-01 Yangyang Li , Guanlong Liu , Ronghua Shang , Licheng Jiao

Hardware-Software Co-Design is a highly successful strategy for improving performance of domain-specific computing systems. We argue for the application of the same methodology to deep learning; specifically, we propose to extend neural…

机器学习 · 计算机科学 2020-01-10 Andrew Anderson , Jing Su , Rozenn Dahyot , David Gregg

Image translators have been successfully applied to many important low level image processing tasks. However, classical network architecture of image translator like U-Net, is borrowed from other vision tasks like biomedical image…

图像与视频处理 · 电气工程与系统科学 2020-02-27 Han Shu , Yunhe Wang

Recently, more and more works have proposed to drive evolutionary algorithms using machine learning models.Usually, the performance of such model based evolutionary algorithms is highly dependent on the training qualities of the adopted…

神经与进化计算 · 计算机科学 2020-04-08 Cheng He , Shihua Huang , Ran Cheng , Kay Chen Tan , Yaochu Jin

The ability to design complex neural network architectures which enable effective training by stochastic gradient descent has been the key for many achievements in the field of deep learning. However, developing such architectures remains a…

神经与进化计算 · 计算机科学 2019-07-04 Marcus Märtens , Dario Izzo

To defend deep neural networks from adversarial attacks, adversarial training has been drawing increasing attention for its effectiveness. However, the accuracy and robustness resulting from the adversarial training are limited by the…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Yuwei Ou , Yuqi Feng , Yanan Sun

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

神经与进化计算 · 计算机科学 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang

A strong visual object tracker nowadays relies on its well-crafted modules, which typically consist of manually-designed network architectures to deliver high-quality tracking results. Not surprisingly, the manual design process becomes a…

计算机视觉与模式识别 · 计算机科学 2021-10-27 Seyed Mojtaba Marvasti-Zadeh , Javad Khaghani , Li Cheng , Hossein Ghanei-Yakhdan , Shohreh Kasaei

Convolutional neural networks belong to the most successul image classifiers, but the adaptation of their network architecture to a particular problem is computationally expensive. We show that an evolutionary algorithm saves training time…

神经与进化计算 · 计算机科学 2018-12-20 Jonas Prellberg , Oliver Kramer

The growing capacity of neural networks has strongly contributed to their success at complex machine learning tasks and the computational demand of such large models has, in turn, stimulated a significant improvement in the hardware…

机器学习 · 计算机科学 2021-04-27 Mohammed Amer , Tomás Maul , Iman Yi Liao

Recent studies on automatic neural architectures search have demonstrated significant performance, competitive to or even better than hand-crafted neural architectures. However, most of the existing network architecture tend to use…

机器学习 · 计算机科学 2020-06-12 Peiye Liu , Bo Wu , Huadong Ma , Mingoo Seok

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity…

神经与进化计算 · 计算机科学 2021-08-10 Noor Awad , Neeratyoy Mallik , Frank Hutter

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

神经与进化计算 · 计算机科学 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman