中文
相关论文

相关论文: Optimizing Neural Architecture Search using Limite…

200 篇论文

Much of the recent improvement in neural networks for computer vision has resulted from discovery of new networks architectures. Most prior work has used the performance of candidate models following limited training to automatically guide…

计算机视觉与模式识别 · 计算机科学 2019-09-09 Pouya Bashivan , Mark Tensen , James J DiCarlo

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RE- NAS), which is…

神经与进化计算 · 计算机科学 2019-04-11 Yukang Chen , Gaofeng Meng , Qian Zhang , Shiming Xiang , Chang Huang , Lisen Mu , Xinggang Wang

Graph neural networks (GNNs) have been intensively applied to various graph-based applications. Despite their success, manually designing the well-behaved GNNs requires immense human expertise. And thus it is inefficient to discover the…

机器学习 · 计算机科学 2022-06-20 Wentao Zhang , Zheyu Lin , Yu Shen , Yang Li , Zhi Yang , Bin Cui

In the last decade, most research in Machine Learning contributed to the improvement of existing models, with the aim of increasing the performance of neural networks for the solution of a variety of different tasks. However, such…

神经与进化计算 · 计算机科学 2023-05-11 Niccolò Cavagnero , Luca Robbiano , Barbara Caputo , Giuseppe Averta

Graph neural architecture search has received a lot of attention as Graph Neural Networks (GNNs) has been successfully applied on the non-Euclidean data recently. However, exploring all possible GNNs architectures in the huge search space…

机器学习 · 计算机科学 2021-12-08 Jiamin Chen , Jianliang Gao , Yibo Chen , Oloulade Babatounde Moctard , Tengfei Lyu , Zhao Li

Recently, much attention has been spent on neural architecture search (NAS), aiming to outperform those manually-designed neural architectures on high-level vision recognition tasks. Inspired by the success, here we attempt to leverage NAS…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Haokui Zhang , Ying Li , Hao Chen , Chengrong Gong , Zongwen Bai , Chunhua Shen

Neural architecture search (NAS) can have a significant impact in computer vision by automatically designing optimal neural network architectures for various tasks. A variant, binarized neural architecture search (BNAS), with a search space…

计算机视觉与模式识别 · 计算机科学 2020-02-12 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , David Doermann , Rongrong Ji

Neural Architecture Search (NAS) has shown great potential in effectively reducing manual effort in network design by automatically discovering optimal architectures. What is noteworthy is that as of now, object detection is less touched by…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Ning Wang , Yang Gao , Hao Chen , Peng Wang , Zhi Tian , Chunhua Shen , Yanning Zhang

This paper introduces a novel optimization method for differential neural architecture search, based on the theory of prediction with expert advice. Its optimization criterion is well fitted for an architecture-selection, i.e., it minimizes…

机器学习 · 计算机科学 2019-06-20 Niv Nayman , Asaf Noy , Tal Ridnik , Itamar Friedman , Rong Jin , Lihi Zelnik-Manor

Despite the remarkable successes of Convolutional Neural Networks (CNNs) in computer vision, it is time-consuming and error-prone to manually design a CNN. Among various Neural Architecture Search (NAS) methods that are motivated to…

计算机视觉与模式识别 · 计算机科学 2021-07-14 Hao Tan , Ran Cheng , Shihua Huang , Cheng He , Changxiao Qiu , Fan Yang , Ping Luo

Recent works show that convolutional neural network (CNN) architectures have a spectral bias towards lower frequencies, which has been leveraged for various image restoration tasks in the Deep Image Prior (DIP) framework. The benefit of the…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Metin Ersin Arican , Ozgur Kara , Gustav Bredell , Ender Konukoglu

We propose a method for learning the neural network architecture that based on Genetic Algorithm (GA). Our approach uses a genetic algorithm integrated with standard Stochastic Gradient Descent(SGD) which allows the sharing of weights…

神经与进化计算 · 计算机科学 2019-07-08 Hai Victor Habi , Gil Rafalovich

Training CNN for detection is time-consuming due to the large dataset and complex network modules, making it hard to search architectures on detection datasets directly, which usually requires vast search costs (usually tens and even…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Xiaoxing Wang , Jiale Lin , Junchi Yan , Juanping Zhao , Xiaokang Yang

The description of rocks is one of the most time-consuming tasks in the everyday work of a geologist, especially when very accurate description is required. We here present a method that reduces the time needed for accurate description of…

计算机视觉与模式识别 · 计算机科学 2019-09-27 E. E. Baraboshkin , L. S. Ismailova , D. M. Orlov , E. A. Zhukovskaya , G. A. Kalmykov , O. V. Khotylev , E. Yu. Baraboshkin , D. A. Koroteev

Architecture search optimizes the structure of a neural network for some task instead of relying on manual authoring. However, it is slow, as each potential architecture is typically trained from scratch. In this paper we present an…

机器学习 · 计算机科学 2021-10-08 Mohan Singamsetti , Anmol Mahajan , Matthew Guzdial

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

计算机视觉与模式识别 · 计算机科学 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

神经与进化计算 · 计算机科学 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Evolutionary computation (EC)-based neural architecture search (NAS) has achieved remarkable performance in the automatic design of neural architectures. However, the high computational cost associated with evaluating searched architectures…

神经与进化计算 · 计算机科学 2025-05-01 Yangyang Li , Guanlong Liu , Ronghua Shang , Licheng Jiao

Deep Neural Networks (DNNs) have made significant improvements to reach the desired accuracy to be employed in a wide variety of Machine Learning (ML) applications. Recently the Google Brain's team demonstrated the ability of Capsule…

As the application area of convolutional neural networks (CNN) is growing in embedded devices, it becomes popular to use a hardware CNN accelerator, called neural processing unit (NPU), to achieve higher performance per watt than CPUs or…

机器学习 · 计算机科学 2020-09-07 Jaeseong Lee , Duseok Kang , Soonhoi Ha