中文
相关论文

相关论文: NEAR: A Training-Free Pre-Estimator of Machine Lea…

200 篇论文

Neural architecture search (NAS) has gained immense popularity owing to its ability to automate neural architecture design. A number of training-free metrics are recently proposed to realize NAS without training, hence making NAS more…

机器学习 · 计算机科学 2022-10-13 Yao Shu , Zhongxiang Dai , Zhaoxuan Wu , Bryan Kian Hsiang Low

Artificial neural networks have gone through a recent rise in popularity, achieving state-of-the-art results in various fields, including image classification, speech recognition, and automated control. Both the performance and…

神经与进化计算 · 计算机科学 2016-11-08 Sean C. Smithson , Guang Yang , Warren J. Gross , Brett H. Meyer

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

For real time applications utilizing Deep Neural Networks (DNNs), it is critical that the models achieve high-accuracy on the target task and low-latency inference on the target computing platform. While Neural Architecture Search (NAS) has…

计算机视觉与模式识别 · 计算机科学 2019-08-09 Albert Shaw , Daniel Hunter , Forrest Iandola , Sammy Sidhu

Neural Networks design is a complex and often daunting task, particularly for resource-constrained scenarios typical of mobile-sized models. Neural Architecture Search is a promising approach to automate this process, but existing…

计算机视觉与模式识别 · 计算机科学 2023-10-09 Niccolò Cavagnero , Luca Robbiano , Francesca Pistilli , Barbara Caputo , Giuseppe Averta

In recent years an increasing number of researchers and practitioners have been suggesting algorithms for large-scale neural network architecture search: genetic algorithms, reinforcement learning, learning curve extrapolation, and accuracy…

机器学习 · 计算机科学 2018-06-04 R. Istrate , F. Scheidegger , G. Mariani , D. Nikolopoulos , C. Bekas , A. C. I. Malossi

Recent advancements in Neural Architecture Search(NAS) resulted in finding new state-of-the-art Artificial Neural Network (ANN) solutions for tasks like image classification, object detection, or semantic segmentation without substantial…

图像与视频处理 · 电气工程与系统科学 2020-04-21 Marcin Możejko , Tomasz Latkowski , Łukasz Treszczotko , Michał Szafraniuk , Krzysztof Trojanowski

We propose a novel strategy for Neural Architecture Search (NAS) based on Bregman iterations. Starting from a sparse neural network our gradient-based one-shot algorithm gradually adds relevant parameters in an inverse scale space manner.…

机器学习 · 计算机科学 2021-06-07 Leon Bungert , Tim Roith , Daniel Tenbrinck , Martin Burger

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

In neural architecture search, the structure of the neural network to best model a given dataset is determined by an automated search process. Efficient Neural Architecture Search (ENAS), proposed by Pham et al. (2018), has recently…

机器学习 · 计算机科学 2019-06-19 Prabhant Singh , Tobias Jacobs , Sebastien Nicolas , Mischa Schmidt

Much of the recent improvement in neural networks for computer vision has resulted from discovery of new networks architectures. Most prior work has used the performance of candidate models following limited training to automatically guide…

计算机视觉与模式识别 · 计算机科学 2019-09-09 Pouya Bashivan , Mark Tensen , James J DiCarlo

Neural architecture search (NAS) with an accuracy predictor that predicts the accuracy of candidate architectures has drawn increasing attention due to its simplicity and effectiveness. Previous works usually employ neural network-based…

机器学习 · 计算机科学 2021-07-20 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

Enabling efficient deep neural network (DNN) inference on edge devices with different hardware constraints is a challenging task that typically requires DNN architectures to be specialized for each device separately. To avoid the huge…

人工智能 · 计算机科学 2026-03-17 Mark Deutel , Simon Geis , Axel Plinge

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

机器学习 · 计算机科学 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

计算与语言 · 计算机科学 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

Neural architecture search (NAS) has shown great promise in designing state-of-the-art (SOTA) models that are both accurate and efficient. Recently, two-stage NAS, e.g. BigNAS, decouples the model training and searching process and achieves…

计算机视觉与模式识别 · 计算机科学 2021-04-15 Dilin Wang , Meng Li , Chengyue Gong , Vikas Chandra

Predictor-based algorithms have achieved remarkable performance in the Neural Architecture Search (NAS) tasks. However, these methods suffer from high computation costs, as training the performance predictor usually requires training and…

机器学习 · 计算机科学 2021-08-19 Ruochen Wang , Xiangning Chen , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Evolutionary Neural Architecture Search (ENAS) can automatically design the architectures of Deep Neural Networks (DNNs) using evolutionary computation algorithms. However, most ENAS algorithms require intensive computational resource,…

机器学习 · 计算机科学 2020-09-08 Yanan Sun , Xian Sun , Yuhan Fang , Gary Yen