中文
相关论文

相关论文: A Hardware-Aware System for Accelerating Deep Neur…

200 篇论文

We propose three novel pruning techniques to improve the cost and results of inference-aware Differentiable Neural Architecture Search (DNAS). First, we introduce Prunode, a stochastic bi-path building block for DNAS, which can search over…

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

计算机视觉与模式识别 · 计算机科学 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

机器学习 · 计算机科学 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Designing domain specific neural networks is a time-consuming, error-prone, and expensive task. Neural Architecture Search (NAS) exists to simplify domain-specific model development but there is a gap in the literature for time series…

机器学习 · 计算机科学 2024-02-06 Tobias King , Yexu Zhou , Tobias Röddiger , Michael Beigl

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

机器学习 · 计算机科学 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Neural architecture search (NAS) aims to automate architecture engineering in neural networks. This often requires a high computational overhead to evaluate a number of candidate networks from the set of all possible networks in the search…

计算机视觉与模式识别 · 计算机科学 2022-04-28 Yameng Peng , Andy Song , Vic Ciesielski , Haytham M. Fayek , Xiaojun Chang

Neural Architecture Search (NAS) is an automated technique to design optimal neural network architectures for a specific workload. Conventionally, evaluating candidate networks in NAS involves extensive training, which requires significant…

机器学习 · 计算机科学 2025-06-05 Tomomasa Yamasaki , Zhehui Wang , Tao Luo , Niangjun Chen , Bo Wang

Transfer learning can boost the performance on the targettask by leveraging the knowledge of the source domain. Recent worksin neural architecture search (NAS), especially one-shot NAS, can aidtransfer learning by establishing sufficient…

计算机视觉与模式识别 · 计算机科学 2021-05-20 Ming Sun , Haoxuan Dou , Junjie Yan

Neural architecture search (NAS) has attracted increasing attentions in both academia and industry. In the early age, researchers mostly applied individual search methods which sample and evaluate the candidate architectures separately and…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Lingxi Xie , Xin Chen , Kaifeng Bi , Longhui Wei , Yuhui Xu , Zhengsu Chen , Lanfei Wang , An Xiao , Jianlong Chang , Xiaopeng Zhang , Qi Tian

Neural network-based semantic segmentation has achieved remarkable results when large amounts of annotated data are available, that is, in the supervised case. However, such data is expensive to collect and so methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Xueqing Deng , Yi Zhu , Yuxin Tian , Shawn Newsam

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

This paper investigates the optimal signal detection problem with a particular interest in large-scale multiple-input multiple-output (MIMO) systems. The problem is NP-hard and can be solved optimally by searching the shortest path on the…

机器学习 · 计算机科学 2022-03-22 Le He , Ke He , Lisheng Fan , Xianfu Lei , Arumugam Nallanathan , George K. Karagiannidis

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

While existing work on neural architecture search (NAS) tunes hyperparameters in a separate post-processing step, we demonstrate that architectural choices and other hyperparameter settings interact in a way that can render this separation…

机器学习 · 计算机科学 2018-07-19 Arber Zela , Aaron Klein , Stefan Falkner , Frank Hutter

Realistic use of neural networks often requires adhering to multiple constraints on latency, energy and memory among others. A popular approach to find fitting networks is through constrained Neural Architecture Search (NAS), however,…

机器学习 · 计算机科学 2021-02-24 Niv Nayman , Yonathan Aflalo , Asaf Noy , Lihi Zelnik-Manor

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a…

机器学习 · 计算机科学 2021-10-29 Wonyong Jeong , Hayeon Lee , Gun Park , Eunyoung Hyung , Jinheon Baek , Sung Ju Hwang

Most applications demand high-performance deep neural architectures costing limited resources. Neural architecture searching is a way of automatically exploring optimal deep neural networks in a given huge search space. However, all…

机器学习 · 计算机科学 2020-06-01 Yunhe Wang , Yixing Xu , Dacheng Tao

Deep neural networks have exhibited promising performance in image super-resolution (SR). Most SR models follow a hierarchical architecture that contains both the cell-level design of computational blocks and the network-level design of the…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Yong Guo , Yongsheng Luo , Zhenhao He , Jin Huang , Jian Chen

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

计算机视觉与模式识别 · 计算机科学 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier