中文
相关论文

相关论文: Powering One-shot Topological NAS with Stabilized …

200 篇论文

A majority of recent developments in neural architecture search (NAS) have been aimed at decreasing the computational cost of various techniques without affecting their final performance. Towards this goal, several low-fidelity and…

机器学习 · 计算机科学 2022-11-04 Vishak Prasad C , Colin White , Paarth Jain , Sibasis Nayak , Ganesh Ramakrishnan

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

机器学习 · 计算机科学 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Recent advances show that Neural Architectural Search (NAS) method is able to find state-of-the-art image classification deep architectures. In this paper, we consider the one-shot NAS problem for resource constrained applications. This…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Xiaojie Jin , Jiang Wang , Joshua Slocum , Ming-Hsuan Yang , Shengyang Dai , Shuicheng Yan , Jiashi Feng

Neural Architecture Search (NAS) is quickly becoming the standard methodology to design neural network models. However, NAS is typically compute-intensive because multiple models need to be evaluated before choosing the best one. To reduce…

机器学习 · 计算机科学 2021-03-22 Mohamed S. Abdelfattah , Abhinav Mehrotra , Łukasz Dudziak , Nicholas D. Lane

Semantic segmentation of 3D medical images is a challenging task due to the high variability of the shape and pattern of objects (such as organs or tumors). Given the recent success of deep learning in medical image segmentation, Neural…

图像与视频处理 · 电气工程与系统科学 2022-03-25 Cheng Peng , Andriy Myronenko , Ali Hatamizadeh , Vish Nath , Md Mahfuzur Rahman Siddiquee , Yufan He , Daguang Xu , Rama Chellappa , Dong Yang

Recent advancements in the area of deep learning have shown the effectiveness of very large neural networks in several applications. However, as these deep neural networks continue to grow in size, it becomes more and more difficult to…

机器学习 · 计算机科学 2022-10-19 Anjul Tyagi , Cong Xie , Klaus Mueller

One-shot neural architecture search (NAS) methods significantly reduce the search cost by considering the whole search space as one network, which only needs to be trained once. However, current methods select each operation independently…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Xiu Su , Tao Huang , Yanxi Li , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Chang Xu

Neural architecture search (NAS) aims to produce the optimal sparse solution from a high-dimensional space spanned by all candidate connections. Current gradient-based NAS methods commonly ignore the constraint of sparsity in the search…

计算机视觉与模式识别 · 计算机科学 2020-10-14 Yibo Yang , Hongyang Li , Shan You , Fei Wang , Chen Qian , Zhouchen Lin

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

机器学习 · 计算机科学 2019-08-01 Liam Li , Ameet Talwalkar

Neural architecture search has proven to be a powerful approach to designing and refining neural networks, often boosting their performance and efficiency over manually-designed variations, but comes with computational overhead. While there…

Convolutional neural networks (CNNs) are used in numerous real-world applications such as vision-based autonomous driving and video content analysis. To run CNN inference on various target devices, hardware-aware neural architecture search…

机器学习 · 计算机科学 2021-11-04 Bingqian Lu , Jianyi Yang , Weiwen Jiang , Yiyu Shi , Shaolei Ren

To discover powerful yet compact models is an important goal of neural architecture search. Previous two-stage one-shot approaches are limited by search space with a fixed depth. It seems handy to include an additional skip connection in…

机器学习 · 计算机科学 2021-08-17 Xiangxiang Chu , Bo Zhang , Qingyuan Li , Ruijun Xu , Xudong Li

Routability optimization in modern EDA tools has benefited greatly from using machine learning (ML) models. Constructing and optimizing the performance of ML models continues to be a challenge. Neural Architecture Search (NAS) serves as a…

机器学习 · 计算机科学 2024-11-22 Arjun Sridhar , Chen-Chia Chang , Junyao Zhang , Yiran Chen

Despite remarkable progress achieved, most neural architecture search (NAS) methods focus on searching for one single accurate and robust architecture. To further build models with better generalization capability and performance, model…

计算机视觉与模式识别 · 计算机科学 2021-07-19 Minghao Chen , Houwen Peng , Jianlong Fu , Haibin Ling

An important step in the task of neural network design, such as hyper-parameter optimization (HPO) or neural architecture search (NAS), is the evaluation of a candidate model's performance. Given fixed computational resources, one can…

机器学习 · 计算机科学 2021-03-09 Shengcao Cao , Xiaofang Wang , Kris Kitani

Neural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information about thousands of…

机器学习 · 计算机科学 2023-03-31 Vasco Lopes , Bruno Degardin , Luís A. Alexandre

Differentiable architecture search (DARTS) is a prevailing NAS solution to identify architectures. Based on the continuous relaxation of the architecture space, DARTS learns a differentiable architecture weight and largely reduces the…

机器学习 · 计算机科学 2021-01-19 Xiangning Chen , Cho-Jui Hsieh

Transferrable neural architecture search can be viewed as a binary optimization problem where a single optimal path should be selected among candidate paths in each edge within the repeated cell block of the directed a cyclic graph form.…

计算机视觉与模式识别 · 计算机科学 2019-12-05 Hyeong Gwon Hong , Pyunghwan Ahn , Junmo Kim

Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the…

Neural Architecture Search (NAS) is a powerful tool to automatically design deep neural networks for many tasks, including image classification. Due to the significant computational burden of the search phase, most NAS methods have focused…