中文
相关论文

相关论文: Continual and Multi-Task Architecture Search

200 篇论文

We propose a novel hardware and software co-exploration framework for efficient neural architecture search (NAS). Different from existing hardware-aware NAS which assumes a fixed hardware design and explores the neural architecture search…

机器学习 · 计算机科学 2020-01-14 Weiwen Jiang , Lei Yang , Edwin Sha , Qingfeng Zhuge , Shouzhen Gu , Sakyasingha Dasgupta , Yiyu Shi , Jingtong Hu

This paper proposes Binary ArchitecTure Search (BATS), a framework that drastically reduces the accuracy gap between binary neural networks and their real-valued counterparts by means of Neural Architecture Search (NAS). We show that…

计算机视觉与模式识别 · 计算机科学 2020-07-27 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

机器学习 · 计算机科学 2019-07-22 Martin Wistuba

The recent progress of deep convolutional neural networks has enabled great success in single image super-resolution (SISR) and many other vision tasks. Their performances are also being increased by deepening the networks and developing…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Joon Young Ahn , Nam Ik Cho

Monumental advances in deep learning have led to unprecedented achievements across various domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial.…

机器学习 · 计算机科学 2023-07-06 Zachariah Carmichael , Tim Moon , Sam Ade Jacobs

Recently, Neural Architecture Search has achieved great success in large-scale image classification. In contrast, there have been limited works focusing on architecture search for object detection, mainly because the costly ImageNet…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Junran Peng , Ming Sun , Zhaoxiang Zhang , Tieniu Tan , Junjie Yan

One-shot neural architecture search (NAS) methods significantly reduce the search cost by considering the whole search space as one network, which only needs to be trained once. However, current methods select each operation independently…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Xiu Su , Tao Huang , Yanxi Li , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Chang Xu

Neural architecture search (NAS) has shown great promise in the field of automated machine learning (AutoML). NAS has outperformed hand-designed networks and made a significant step forward in the field of automating the design of deep…

机器学习 · 计算机科学 2022-05-16 Matej Grobelnik , Joaquin Vanschoren

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

机器学习 · 计算机科学 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design…

机器学习 · 计算机科学 2023-12-11 Simon Schrodi , Danny Stoll , Binxin Ru , Rhea Sukthanker , Thomas Brox , Frank Hutter

Recent years have witnessed the popularity and success of graph neural networks (GNN) in various scenarios. To obtain data-specific GNN architectures, researchers turn to neural architecture search (NAS), which has made impressive success…

机器学习 · 计算机科学 2021-04-21 Huan Zhao , Quanming Yao , Weiwei Tu

Neural architecture search enables automation of architecture design. Despite its success, it is computationally costly and does not provide an insight on how to design a desirable architecture. Here we propose a new way of searching neural…

机器学习 · 计算机科学 2021-12-16 Zhenhan Huang , Chunheng Jiang , Pin-Yu Chen , Jianxi Gao

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

机器学习 · 统计学 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

A key problem in deep multi-attribute learning is to effectively discover the inter-attribute correlation structures. Typically, the conventional deep multi-attribute learning approaches follow the pipeline of manually designing the network…

神经与进化计算 · 计算机科学 2018-08-03 Siyu Huang , Xi Li , Zhi-Qi Cheng , Zhongfei Zhang , Alexander Hauptmann

Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e.,\ compute clients) are idle much of the time, waiting for the next generation…

神经与进化计算 · 计算机科学 2024-01-02 Jason Liang , Hormoz Shahrzad , Risto Miikkulainen

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

机器学习 · 计算机科学 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

We report a neural architecture search framework, BioNAS, that is tailored for biomedical researchers to easily build, evaluate, and uncover novel knowledge from interpretable deep learning models. The introduction of knowledge…

机器学习 · 统计学 2019-09-04 Zijun Zhang , Linqi Zhou , Liangke Gou , Ying Nian Wu

One-shot Neural Architecture Search (NAS) has been widely used to discover architectures due to its efficiency. However, previous studies reveal that one-shot performance estimations of architectures might not be well correlated with their…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Zixuan Zhou , Xuefei Ning , Yi Cai , Jiashu Han , Yiping Deng , Yuhan Dong , Huazhong Yang , Yu Wang

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

机器学习 · 计算机科学 2019-08-01 Liam Li , Ameet Talwalkar

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

神经与进化计算 · 计算机科学 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang