English
Related papers

Related papers: BATS: Binary ArchitecTure Search

200 papers

Existing neural architecture search (NAS) methods often return an architecture with good search performance but generalizes poorly to the test setting. To achieve better generalization, we propose a novel neighborhood-aware NAS formulation…

Machine Learning · Computer Science 2021-11-01 Xiaofang Wang , Shengcao Cao , Mengtian Li , Kris M. Kitani

This paper proposes a neural architecture search (NAS) method for split computing. Split computing is an emerging machine-learning inference technique that addresses the privacy and latency challenges of deploying deep learning in IoT…

Machine Learning · Computer Science 2022-08-31 Shoma Shimizu , Takayuki Nishio , Shota Saito , Yoichi Hirose , Chen Yen-Hsiu , Shinichi Shirakawa

In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the…

Machine Learning · Computer Science 2021-01-19 Yigit Alparslan , Ethan Jacob Moyer , Isamu Mclean Isozaki , Daniel Schwartz , Adam Dunlop , Shesh Dave , Edward Kim

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

Machine Learning · Computer Science 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

In this paper, we investigate the fundamental question: To what extent are gradient-based neural architecture search (NAS) techniques applicable to RL? Using the original DARTS as a convenient baseline, we discover that the discrete…

Machine Learning · Computer Science 2022-11-16 Yingjie Miao , Xingyou Song , John D. Co-Reyes , Daiyi Peng , Summer Yue , Eugene Brevdo , Aleksandra Faust

Differentiable architecture search (DARTS) marks a milestone in Neural Architecture Search (NAS), boasting simplicity and small search costs. However, DARTS still suffers from frequent performance collapse, which happens when some…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Pengfei Hou , Ying Jin , Yukang Chen

Network structures and models have been widely adopted, e.g., for Internet of Things, wireless sensor networks, smart grids, transportation networks, communication networks, social networks, and computer grid systems. Network reliability is…

Data Structures and Algorithms · Computer Science 2020-04-20 Wei-Chang Yeh

We report a neural architecture search framework, BioNAS, that is tailored for biomedical researchers to easily build, evaluate, and uncover novel knowledge from interpretable deep learning models. The introduction of knowledge…

Machine Learning · Statistics 2019-09-04 Zijun Zhang , Linqi Zhou , Liangke Gou , Ying Nian Wu

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two…

Machine Learning · Computer Science 2021-03-11 Rei Sato , Jun Sakuma , Youhei Akimoto

Neural Architecture Search (NAS) has emerged as a promising technique for automatic neural network design. However, existing MCTS based NAS approaches often utilize manually designed action space, which is not directly related to the…

Machine Learning · Computer Science 2021-04-02 Linnan Wang , Saining Xie , Teng Li , Rodrigo Fonseca , Yuandong Tian

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Efficient evaluation of a network architecture drawn from a large search space remains a key challenge in Neural Architecture Search (NAS). Vanilla NAS evaluates each architecture by training from scratch, which gives the true performance…

Machine Learning · Computer Science 2024-08-13 Yiyang Zhao , Linnan Wang , Yuandong Tian , Rodrigo Fonseca , Tian Guo

While existing work on neural architecture search (NAS) tunes hyperparameters in a separate post-processing step, we demonstrate that architectural choices and other hyperparameter settings interact in a way that can render this separation…

Machine Learning · Computer Science 2018-07-19 Arber Zela , Aaron Klein , Stefan Falkner , Frank Hutter

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

This paper aims to explore the feasibility of neural architecture search (NAS) given only a pre-trained model without using any original training data. This is an important circumstance for privacy protection, bias avoidance, etc., in…

Machine Learning · Computer Science 2022-07-15 Zechun Liu , Zhiqiang Shen , Yun Long , Eric Xing , Kwang-Ting Cheng , Chas Leichner

Neural Architecture Search (NAS) has become a popular method for discovering effective model architectures, especially for target hardware. As such, NAS methods that find optimal architectures under constraints are essential. In our paper,…

Machine Learning · Computer Science 2023-04-25 Yicheng Fan , Dana Alon , Jingyue Shen , Daiyi Peng , Keshav Kumar , Yun Long , Xin Wang , Fotis Iliopoulos , Da-Cheng Juan , Erik Vee

Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image…

Computation and Language · Computer Science 2019-06-13 Ramakanth Pasunuru , Mohit Bansal

The search space of neural architecture search (NAS) for convolutional neural network (CNN) is huge. To reduce searching cost, most NAS algorithms use fixed outer network level structure, and search the repeatable cell structure only. Such…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Chunnan Wang , Hongzhi Wang , Guosheng Feng , Fei Geng

The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately…

Machine Learning · Computer Science 2020-04-01 Renqian Luo , Tao Qin , Enhong Chen

Multi-task neural architecture search (NAS) enables transferring architectural knowledge among different tasks. However, ranking disorder between the source task and the target task degrades the architecture performance on the downstream…

Neural and Evolutionary Computing · Computer Science 2026-02-03 TingJie Zhang , HaiLin Liu
‹ Prev 1 4 5 6 7 8 10 Next ›