English
Related papers

Related papers: MiLeNAS: Efficient Neural Architecture Search via …

200 papers

One-shot neural architecture search (NAS) substantially improves the search efficiency by training one supernet to estimate the performance of every possible child architecture (i.e., subnet). However, the inconsistency of characteristics…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Xin He , Jiangchao Yao , Yuxin Wang , Zhenheng Tang , Ka Chu Cheung , Simon See , Bo Han , Xiaowen Chu

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Neural architecture search (NAS) promises to make deep learning accessible to non-experts by automating architecture engineering of deep neural networks. BANANAS is one state-of-the-art NAS method that is embedded within the Bayesian…

Machine Learning · Computer Science 2021-07-16 Lennart Schneider , Florian Pfisterer , Martin Binder , Bernd Bischl

With the flourish of differentiable neural architecture search (NAS), automatically searching latency-constrained architectures gives a new perspective to reduce human labor and expertise. However, the searched architectures are usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Yibo Hu , Xiang Wu , Ran He

Recently, Neural Architecture Search (NAS) methods are introduced and show impressive performance on many benchmarks. Among those NAS studies, Neural Architecture Transformer (NAT) aims to improve the given neural architecture to have…

Machine Learning · Computer Science 2021-10-20 Do-Guk Kim , Heung-Chang Lee

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

In this work, we employ neural architecture search (NAS) to enhance the efficiency of deploying diverse machine learning (ML) tasks on in-memory computing (IMC) architectures. Initially, we design three fundamental components inspired by…

Machine Learning · Computer Science 2024-06-12 Md Hasibul Amin , Mohammadreza Mohammadi , Ramtin Zand

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Neural Architecture Search (NAS), a framework which automates the task of designing neural networks, has recently been actively studied in the field of deep learning. However, there are only a few NAS methods suitable for 3D medical image…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Woong Bae , Seungho Lee , Yeha Lee , Beomhee Park , Minki Chung , Kyu-Hwan Jung

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. We apply this idea to Federated Learning (FL), wherein predefined neural network models are trained on the client/device data. This…

Machine Learning · Computer Science 2020-10-21 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Binary Neural Networks (BNNs) have received significant attention due to their promising efficiency. Currently, most BNN studies directly adopt widely-used CNN architectures, which can be suboptimal for BNNs. This paper proposes a novel…

Artificial Intelligence · Computer Science 2021-03-30 Tianchen Zhao , Xuefei Ning , Xiangsheng Shi , Songyi Yang , Shuang Liang , Peng Lei , Jianfei Chen , Huazhong Yang , Yu Wang

Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as expert-crafted architectures. While most existing works aim at finding architectures that optimize the prediction…

Performing analytical tasks over graph data has become increasingly interesting due to the ubiquity and large availability of relational information. However, unlike images or sentences, there is no notion of sequence in networks. Nodes…

Neural and Evolutionary Computing · Computer Science 2020-10-28 Matheus Nunes , Gisele L. Pappa

The emergence of neural architecture search (NAS) has greatly advanced the research on network design. Recent proposals such as gradient-based methods or one-shot approaches significantly boost the efficiency of NAS. In this paper, we…

Machine Learning · Computer Science 2019-12-09 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

Machine Learning · Computer Science 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

Neural Architecture Search (NAS) has become a pivotal technique in automated machine learning. Evolutionary Algorithm (EA)-based methods demonstrate superior search quality but suffer from prohibitive computational costs, while…

Neural and Evolutionary Computing · Computer Science 2026-04-02 Xingbang Du , Enzhi Zhang , Rui Zhong , Yang Cao , Masaharu Munetomo

Neural Architecture Search (NAS) aims to automate the design of deep neural networks. However, existing NAS techniques often focus on maximising accuracy, neglecting model efficiency. This limitation restricts their use in…

Machine Learning · Computer Science 2025-01-30 Srikanth Thudumu , Hy Nguyen , Hung Du , Nhat Duong , Zafaryab Rasool , Rena Logothetis , Scott Barnett , Rajesh Vasa , Kon Mouzakis

Benefiting from the search efficiency, differentiable neural architecture search (NAS) has evolved as the most dominant alternative to automatically design competitive deep neural networks (DNNs). We note that DNNs must be executed under…

Machine Learning · Computer Science 2022-09-01 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Weichen Liu

This paper proposes Binary ArchitecTure Search (BATS), a framework that drastically reduces the accuracy gap between binary neural networks and their real-valued counterparts by means of Neural Architecture Search (NAS). We show that…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Hardware-aware Neural Architecture Search approaches (HW-NAS) automate the design of deep learning architectures, tailored specifically to a given target hardware platform. Yet, these techniques demand substantial computational resources,…

Machine Learning · Computer Science 2024-04-22 Nilotpal Sinha , Peyman Rostami , Abd El Rahman Shabayek , Anis Kacem , Djamila Aouada