中文
相关论文

相关论文: $\mu$NAS: Constrained Neural Architecture Search f…

200 篇论文

As the application area of convolutional neural networks (CNN) is growing in embedded devices, it becomes popular to use a hardware CNN accelerator, called neural processing unit (NPU), to achieve higher performance per watt than CPUs or…

机器学习 · 计算机科学 2020-09-07 Jaeseong Lee , Duseok Kang , Soonhoi Ha

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

机器学习 · 计算机科学 2020-03-27 Chun-Ting Liu

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

机器学习 · 计算机科学 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Recently, the expert-crafted neural architectures is increasing overtaken by the utilization of neural architecture search (NAS) and automatic generation (and tuning) of network structures which has a close relation to the Hyperparameter…

计算机视觉与模式识别 · 计算机科学 2023-07-19 Seyed Mahdi Shariatzadeh , Mahmood Fathy , Reza Berangi , Mohammad Shahverdy

Neural Architecture Search (NAS) is a collection of methods to craft the way neural networks are built. Current NAS methods are far from ab initio and automatic, as they use manual backbone architectures or micro building blocks (cells),…

机器学习 · 计算机科学 2020-10-20 Anubhav Garg , Amit Kumar Saha , Debo Dutta

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

计算机视觉与模式识别 · 计算机科学 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

Neural Architecture Search (NAS) is a laborious process. Prior work on automated NAS targets mainly on improving accuracy, but lacks consideration of computational resource use. We propose the Resource-Efficient Neural Architect (RENA), an…

神经与进化计算 · 计算机科学 2018-06-22 Yanqi Zhou , Siavash Ebrahimi , Sercan Ö. Arık , Haonan Yu , Hairong Liu , Greg Diamos

One-Shot Neural Architecture Search (NAS) is a promising method to significantly reduce search time without any separate training. It can be treated as a Network Compression problem on the architecture parameters from an over-parameterized…

机器学习 · 计算机科学 2019-06-11 Hongpeng Zhou , Minghao Yang , Jun Wang , Wei Pan

The majority of IoT devices like smartwatches, smart plugs, HVAC controllers, etc., are powered by hardware with a constrained specification (low memory, clock speed and processor) which is insufficient to accommodate and execute large,…

Deep Learning models have experienced exponential growth in complexity and resource demands in recent years. Accelerating these models for efficient execution on resource-constrained devices has become more crucial than ever. Two notable…

机器学习 · 计算机科学 2024-08-09 Inas Bachiri , Hadjer Benmeziane , Smail Niar , Riyadh Baghdadi , Hamza Ouarnoughi , Abdelkrime Aries

Neural Architecture Search (NAS) is increasingly popular to automatically explore the accuracy versus computational complexity trade-off of Deep Learning (DL) architectures. When targeting tiny edge devices, the main challenge for DL…

机器学习 · 计算机科学 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

Many studies estimate energy consumption using proxy metrics like memory usage, FLOPs, and inference latency, with the assumption that reducing these metrics will also lower energy consumption in neural networks. This paper, however, takes…

机器学习 · 计算机科学 2025-04-14 Hoang-Loc La , Phuong Hoai Ha

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

机器学习 · 计算机科学 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

Neural architecture search (NAS) has shown great promise in automatically designing lightweight models. However, conventional approaches are insufficient in training the supernet and pay little attention to actual robot hardware resources.…

机器人学 · 计算机科学 2025-09-26 Shouren Mao , Minghao Qin , Wei Dong , Huajian Liu , Yongzhuo Gao

Due to limited computational cost and energy consumption, most neural network models deployed in mobile devices are tiny. However, tiny neural networks are commonly very vulnerable to attacks. Current research has proved that larger model…

机器学习 · 计算机科学 2022-01-11 Guoyang Xie , Jinbao Wang , Guo Yu , Feng Zheng , Yaochu Jin

Neural architecture search (NAS) has recently reshaped our understanding on various vision tasks. Similar to the success of NAS in high-level vision tasks, it is possible to find a memory and computationally efficient solution via NAS with…

图像与视频处理 · 电气工程与系统科学 2021-04-07 Qian Ning , Weisheng Dong , Xin Li , Jinjian Wu , Leida Li , Guangming Shi

The term Neural Architecture Search (NAS) refers to the automatic optimization of network architectures for a new, previously unknown task. Since testing an architecture is computationally very expensive, many optimizers need days or even…

机器学习 · 计算机科学 2019-07-22 Martin Wistuba

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural architecture search (NAS) has become an important approach to automatically find effective architectures. To cover all possible good architectures, we need to search in an extremely large search space with billions of candidate…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Yong Guo , Yaofo Chen , Yin Zheng , Peilin Zhao , Jian Chen , Junzhou Huang , Mingkui Tan

In this paper, we present a novel multi-objective hardware-aware neural architecture search (NAS) framework, namely HSCoNAS, to automate the design of deep neural networks (DNNs) with high accuracy but low latency upon target hardware. To…

机器学习 · 计算机科学 2021-03-16 Xiangzhong Luo , Di Liu , Shuo Huai , Weichen Liu