English
Related papers

Related papers: One Proxy Device Is Enough for Hardware-Aware Neur…

200 papers

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Neural architecture search (NAS) enables researchers to automatically explore broad design spaces in order to improve efficiency of neural networks. This efficiency is especially important in the case of on-device deployment, where…

Machine Learning · Computer Science 2021-01-20 Łukasz Dudziak , Thomas Chau , Mohamed S. Abdelfattah , Royson Lee , Hyeji Kim , Nicholas D. Lane

Unmanned Aerial Vehicles (drones) are emerging as a promising technology for both environmental and infrastructure monitoring, with broad use in a plethora of applications. Many such applications require the use of computer vision…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Christos Kyrkou , George Plastiras , Stylianos Venieris , Theocharis Theocharides , Christos-Savvas Bouganis

The growing capacity of neural networks has strongly contributed to their success at complex machine learning tasks and the computational demand of such large models has, in turn, stimulated a significant improvement in the hardware…

Machine Learning · Computer Science 2021-04-27 Mohammed Amer , Tomás Maul , Iman Yi Liao

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the…

Machine Learning · Computer Science 2021-11-05 Jun-Liang Lin , Sheng-De Wang

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

A new trans-disciplinary knowledge area, Edge Artificial Intelligence or Edge Intelligence, is beginning to receive a tremendous amount of interest from the machine learning community due to the ever increasing popularization of the…

Neural and Evolutionary Computing · Computer Science 2020-06-23 Christiam F. Frasser , Pablo Linares-Serrano , V. Canals , Miquel Roca , T. Serrano-Gotarredona , Josep L. Rossello

Recent breakthroughs in Neural Architectural Search (NAS) have achieved state-of-the-art performances in applications such as image classification and language modeling. However, these techniques typically ignore device-related objectives…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Jin-Dong Dong , An-Chieh Cheng , Da-Cheng Juan , Wei Wei , Min Sun

Neural Architecture Search (NAS) has been pivotal in finding optimal network configurations for Convolution Neural Networks (CNNs). While many methods explore NAS from a global search-space perspective, the employed optimization schemes…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Yi Ru Wang , Samir Khaki , Weihang Zheng , Mahdi S. Hosseini , Konstantinos N. Plataniotis

Recently, deep learning has become a de facto standard in machine learning with convolutional neural networks (CNNs) demonstrating spectacular success on a wide variety of tasks. However, CNNs are typically very demanding computationally at…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Yochai Zur , Chaim Baskin , Evgenii Zheltonozhskii , Brian Chmiel , Itay Evron , Alex M. Bronstein , Avi Mendelson

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

Neural and Evolutionary Computing · Computer Science 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu

Designing domain specific neural networks is a time-consuming, error-prone, and expensive task. Neural Architecture Search (NAS) exists to simplify domain-specific model development but there is a gap in the literature for time series…

Machine Learning · Computer Science 2024-02-06 Tobias King , Yexu Zhou , Tobias Röddiger , Michael Beigl

Hardware-aware Neural Architecture Search (HW-NAS) is a technique used to automatically design the architecture of a neural network for a specific task and target hardware. However, evaluating the performance of candidate architectures is a…

Neural and Evolutionary Computing · Computer Science 2023-11-08 Nilotpal Sinha , Abd El Rahman Shabayek , Anis Kacem , Peyman Rostami , Carl Shneider , Djamila Aouada

Graph Neural Networks (GNNs) are becoming increasingly popular for graph-based learning tasks such as point cloud processing due to their state-of-the-art (SOTA) performance. Nevertheless, the research community has primarily focused on…

Machine Learning · Computer Science 2024-08-26 Ao Zhou , Jianlei Yang , Yingjie Qi , Tong Qiao , Yumeng Shi , Cenlin Duan , Weisheng Zhao , Chunming Hu

Neural Architecture Search (NAS) is an open and challenging problem in machine learning. While NAS offers great promise, the prohibitive computational demand of most of the existing NAS methods makes it difficult to directly search the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Rameswar Panda , Michele Merler , Mayoore Jaiswal , Hui Wu , Kandan Ramakrishnan , Ulrich Finkler , Chun-Fu Chen , Minsik Cho , David Kung , Rogerio Feris , Bishwaranjan Bhattacharjee

In one-shot NAS, sub-networks need to be searched from the supernet to meet different hardware constraints. However, the search cost is high and $N$ times of searches are needed for $N$ different constraints. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Sian-Yao Huang , Wei-Ta Chu

Embedding Convolutional Neural Network (CNN) into edge devices for inference is a very challenging task because such lightweight hardware is not born to handle this heavyweight software, which is the common overhead from the modern…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Ching-Chen Wang , Ching-Te Chiu , Jheng-Yi Chang

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in audio tagging tasks. However, deploying these models on resource-constrained devices like the Raspberry Pi poses challenges related to computational…

Existing hardware-aware NAS (HW-NAS) methods typically assume access to precise information circa the target device, either via analytical approximations of the post-compilation latency model, or through learned latency predictors. Such…

Machine Learning · Computer Science 2026-05-18 Francesco Capuano , Gabriele Tiboni , Niccolò Cavagnero , Giuseppe Averta