English
Related papers

Related papers: NASH: Neural Architecture Search for Hardware-Opti…

200 papers

Pareto front profiling in multi-objective optimization (MOO), i.e., finding a diverse set of Pareto optimal solutions, is challenging, especially with expensive objectives that require training a neural network. Typically, in MOO for neural…

Machine Learning · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Arber Zela , Benedikt Staffler , Samuel Dooley , Josif Grabocka , Frank Hutter

In-Memory Computing (IMC) hardware using Memristive Crossbar Arrays (MCAs) are gaining popularity to accelerate Deep Neural Networks (DNNs) since it alleviates the "memory wall" problem associated with von-Neumann architecture. The hardware…

Emerging Technologies · Computer Science 2021-06-24 Shubham Negi , Indranil Chakraborty , Aayush Ankit , Kaushik Roy

Accurate surface roughness prediction is critical for ensuring high product quality, especially in areas like manufacturing and aerospace, where the smallest imperfections can compromise performance or safety. However, this is challenging…

Computational Engineering, Finance, and Science · Computer Science 2024-05-29 Penghui Ruan , Divya Saxena , Jiannong Cao , Xiaoyun Liu , Ruoxin Wang , Chi Fai Cheung

Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival…

Machine Learning · Computer Science 2022-10-07 Andrea Falanti , Eugenio Lomurno , Stefano Samele , Danilo Ardagna , Matteo Matteucci

Designing convolutional neural networks (CNN) for mobile devices is challenging because mobile models need to be small and fast, yet still accurate. Although significant efforts have been dedicated to design and improve mobile CNNs on all…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , Quoc V. Le

Neural Architecture Search (NAS) has become the de fecto tools in the industry in automating the design of deep neural networks for various applications, especially those driven by mobile and edge devices with limited computing resources.…

Machine Learning · Computer Science 2024-02-13 Ruiyang Qin , Yuting Hu , Zheyu Yan , Jinjun Xiong , Ahmed Abbasi , Yiyu Shi

Recently, several approaches successfully demonstrated that weight-sharing Neural Architecture Search (NAS) can effectively explore a search space of elastic low-rank adapters (LoRA), allowing the parameter-efficient fine-tuning (PEFT) and…

Machine Learning · Computer Science 2024-04-18 J. Pablo Muñoz , Jinjie Yuan , Nilesh Jain

By the widespread popularity of electronic devices, the emergence of biometric technology has brought significant convenience to user authentication compared with the traditional password and mode unlocking. Among many biological…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Ning Zhu

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Neural Architecture Search (NAS) benchmarks significantly improved the capability of developing and comparing NAS methods while at the same time drastically reduced the computational overhead by providing meta-information about thousands of…

Machine Learning · Computer Science 2023-03-31 Vasco Lopes , Bruno Degardin , Luís A. Alexandre

Recent breakthroughs in Neural Architectural Search (NAS) have achieved state-of-the-art performance in many tasks such as image classification and language understanding. However, most existing works only optimize for model accuracy and…

We achieve very efficient deep learning model deployment that designs neural network architectures to fit different hardware constraints. Given a constraint, most neural architecture search (NAS) methods either sample a set of sub-networks…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Sian-Yao Huang , Wei-Ta Chu

Designing accurate and efficient convolutional neural architectures for vast amount of hardware is challenging because hardware designs are complex and diverse. This paper addresses the hardware diversity challenge in Neural Architecture…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Li Lyna Zhang , Yuqing Yang , Yuhang Jiang , Wenwu Zhu , Yunxin Liu

In this work, we employ neural architecture search (NAS) to enhance the efficiency of deploying diverse machine learning (ML) tasks on in-memory computing (IMC) architectures. Initially, we design three fundamental components inspired by…

Machine Learning · Computer Science 2024-06-12 Md Hasibul Amin , Mohammadreza Mohammadi , Ramtin Zand

This paper presents a hardware-efficient deep neural network (DNN), optimized through hardware-aware neural architecture search (HW-NAS); the DNN supports the classification of session-level encrypted traffic on resource-constrained…

Networking and Internet Architecture · Computer Science 2026-03-20 Adel Chehade , Edoardo Ragusa , Paolo Gastaldo , Rodolfo Zunino

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Neural Architecture Search (NAS) has attracted growing interest. To reduce the search cost, recent work has explored weight sharing across models and made major progress in One-Shot NAS. However, it has been observed that a model with…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Xin Xia , Xuefeng Xiao , Xing Wang , Min Zheng

Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent high-sparsity activation. However, most prior SNN methods use…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Youngeun Kim , Yuhang Li , Hyoungseob Park , Yeshwanth Venkatesha , Priyadarshini Panda

One-shot neural architecture search (NAS) has played a crucial role in making NAS methods computationally feasible in practice. Nevertheless, there is still a lack of understanding on how these weight-sharing algorithms exactly work due to…

Machine Learning · Computer Science 2020-04-14 Arber Zela , Julien Siems , Frank Hutter

Neural Architecture Search (NAS) has proven effective in discovering new Convolutional Neural Network (CNN) architectures, particularly for scenarios with well-defined accuracy optimization goals. However, previous approaches often involve…

Machine Learning · Computer Science 2024-08-28 Ye Qiao , Haocheng Xu , Yifan Zhang , Sitao Huang