English
Related papers

Related papers: BOMP-NAS: Bayesian Optimization Mixed Precision NA…

200 papers

Neural architecture search (NAS) targets at finding the optimal architecture of a neural network for a problem or a family of problems. Evaluations of neural architectures are very time-consuming. One of the possible ways to mitigate this…

Machine Learning · Computer Science 2021-05-20 Ilya Trofimov , Nikita Klyuchnikov , Mikhail Salnikov , Alexander Filippov , Evgeny Burnaev

The automated machine learning (AutoML) field has become increasingly relevant in recent years. These algorithms can develop models without the need for expert knowledge, facilitating the application of machine learning techniques in the…

Machine Learning · Computer Science 2022-12-14 Andrea Falanti , Eugenio Lomurno , Danilo Ardagna , Matteo Matteucci

In this paper, we propose the CrossNAS framework, an automated approach for exploring a vast, multidimensional search space that spans various design abstraction layers-circuits, architecture, and systems-to optimize the deployment of…

Emerging Technologies · Computer Science 2025-07-04 Md Hasibul Amin , Mohammadreza Mohammadi , Jason D. Bakos , Ramtin Zand

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

Neural Architecture Search (NAS) has shown excellent results in designing architectures for computer vision problems. NAS alleviates the need for human-defined settings by automating architecture design and engineering. However, NAS methods…

Machine Learning · Computer Science 2021-10-29 Vasco Lopes , Saeid Alirezazadeh , Luís A. Alexandre

We tackle the problem of visual search under resource constraints. Existing systems use the same embedding model to compute representations (embeddings) for the query and gallery images. Such systems inherently face a hard…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Rahul Duggal , Hao Zhou , Shuo Yang , Yuanjun Xiong , Wei Xia , Zhuowen Tu , Stefano Soatto

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

Machine Learning · Computer Science 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Neural Architecture Search (NAS) represents a class of methods to generate the optimal neural network architecture and typically iterate over candidate architectures till convergence over some particular metric like validation loss. They…

Machine Learning · Computer Science 2019-10-22 Abhishek Singh , Anubhav Garg , Jinan Zhou , Shiv Ram Dubey , Debo Dutta

This work presents a novel approach to neural architecture search (NAS) that aims to reduce energy costs and increase carbon efficiency during the model design process. The proposed framework, called carbon-efficient NAS (CE-NAS), consists…

Machine Learning · Computer Science 2023-07-12 Yiyang Zhao , Tian Guo

Considering the noise level limit, one crucial aspect for quantum machine learning is to design a high-performing variational quantum circuit architecture with small number of quantum gates. As the classical neural architecture search…

Quantum Physics · Physics 2024-03-08 Jialin Chen , Zhiqiang Cai , Ke Xu , Di Wu , Wei Cao

Previous works on meta-learning either relied on elaborately hand-designed network structures or adopted specialized learning rules to a particular domain. We propose a universal framework to optimize the meta-learning process automatically…

Machine Learning · Computer Science 2019-09-10 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao shi , Feiyu Xu

The Neural Architecture Search (NAS) problem is typically formulated as a graph search problem where the goal is to learn the optimal operations over edges in order to maximise a graph-level global objective. Due to the large architecture…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Vasco Lopes , Fabio Maria Carlucci , Pedro M Esperança , Marco Singh , Victor Gabillon , Antoine Yang , Hang Xu , Zewei Chen , Jun Wang

The rapid proliferation of computing domains relying on Internet of Things (IoT) devices has created a pressing need for efficient and accurate deep-learning (DL) models that can run on low-power devices. However, traditional DL models tend…

We implement a differentiable Neural Architecture Search (NAS) method inspired by FBNet for discovering neural networks that are heavily optimized for a particular target device. The FBNet NAS method discovers a neural network from a given…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Sai Vineeth Kalluru Srinivas , Harideep Nair , Vinay Vidyasagar

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Neural architecture search (NAS) has emerged as a powerful paradigm that enables researchers to automatically explore vast search spaces and discover efficient neural networks. However, NAS suffers from a critical bottleneck, i.e. the…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Yu Xue , Pengcheng Jiang , Chenchen Zhu , MengChu Zhou , Mohamed Wahib , Moncef Gabbouj

Bayesian network structure learning is an NP-hard problem that has been faced by a number of traditional approaches in recent decades. Currently, quantum technologies offer a wide range of advantages that can be exploited to solve…

Quantum Physics · Physics 2022-03-07 Vicente P. Soloviev , Concha Bielza , Pedro Larrañaga

To prevent the leakage of private information while enabling automated machine intelligence, there is an emerging trend to integrate federated learning and Neural Architecture Search (NAS). Although promising as it may seem, the coupling of…

Machine Learning · Computer Science 2020-11-09 Chunhui Zhang , Yongyuan Liang , Xiaoming Yuan , Lei Cheng

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Mixed-precision quantization can potentially achieve the optimal tradeoff between performance and compression rate of deep neural networks, and thus, have been widely investigated. However, it lacks a systematic method to determine the…

Machine Learning · Computer Science 2021-02-23 Huanrui Yang , Lin Duan , Yiran Chen , Hai Li