中文
相关论文

相关论文: Multi-Predict: Few Shot Predictors For Efficient N…

200 篇论文

A majority of recent developments in neural architecture search (NAS) have been aimed at decreasing the computational cost of various techniques without affecting their final performance. Towards this goal, several low-fidelity and…

机器学习 · 计算机科学 2022-11-04 Vishak Prasad C , Colin White , Paarth Jain , Sibasis Nayak , Ganesh Ramakrishnan

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

机器学习 · 计算机科学 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

High-resolution representations (HR) are essential for dense prediction tasks such as segmentation, detection, and pose estimation. Learning HR representations is typically ignored in previous Neural Architecture Search (NAS) methods that…

计算机视觉与模式识别 · 计算机科学 2021-06-15 Mingyu Ding , Xiaochen Lian , Linjie Yang , Peng Wang , Xiaojie Jin , Zhiwu Lu , Ping Luo

In this paper, we present a novel multi-objective hardware-aware neural architecture search (NAS) framework, namely HSCoNAS, to automate the design of deep neural networks (DNNs) with high accuracy but low latency upon target hardware. To…

机器学习 · 计算机科学 2021-03-16 Xiangzhong Luo , Di Liu , Shuo Huai , Weichen Liu

Efficient evaluation of a network architecture drawn from a large search space remains a key challenge in Neural Architecture Search (NAS). Vanilla NAS evaluates each architecture by training from scratch, which gives the true performance…

机器学习 · 计算机科学 2024-08-13 Yiyang Zhao , Linnan Wang , Yuandong Tian , Rodrigo Fonseca , Tian Guo

Enabling efficient deep neural network (DNN) inference on edge devices with different hardware constraints is a challenging task that typically requires DNN architectures to be specialized for each device separately. To avoid the huge…

人工智能 · 计算机科学 2026-03-17 Mark Deutel , Simon Geis , Axel Plinge

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate intermediate neural…

机器学习 · 计算机科学 2021-09-27 Yixing Xu , Yunhe Wang , Kai Han , Yehui Tang , Shangling Jui , Chunjing Xu , Chang Xu

As machine learning (ML) algorithms get deployed in an ever-increasing number of applications, these algorithms need to achieve better trade-offs between high accuracy, high throughput and low latency. This paper introduces NASH, a novel…

机器学习 · 计算机科学 2024-03-12 Mengfei Ji , Yuchun Chang , Baolin Zhang , Zaid Al-Ars

Neural architecture search (NAS) approaches aim at automatically finding novel CNN architectures that fit computational constraints while maintaining a good performance on the target platform. We introduce a novel efficient one-shot NAS…

计算机视觉与模式识别 · 计算机科学 2020-05-22 Maxim Berman , Leonid Pishchulin , Ning Xu , Matthew B. Blaschko , Gerard Medioni

Neural architecture search (NAS) is an attractive approach to automate the design of optimized architectures but is constrained by high computational budget, especially when optimizing for multiple, important conflicting objectives. To…

机器学习 · 计算机科学 2025-09-03 Zhao Wei , Chin Chun Ooi , Yew-Soon Ong

Deploying deep learning models requires taking into consideration neural network metrics such as model size, inference latency, and #FLOPs, aside from inference accuracy. This results in deep learning model designers leveraging…

机器学习 · 计算机科学 2024-08-20 Yiyang Zhao , Linnan Wang , Tian Guo

This paper introduces neural architecture search (NAS) for the automatic discovery of small models for keyword spotting (KWS) in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

音频与语音处理 · 电气工程与系统科学 2020-12-21 David Peter , Wolfgang Roth , Franz Pernkopf

Neural Architecture Search (NAS) has significantly improved productivity in the design and deployment of neural networks (NN). As NAS typically evaluates multiple models by training them partially or completely, the improved productivity…

机器学习 · 计算机科学 2022-12-22 Yash Akhauri , J. Pablo Munoz , Nilesh Jain , Ravi Iyer

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

A fundamental question lies in almost every application of deep neural networks: what is the optimal neural architecture given a specific dataset? Recently, several Neural Architecture Search (NAS) frameworks have been developed that use…

分布式、并行与集群计算 · 计算机科学 2019-02-04 Weiwen Jiang , Xinyi Zhang , Edwin H. -M. Sha , Lei Yang , Qingfeng Zhuge , Yiyu Shi , Jingtong Hu

The use of automatic methods, often referred to as Neural Architecture Search (NAS), in designing neural network architectures has recently drawn considerable attention. In this work, we present an efficient NAS approach, named HM- NAS,…

机器学习 · 计算机科学 2019-09-10 Shen Yan , Biyi Fang , Faen Zhang , Yu Zheng , Xiao Zeng , Hui Xu , Mi Zhang

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

神经与进化计算 · 计算机科学 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

The recent progress in neural architecture search (NAS) has allowed scaling the automated design of neural architectures to real-world domains, such as object detection and semantic segmentation. However, one prerequisite for the…

机器学习 · 计算机科学 2021-06-15 Thomas Elsken , Benedikt Staffler , Jan Hendrik Metzen , Frank Hutter

Deep learning has revolutionized computer vision, but it achieved its tremendous success using deep network architectures which are mostly hand-crafted and therefore likely suboptimal. Neural Architecture Search (NAS) aims to bridge this…

计算机视觉与模式识别 · 计算机科学 2025-02-10 Ondřej Týbl , Lukáš Neumann

Neural architecture search (NAS) is a promising technique to design efficient and high-performance deep neural networks (DNNs). As the performance requirements of ML applications grow continuously, the hardware accelerators start playing a…

计算机视觉与模式识别 · 计算机科学 2021-08-03 Guihong Li , Sumit K. Mandal , Umit Y. Ogras , Radu Marculescu