中文
相关论文

相关论文: LC-NAS: Latency Constrained Neural Architecture Se…

200 篇论文

Efficient deployment of neural networks (NN) requires the co-optimization of accuracy and latency. For example, hardware-aware neural architecture search has been used to automatically find NN architectures that satisfy a latency constraint…

机器学习 · 计算机科学 2024-03-06 Yash Akhauri , Mohamed S. Abdelfattah

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

图像与视频处理 · 电气工程与系统科学 2019-07-29 Nils Gessert , Alexander Schlaefer

Neural Architecture Search (NAS), together with model scaling, has shown remarkable progress in designing high accuracy and fast convolutional architecture families. However, as neither NAS nor model scaling considers sufficient hardware…

计算机视觉与模式识别 · 计算机科学 2021-02-11 Sheng Li , Mingxing Tan , Ruoming Pang , Andrew Li , Liqun Cheng , Quoc Le , Norman P. Jouppi

Designing convolutional neural networks (CNN) for mobile devices is challenging because mobile models need to be small and fast, yet still accurate. Although significant efforts have been dedicated to design and improve mobile CNNs on all…

计算机视觉与模式识别 · 计算机科学 2019-05-30 Mingxing Tan , Bo Chen , Ruoming Pang , Vijay Vasudevan , Mark Sandler , Andrew Howard , Quoc V. Le

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

神经与进化计算 · 计算机科学 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

机器学习 · 计算机科学 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

With the growing workload of inference tasks on mobile devices, state-of-the-art neural architectures (NAs) are typically designed through Neural Architecture Search (NAS) to identify NAs with good tradeoffs between accuracy and efficiency…

性能 · 计算机科学 2022-10-07 Zhuojin Li , Marco Paolieri , Leana Golubchik

Neural Architecture Search (NAS) has proved effective in offering outperforming alternatives to handcrafted neural networks. In this paper we analyse the benefits of NAS for image classification tasks under strict computational constraints.…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Cristian Cioflan , Radu Timofte

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

计算机视觉与模式识别 · 计算机科学 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Satisfying the high computation demand of modern deep learning architectures is challenging for achieving low inference latency. The current approaches in decreasing latency only increase parallelism within a layer. This is because…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Ramyad Hadidi , Jiashen Cao , Michael S. Ryoo , Hyesoon Kim

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

机器学习 · 计算机科学 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Recent advances show that Neural Architectural Search (NAS) method is able to find state-of-the-art image classification deep architectures. In this paper, we consider the one-shot NAS problem for resource constrained applications. This…

计算机视觉与模式识别 · 计算机科学 2020-01-01 Xiaojie Jin , Jiang Wang , Joshua Slocum , Ming-Hsuan Yang , Shengyang Dai , Shuicheng Yan , Jiashi Feng

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

机器学习 · 计算机科学 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai

Long-Tailed (LT) recognition has been widely studied to tackle the challenge of imbalanced data distributions in real-world applications. However, the design of neural architectures for LT settings has received limited attention, despite…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Yuhan Pan , Yanan Sun , Wei Gong

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

机器学习 · 计算机科学 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

In recent years Deep Learning reached significant results in many practical problems, such as computer vision, natural language processing, speech recognition and many others. For many years the main goal of the research was to improve the…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Alexey Letunovskiy , Vladimir Korviakov , Vladimir Polovnikov , Anastasiia Kargapoltseva , Ivan Mazurenko , Yepan Xiong

Neural architecture search (NAS) aims to discover network architectures with desired properties such as high accuracy or low latency. Recently, differentiable NAS (DNAS) has demonstrated promising results while maintaining a search cost…

机器学习 · 计算机科学 2020-08-31 Arash Vahdat , Arun Mallya , Ming-Yu Liu , Jan Kautz

As the application area of convolutional neural networks (CNN) is growing in embedded devices, it becomes popular to use a hardware CNN accelerator, called neural processing unit (NPU), to achieve higher performance per watt than CPUs or…

机器学习 · 计算机科学 2020-09-07 Jaeseong Lee , Duseok Kang , Soonhoi Ha

Neural architecture search (NAS) relies on a good controller to generate better architectures or predict the accuracy of given architectures. However, training the controller requires both abundant and high-quality pairs of architectures…

机器学习 · 计算机科学 2020-11-04 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu