中文
相关论文

相关论文: Operation-level Progressive Differentiable Archite…

200 篇论文

In this paper, we propose Efficient Progressive Neural Architecture Search (EPNAS), a neural architecture search (NAS) that efficiently handles large search space through a novel progressive search policy with performance prediction based…

机器学习 · 计算机科学 2019-07-11 Yanqi Zhou , Peng Wang , Sercan Arik , Haonan Yu , Syed Zawad , Feng Yan , Greg Diamos

Neural Architecture Search (NAS) continues to serve a key roll in the design and development of neural networks for task specific deployment. Modern NAS techniques struggle to deal with ever increasing search space complexity and compute…

计算机视觉与模式识别 · 计算机科学 2024-11-25 Arjun Sridhar , Yiran Chen

Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has…

神经与进化计算 · 计算机科学 2024-09-10 Reinhard Booysen , Anna Sergeevna Bosman

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

计算机视觉与模式识别 · 计算机科学 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

Recently, neural architecture search (NAS) has been applied to automatically search high-performance networks for medical image segmentation. The NAS search space usually contains a network topology level (controlling connections among…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Yufan He , Dong Yang , Holger Roth , Can Zhao , Daguang Xu

Edge computing aims to enable edge devices, such as IoT devices, to process data locally instead of relying on the cloud. However, deep learning techniques like computer vision and natural language processing can be computationally…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Oshin Dutta , Tanu Kanvar , Sumeet Agarwal

Multiplication is arguably the most cost-dominant operation in modern deep neural networks (DNNs), limiting their achievable efficiency and thus more extensive deployment in resource-constrained applications. To tackle this limitation,…

硬件体系结构 · 计算机科学 2022-12-20 Huihong Shi , Haoran You , Yang Zhao , Zhongfeng Wang , Yingyan Lin

In deep learning applications, the architectures of deep neural networks are crucial in achieving high accuracy. Many methods have been proposed to search for high-performance neural architectures automatically. However, these searched…

机器学习 · 计算机科学 2020-12-14 Ramtin Hosseini , Xingyi Yang , Pengtao Xie

State-of-the-art automatic speech recognition (ASR) system development is data and computation intensive. The optimal design of deep neural networks (DNNs) for these systems often require expert knowledge and empirical evaluation. In this…

音频与语音处理 · 电气工程与系统科学 2022-03-30 Shoukang Hu , Xurong Xie , Mingyu Cui , Jiajun Deng , Shansong Liu , Jianwei Yu , Mengzhe Geng , Xunying Liu , Helen Meng

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

机器学习 · 计算机科学 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

机器学习 · 计算机科学 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool

Neural Architecture Search (NAS) has shown promising capability in learning text representation. However, existing text-based NAS neither performs a learnable fusion of neural operations to optimize the architecture, nor encodes the latent…

计算与语言 · 计算机科学 2023-07-13 Kuan-Chun Chen , Cheng-Te Li , Kuo-Jung Lee

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

Designing effective architectures is one of the key factors behind the success of deep neural networks. Existing deep architectures are either manually designed or automatically searched by some Neural Architecture Search (NAS) methods.…

计算机视觉与模式识别 · 计算机科学 2021-02-23 Yong Guo , Yin Zheng , Mingkui Tan , Qi Chen , Zhipeng Li , Jian Chen , Peilin Zhao , Junzhou Huang

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

机器学习 · 计算机科学 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

计算机视觉与模式识别 · 计算机科学 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Graph neural architecture search has received a lot of attention as Graph Neural Networks (GNNs) has been successfully applied on the non-Euclidean data recently. However, exploring all possible GNNs architectures in the huge search space…

机器学习 · 计算机科学 2021-12-08 Jiamin Chen , Jianliang Gao , Yibo Chen , Oloulade Babatounde Moctard , Tengfei Lyu , Zhao Li

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

机器学习 · 计算机科学 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Gradient-based one-shot neural architecture search (NAS) has significantly reduced the cost of exploring architectural spaces with discrete design choices, such as selecting operations within a model. However, the field faces two major…

机器学习 · 计算机科学 2025-07-23 Abhash Kumar Jha , Shakiba Moradian , Arjun Krishnakumar , Martin Rapp , Frank Hutter

We present new Recurrent Neural Network (RNN) cells for image classification using a Neural Architecture Search (NAS) approach called DARTS. We are interested in the ReNet architecture, which is a RNN based approach presented as an…

计算机视觉与模式识别 · 计算机科学 2023-04-13 Brian Moser , Federico Raue , Jörn Hees , Andreas Dengel