English
Related papers

Related papers: Scheduled Differentiable Architecture Search for V…

200 papers

Neural Architecture Search (NAS), the process of automating architecture engineering, is an appealing next step to advancing end-to-end Automatic Speech Recognition (ASR), replacing expert-designed networks with learned, task-specific…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-12 Huahuan Zheng , Keyu An , Zhijian Ou

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen

Conventional neural architecture search (NAS) approaches are based on reinforcement learning or evolutionary strategy, which take more than 3000 GPU hours to find a good model on CIFAR-10. We propose an efficient NAS approach learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Xuanyi Dong , Yi Yang

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

Deep Neural Networks (DNNs) have achieved great success in many applications. The architectures of DNNs play a crucial role in their performance, which is usually manually designed with rich expertise. However, such a design process is…

Neural and Evolutionary Computing · Computer Science 2022-02-07 Yuqiao Liu , Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen , Kay Chen Tan

Recent years have witnessed the popularity of Graph Neural Networks (GNN) in various scenarios. To obtain optimal data-specific GNN architectures, researchers turn to neural architecture search (NAS) methods, which have made impressive…

Machine Learning · Computer Science 2020-09-08 Huan Zhao , Lanning Wei , Quanming Yao

GNAS (Graph Neural Architecture Search) has demonstrated great effectiveness in automatically designing the optimal graph neural architectures for multiple downstream tasks, such as node classification and link prediction. However, most…

Machine Learning · Computer Science 2024-12-04 Guanghui Zhu , Zipeng Ji , Jingyan Chen , Limin Wang , Chunfeng Yuan , Yihua Huang

We develop a Neural Architecture Search (NAS) framework for CycleGAN that carries out unpaired image-to-image translation task. Extending previous NAS techniques for Generative Adversarial Networks (GANs) to CycleGAN is not straightforward…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Taegun An , Changhee Joo

Deep neural networks have achieved great success for video analysis and understanding. However, designing a high-performance neural architecture requires substantial efforts and expertise. In this paper, we make the first attempt to let…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Wei Peng , Xiaopeng Hong , Guoying Zhao

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

Machine Learning · Computer Science 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

Neural Architecture Search (NAS) has gained significant popularity as an effective tool for designing high performance deep neural networks (DNNs). NAS can be performed via policy gradient, evolutionary algorithms, differentiable…

Machine Learning · Computer Science 2021-04-27 Hanxun Huang , Xingjun Ma , Sarah M. Erfani , James Bailey

The design of handcrafted neural networks requires a lot of time and resources. Recent techniques in Neural Architecture Search (NAS) have proven to be competitive or better than traditional handcrafted design, although they require domain…

Machine Learning · Computer Science 2021-03-17 Cat P. Le , Mohammadreza Soltani , Robert Ravier , Vahid Tarokh

This paper addresses the difficult problem of finding an optimal neural architecture design for a given image classification task. We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Juan-Manuel Perez-Rua , Moez Baccouche , Stephane Pateux

Recently, dynamic inference has emerged as a promising way to reduce the computational cost of deep convolutional neural network (CNN). In contrast to static methods (e.g. weight pruning), dynamic inference adaptively adjusts the inference…

Computer Vision and Pattern Recognition · Computer Science 2019-12-18 Zhihang Yuan , Bingzhe Wu , Zheng Liang , Shiwan Zhao , Weichen Bi , Guangyu Sun

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

Machine Learning · Computer Science 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Neural Architecture Search (NAS) has recently gained increased attention, as a class of approaches that automatically searches in an input space of network architectures. A crucial part of the NAS pipeline is the encoding of the…

Machine Learning · Computer Science 2021-08-18 Michail Chatzianastasis , George Dasoulas , Georgios Siolas , Michalis Vazirgiannis

Point cloud architecture design has become a crucial problem for 3D deep learning. Several efforts exist to manually design architectures with high accuracy in point cloud tasks such as classification, segmentation, and detection. Recent…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Guohao Li , Mengmeng Xu , Silvio Giancola , Ali Thabet , Bernard Ghanem

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

Machine Learning · Computer Science 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Noor Awad , Neeratyoy Mallik , Frank Hutter