English
Related papers

Related papers: iDARTS: Improving DARTS by Node Normalization and …

200 papers

Neural architecture search (NAS) has been an active direction of automatic machine learning (Auto-ML), aiming to explore efficient network structures. The searched architecture is evaluated by training on datasets with fixed data…

Machine Learning · Computer Science 2022-01-31 Xiaoxing Wang , Xiangxiang Chu , Junchi Yan , Xiaokang Yang

This paper introduces a novel optimization method for differential neural architecture search, based on the theory of prediction with expert advice. Its optimization criterion is well fitted for an architecture-selection, i.e., it minimizes…

Machine Learning · Computer Science 2019-06-20 Niv Nayman , Asaf Noy , Tal Ridnik , Itamar Friedman , Rong Jin , Lihi Zelnik-Manor

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

Machine Learning · Computer Science 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

This study aims at making the architecture search process more adaptive for one-shot or online training. It is extended from the existing study on differentiable neural architecture search, and we made the backbone architecture…

Artificial Intelligence · Computer Science 2021-06-15 Renlong Jie , Junbin Gao

Recently proposed neural architecture search (NAS) methods co-train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jiefeng Peng , Jiqi Zhang , Changlin Li , Guangrun Wang , Xiaodan Liang , Liang Lin

While recent NAS algorithms are thousands of times faster than the pioneering works, it is often overlooked that they use fewer candidate operations, resulting in a significantly smaller search space. We present PR-DARTS, a NAS algorithm…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Convolutional neural networks (CNNs) have shown good performance in polarimetric synthetic aperture radar (PolSAR) image classification due to the automation of feature engineering. Excellent hand-crafted architectures of CNNs incorporated…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Hongwei Dong , Siyu Zhang , Bin Zou , Lamei Zhang

Single Image Super-Resolution (SISR) tasks have achieved significant performance with deep neural networks. However, the large number of parameters in CNN-based met-hods for SISR tasks require heavy computations. Although several efficient…

Image and Video Processing · Electrical Eng. & Systems 2022-12-20 Han Huang , Li Shen , Chaoyang He , Weisheng Dong , Wei Liu

Differentiable neural architecture search methods became popular in recent years, mainly due to their low search costs and flexibility in designing the search space. However, these methods suffer the difficulty in optimizing network, so…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Yuhui Xu , Lingxi Xie , Xiaopeng Zhang , Xin Chen , Bowen Shi , Qi Tian , Hongkai Xiong

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

The emergence of neural architecture search (NAS) has greatly advanced the research on network design. Recent proposals such as gradient-based methods or one-shot approaches significantly boost the efficiency of NAS. In this paper, we…

Machine Learning · Computer Science 2019-12-09 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

To preserve user privacy while enabling mobile intelligence, techniques have been proposed to train deep neural networks on decentralized data. However, training over decentralized data makes the design of neural architecture quite…

Machine Learning · Computer Science 2022-07-07 Jinliang Yuan , Mengwei Xu , Yuxin Zhao , Kaigui Bian , Gang Huang , Xuanzhe Liu , Shangguang Wang

Neural architecture search has shown its great potential in various areas recently. However, existing methods rely heavily on a black-box controller to search architectures, which suffers from the serious problem of lacking…

Machine Learning · Computer Science 2020-09-29 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Neural Architecture Search (NAS), aiming at automatically designing network architectures by machines, is hoped and expected to bring about a new revolution in machine learning. Despite these high expectation, the effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Changlin Li , Jiefeng Peng , Liuchun Yuan , Guangrun Wang , Xiaodan Liang , Liang Lin , Xiaojun Chang

Neural Architecture Search (NAS) achieves significant progress in many computer vision tasks. While many methods have been proposed to improve the efficiency of NAS, the search progress is still laborious because training and evaluating…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Dongzhan Zhou , Xinchi Zhou , Wenwei Zhang , Chen Change Loy , Shuai Yi , Xuesen Zhang , Wanli Ouyang

Deep neural networks achieve outstanding results in challenging image classification tasks. However, the design of network topologies is a complex task and the research community makes a constant effort in discovering top-accuracy…

Machine Learning · Computer Science 2019-09-25 Florian Scheidegger , Luca Benini , Costas Bekas , Cristiano Malossi

In this paper, we propose BNAS-v2 to further improve the efficiency of NAS, embodying both superiorities of BCNN simultaneously. To mitigate the unfair training issue of BNAS, we employ continuous relaxation strategy to make each edge of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao

Recently, neural architecture search (NAS) methods have attracted much attention and outperformed manually designed architectures on a few high-level vision tasks. In this paper, we propose HiNAS (Hierarchical NAS), an effort towards…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Haokui Zhang , Ying Li , Hao Chen , Chunhua Shen

Neural Architecture Search remains a very challenging meta-learning problem. Several recent techniques based on parameter-sharing idea have focused on reducing the NAS running time by leveraging proxy models, leading to architectures with…

Machine Learning · Computer Science 2022-02-08 Minsu Cho , Mohammadreza Soltani , Chinmay Hegde

Neural architecture search automates the design of neural network architectures usually by exploring a large and thus complex architecture search space. To advance the architecture search, we present a graph diffusion-based NAS approach…

Machine Learning · Computer Science 2024-03-25 Rohan Asthana , Joschua Conrad , Youssef Dawoud , Maurits Ortmanns , Vasileios Belagiannis