English
Related papers

Related papers: FP-NAS: Fast Probabilistic Neural Architecture Sea…

200 papers

Different from other deep scalable architecture-based NAS approaches, Broad Neural Architecture Search (BNAS) proposes a broad scalable architecture which consists of convolution and enhancement blocks, dubbed Broad Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , C. L. Philip Chen

Bayesian Neural Networks (BNNs) offer a mathematically grounded framework to quantify the uncertainty of model predictions but come with a prohibitive computation cost for both training and inference. In this work, we show a novel network…

Machine Learning · Computer Science 2022-02-10 Duo Wang , Yiren Zhao , Ilia Shumailov , Robert Mullins

Current state-of-the-art convolutional architectures for object detection are manually designed. Here we aim to learn a better architecture of feature pyramid network for object detection. We adopt Neural Architecture Search and discover a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Golnaz Ghiasi , Tsung-Yi Lin , Ruoming Pang , Quoc V. Le

Fast Neural Architecture Construction (NAC) is a method to construct deep network architectures by pruning and expansion of a base network. In recent years, several automated search methods for neural network architectures have been…

Neural and Evolutionary Computing · Computer Science 2018-12-17 Purushotham Kamath , Abhishek Singh , Debo Dutta

Neural Architecture Search (NAS), i.e., the automation of neural network design, has gained much popularity in recent years with increasingly complex search algorithms being proposed. Yet, solid comparisons with simple baselines are often…

Neural and Evolutionary Computing · Computer Science 2020-07-28 T. Den Ottelander , A. Dushatskiy , M. Virgolin , P. A. N. Bosman

Graph neural networks (GNNs) have been intensively applied to various graph-based applications. Despite their success, manually designing the well-behaved GNNs requires immense human expertise. And thus it is inefficient to discover the…

Machine Learning · Computer Science 2022-06-20 Wentao Zhang , Zheyu Lin , Yu Shen , Yang Li , Zhi Yang , Bin Cui

Multiplication is arguably the most cost-dominant operation in modern deep neural networks (DNNs), limiting their achievable efficiency and thus more extensive deployment in resource-constrained applications. To tackle this limitation,…

Hardware Architecture · Computer Science 2022-12-20 Huihong Shi , Haoran You , Yang Zhao , Zhongfeng Wang , Yingyan Lin

3D convolution neural networks (CNN) have been proved very successful in parsing organs or tumours in 3D medical images, but it remains sophisticated and time-consuming to choose or design proper 3D networks given different task contexts.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Qihang Yu , Dong Yang , Holger Roth , Yutong Bai , Yixiao Zhang , Alan L. Yuille , Daguang Xu

Weight sharing based and predictor based methods are two major types of fast neural architecture search methods. In this paper, we propose to jointly use weight sharing and predictor in a unified framework. First, we construct a SuperNet in…

Machine Learning · Computer Science 2022-03-07 Ke Lin , Yong A , Zhuoxin Gan , Yingying Jiang

Deep Neural Networks (DNNs) have the potential for making various clinical procedures more time-efficient by automating medical image segmentation. Due to their strong, in some cases human-level, performance, they have become the standard…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Martijn M. A. Bosma , Arkadiy Dushatskiy , Monika Grewal , Tanja Alderliesten , Peter A. N. Bosman

Neural architecture search (NAS) has become increasingly popular in the deep learning community recently, mainly because it can provide an opportunity to allow interested users without rich expertise to benefit from the success of deep…

Machine Learning · Computer Science 2022-10-25 Shiqing Liu , Haoyu Zhang , Yaochu Jin

Deep learning has revolutionized computer vision, but it achieved its tremendous success using deep network architectures which are mostly hand-crafted and therefore likely suboptimal. Neural Architecture Search (NAS) aims to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Ondřej Týbl , Lukáš Neumann

The wide application of pre-trained models is driving the trend of once-for-all training in one-shot neural architecture search (NAS). However, training within a huge sample space damages the performance of individual subnets and requires…

Networking and Internet Architecture · Computer Science 2023-06-19 Haibin Wang , Ce Ge , Hesen Chen , Xiuyu Sun

Due to the recent advances on Neural Architecture Search (NAS), it gains popularity in designing best networks for specific tasks. Although it shows promising results on many benchmarks and competitions, NAS still suffers from its demanding…

Machine Learning · Computer Science 2019-11-22 Minje Park

Training a supernet matters for one-shot neural architecture search (NAS) methods since it serves as a basic performance estimator for different architectures (paths). Current methods mainly hold the assumption that a supernet should give a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Shan You , Tao Huang , Mingmin Yang , Fei Wang , Chen Qian , Changshui Zhang

In off-axis Quantitative Phase Imaging (QPI), artificial neural networks have been recently applied for phase retrieval with aberration compensation and phase unwrapping. However, the involved neural network architectures are largely…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Xin Shu , Mengxuan Niu , Yi Zhang , Wei Luo , Renjie Zhou

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

This paper addresses the difficult problem of finding an optimal neural architecture design for a given image classification task. We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Juan-Manuel Perez-Rua , Moez Baccouche , Stephane Pateux

Developing neural network image classification models often requires significant architecture engineering. In this paper, we study a method to learn the model architectures directly on the dataset of interest. As this approach is expensive…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Barret Zoph , Vijay Vasudevan , Jonathon Shlens , Quoc V. Le

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis