English
Related papers

Related papers: BiX-NAS: Searching Efficient Bi-directional Archit…

200 papers

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

Machine Learning · Statistics 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

Despite the success of convolutional neural networks for 3D medical-image segmentation, the architectures currently used are still not robust enough to the protocols of different scanners, and the variety of image properties they produce.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-31 Shrajan Bhandary , Zahra Babaiee , Dejan Kostyszyn , Tobias Fechter , Constantinos Zamboglou , Anca-Ligia Grosu , Radu Grosu

In the past years, significant improvements in the field of neural architecture search(NAS) have been made. However, it is still challenging to search for efficient networks due to the gap between the searched constraint and real inference…

Machine Learning · Computer Science 2022-06-16 Mingyang Zhang , Xinyi Yu , Jingtao Rong , Linlin Ou

Neural Architecture Search (NAS) is a powerful tool to automatically design deep neural networks for many tasks, including image classification. Due to the significant computational burden of the search phase, most NAS methods have focused…

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

Neural and Evolutionary Computing · Computer Science 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang

The searching procedure of neural architecture search (NAS) is notoriously time consuming and cost prohibitive.To make the search space continuous, most existing gradient-based NAS methods relax the categorical choice of a particular…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Shoufa Chen , Yunpeng Chen , Shuicheng Yan , Jiashi Feng

Neural architecture search (NAS) proves to be among the effective approaches for many tasks by generating an application-adaptive neural architecture, which is still challenged by high computational cost and memory consumption. At the same…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yanjing Li , Sheng Xu , Xianbin Cao , Li'an Zhuo , Baochang Zhang , Tian Wang , Guodong Guo

Neural Architecture Search (NAS) is an emerging topic in machine learning and computer vision. The fundamental ideology of NAS is using an automatic mechanism to replace manual designs for exploring powerful network architectures. One of…

Machine Learning · Computer Science 2020-09-24 Lanfei Wang , Lingxi Xie , Tianyi Zhang , Jun Guo , Qi Tian

If NAS methods are solutions, what is the problem? Most existing NAS methods require two-stage parameter optimization. However, performance of the same architecture in the two stages correlates poorly. In this work, we propose a new problem…

Machine Learning · Computer Science 2020-04-02 Shoukang Hu , Sirui Xie , Hehui Zheng , Chunxiao Liu , Jianping Shi , Xunying Liu , Dahua Lin

Neural Architecture Search (NAS) has been widely adopted to design accurate and efficient image classification models. However, applying NAS to a new computer vision task still requires a huge amount of effort. This is because 1) previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Bichen Wu , Chaojian Li , Hang Zhang , Xiaoliang Dai , Peizhao Zhang , Matthew Yu , Jialiang Wang , Yingyan Celine Lin , Peter Vajda

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

Hardware-aware Neural Architecture Search approaches (HW-NAS) automate the design of deep learning architectures, tailored specifically to a given target hardware platform. Yet, these techniques demand substantial computational resources,…

Machine Learning · Computer Science 2024-04-22 Nilotpal Sinha , Peyman Rostami , Abd El Rahman Shabayek , Anis Kacem , Djamila Aouada

Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival…

Machine Learning · Computer Science 2022-10-07 Andrea Falanti , Eugenio Lomurno , Stefano Samele , Danilo Ardagna , Matteo Matteucci

In recent years Deep Learning has brought about a breakthrough in Medical Image Segmentation. U-Net is the most prominent deep network in this regard, which has been the most popular architecture in the medical imaging community. Despite…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Nabil Ibtehaz , M. Sohel Rahman

Neural Architecture Search (NAS) is an automated technique to design optimal neural network architectures for a specific workload. Conventionally, evaluating candidate networks in NAS involves extensive training, which requires significant…

Machine Learning · Computer Science 2025-06-05 Tomomasa Yamasaki , Zhehui Wang , Tao Luo , Niangjun Chen , Bo Wang

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Single Image Super-Resolution (SISR) tasks have achieved significant performance with deep neural networks. However, the large number of parameters in CNN-based met-hods for SISR tasks require heavy computations. Although several efficient…

Image and Video Processing · Electrical Eng. & Systems 2022-12-20 Han Huang , Li Shen , Chaoyang He , Weisheng Dong , Wei Liu

One-Shot Neural architecture search (NAS) attracts broad attention recently due to its capacity to reduce the computational hours through weight sharing. However, extensive experiments on several recent works show that there is no positive…

Machine Learning · Computer Science 2019-07-23 Miao Zhang , Huiqi Li , Shirui Pan , Taoping Liu , Steven Su

Neural Architecture Search (NAS) methods are widely used in various industries to obtain high quality taskspecific solutions with minimal human intervention. Event Sequences find widespread use in various industrial applications including…

Neural architecture search (NAS), the study of automating the discovery of optimal deep neural network architectures for tasks in domains such as computer vision and natural language processing, has seen rapid growth in the machine learning…

Neural and Evolutionary Computing · Computer Science 2022-03-01 Daniel Cummings , Sharath Nittur Sridhar , Anthony Sarah , Maciej Szankin