English
Related papers

Related papers: Neural Architecture Search with an Efficient Multi…

200 papers

Different from handcrafted features, deep neural networks can automatically learn task-specific features from data. Due to this data-driven nature, they have achieved remarkable success in various areas. However, manual design and selection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Jikuan Qian , Rui Li , Xin Yang , Yuhao Huang , Mingyuan Luo , Zehui Lin , Wenhui Hong , Ruobing Huang , Haining Fan , Dong Ni , Jun Cheng

The automated machine learning (AutoML) field has become increasingly relevant in recent years. These algorithms can develop models without the need for expert knowledge, facilitating the application of machine learning techniques in the…

Machine Learning · Computer Science 2022-12-14 Andrea Falanti , Eugenio Lomurno , Danilo Ardagna , Matteo Matteucci

In recent years, neural architecture search (NAS) methods have been proposed for the automatic generation of task-oriented network architecture in image classification. However, the architectures obtained by existing NAS approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Haichao Zhang , Kuangrong Hao , Lei Gao , Xuesong Tang , Bing Wei

Evolutionary neural architecture search (ENAS) employs evolutionary algorithms to find high-performing neural architectures automatically, and has achieved great success. However, compared to the empirical success, its rigorous theoretical…

Neural and Evolutionary Computing · Computer Science 2024-04-09 Zeqiong Lv , Chao Qian , Yanan Sun

In this paper, a neural architecture search (NAS) framework is proposed for 3D medical image segmentation, to automatically optimize a neural architecture from a large design space. Our NAS framework searches the structure of each layer…

Machine Learning · Computer Science 2021-10-28 Sungwoong Kim , Ildoo Kim , Sungbin Lim , Woonhyuk Baek , Chiheon Kim , Hyungjoo Cho , Boogeon Yoon , Taesup Kim

In the past few years, neural architecture search (NAS) has become an increasingly important tool within the deep learning community. Despite the many recent successes of NAS, however, most existing approaches operate within highly…

Machine Learning · Computer Science 2022-11-14 Charles Jin , Phitchaya Mangpo Phothilimthana , Sudip Roy

Neural Architecture Search (NAS) is challenged by the trade-off between search space exploration and efficiency, especially for complex tasks. While recent LLM-based NAS methods have shown promise, they often suffer from static search…

Machine Learning · Computer Science 2025-07-29 Fei Kong , Xiaohan Shan , Yanwei Hu , Jianmin Li

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Machine Learning · Computer Science 2021-10-29 Ravi Krishna , Aravind Kalaiah , Bichen Wu , Maxim Naumov , Dheevatsa Mudigere , Misha Smelyanskiy , Kurt Keutzer

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Hardware-aware Neural Architecture Search (HW-NAS) is a technique used to automatically design the architecture of a neural network for a specific task and target hardware. However, evaluating the performance of candidate architectures is a…

Neural and Evolutionary Computing · Computer Science 2023-11-08 Nilotpal Sinha , Abd El Rahman Shabayek , Anis Kacem , Peyman Rostami , Carl Shneider , Djamila Aouada

Neural Architecture Search (NAS) methods, which automatically learn entire neural model or individual neural cell architectures, have recently achieved competitive or state-of-the-art (SOTA) performance on variety of natural language…

Computation and Language · Computer Science 2020-10-12 Ansel MacLaughlin , Jwala Dhamala , Anoop Kumar , Sriram Venkatapathy , Ragav Venkatesan , Rahul Gupta

Automated machine learning (AutoML) has seen a resurgence in interest with the boom of deep learning over the past decade. In particular, Neural Architecture Search (NAS) has seen significant attention throughout the AutoML research…

Neural and Evolutionary Computing · Computer Science 2020-09-23 Min Shi , David A. Wilson , Xingquan Zhu , Yu Huang , Yuan Zhuang , Jianxun Liu , Yufei Tang

The traditional Neural Network-development process requires substantial expert knowledge and relies heavily on intuition and trial-and-error. Neural Architecture Search (NAS) frameworks were introduced to robustly search for network…

Neural and Evolutionary Computing · Computer Science 2023-06-16 Mohamed Shahawy , Elhadj Benkhelifa

Past few years have witnessed the artificial intelligence inspired evolution in various medical fields. The diagnosis and treatment of gliomas -- one of the most commonly seen brain tumors with low survival rate -- rely heavily on the…

Image and Video Processing · Electrical Eng. & Systems 2020-05-21 Feifan Wang

The key challenge in neural architecture search (NAS) is designing how to explore wisely in the huge search space. We propose a new NAS method called TNAS (NAS with trees), which improves search efficiency by exploring only a small number…

Artificial Intelligence · Computer Science 2022-04-12 Guocheng Qian , Xuanyang Zhang , Guohao Li , Chen Zhao , Yukang Chen , Xiangyu Zhang , Bernard Ghanem , Jian Sun

Convolutional neural networks (CNNs), such as the time-delay neural network (TDNN), have shown their remarkable capability in learning speaker embedding. However, they meanwhile bring a huge computational cost in storage size, processing,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Rui Wang , Zhihua Wei , Haoran Duan , Shouling Ji , Yang Long , Zhen Hong

Hand gesture recognition (HGR) based on multimodal data has attracted considerable attention owing to its great potential in applications. Various manually designed multimodal deep networks have performed well in multimodal HGR (MHGR), but…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Yizhang Xia , Shihao Song , Zhanglu Hou , Junwen Xu , Juan Zou , Yuan Liu , Shengxiang Yang

Recently, differentiable neural architecture search methods significantly reduce the search cost by constructing a super network and relax the architecture representation by assigning architecture weights to the candidate operations. All…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Xukai Xie , Yuan Zhou , Sun-Yuan Kung

Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years.…

Machine Learning · Computer Science 2020-01-03 Yao Shu , Wei Wang , Shaofeng Cai