English
Related papers

Related papers: Neural Architecture Search: A Survey

200 papers

The growing interest in both the automation of machine learning and deep learning has inevitably led to the development of a wide variety of automated methods for neural architecture search. The choice of the network architecture has proven…

Machine Learning · Computer Science 2019-06-19 Martin Wistuba , Ambrish Rawat , Tejaswini Pedapati

In the past decade, advances in deep learning have resulted in breakthroughs in a variety of areas, including computer vision, natural language understanding, speech recognition, and reinforcement learning. Specialized, high-performing…

Machine Learning · Computer Science 2023-01-26 Colin White , Mahmoud Safari , Rhea Sukthanker , Binxin Ru , Thomas Elsken , Arber Zela , Debadeepta Dey , Frank Hutter

In modern deep learning research, finding optimal (or near optimal) neural network models is one of major research directions and it is widely studied in many applications. In this paper, the main research trends of neural architecture…

Machine Learning · Computer Science 2021-08-20 Youngkee Kim , Won Joon Yun , Youn Kyu Lee , Soyi Jung , Joongheon Kim

Deep learning has made breakthroughs and substantial in many fields due to its powerful automatic representation capabilities. It has been proven that neural architecture design is crucial to the feature representation of data and the final…

Machine Learning · Computer Science 2021-03-03 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Xiaojiang Chen , Xin Wang

The automation of feature extraction of machine learning has been successfully realized by the explosive development of deep learning. However, the structures and hyperparameters of deep neural network architectures also make huge…

Machine Learning · Computer Science 2024-10-01 Wenzhu Shao

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

Machine learning has made tremendous progress in recent years and received large amounts of public attention. Though we are still far from designing a full artificially intelligent agent, machine learning has brought us many applications in…

Machine Learning · Computer Science 2019-08-29 Steven Abreu

Deep neural networks have recently become a popular solution to keyword spotting systems, which enable the control of smart devices via voice. In this paper, we apply neural architecture search to search for convolutional neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Tong Mo , Yakun Yu , Mohammad Salameh , Di Niu , Shangling Jui

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

While neural architecture search methods have been successful in previous years and led to new state-of-the-art performance on various problems, they have also been criticized for being unstable, being highly sensitive with respect to their…

Machine Learning · Computer Science 2021-07-09 Thomas Elsken , Benedikt Staffler , Arber Zela , Jan Hendrik Metzen , Frank Hutter

The success of deep learning in recent years has lead to a rising demand for neural network architecture engineering. As a consequence, neural architecture search (NAS), which aims at automatically designing neural network architectures in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Thomas Elsken , Arber Zela , Jan Hendrik Metzen , Benedikt Staffler , Thomas Brox , Abhinav Valada , Frank Hutter

The influence of deep learning is continuously expanding across different domains, and its new applications are ubiquitous. The question of neural network design thus increases in importance, as traditional empirical approaches are reaching…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Anton Muravev , Jenni Raitoharju , Moncef Gabbouj

Deep learning (DL) has proven to be a highly effective approach for developing models in diverse contexts, including visual perception, speech recognition, and machine translation. However, the end-to-end process for applying DL is not…

Machine Learning · Computer Science 2022-05-18 Xuanyi Dong , David Jacob Kedziora , Katarzyna Musial , Bogdan Gabrys

Neural architecture search enables automation of architecture design. Despite its success, it is computationally costly and does not provide an insight on how to design a desirable architecture. Here we propose a new way of searching neural…

Machine Learning · Computer Science 2021-12-16 Zhenhan Huang , Chunheng Jiang , Pin-Yu Chen , Jianxi Gao

Neural Architecture Search (NAS) enabled the discovery of state-of-the-art architectures in many domains. However, the success of NAS depends on the definition of the search space. Current search spaces are defined as a static sequence of…

Machine Learning · Computer Science 2019-08-01 Stanisław Jastrzębski , Quentin de Laroussilhe , Mingxing Tan , Xiao Ma , Neil Houlsby , Andrea Gesmundo

The design of compact deep neural networks is a crucial task to enable widespread adoption of deep neural networks in the real-world, particularly for edge and mobile scenarios. Due to the time-consuming and challenging nature of manually…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Mohammad Javad Shafiee , Andrew Hryniowski , Francis Li , Zhong Qiu Lin , Alexander Wong

Neural networks are powerful models that have a remarkable ability to extract patterns that are too complex to be noticed by humans or other machine learning models. Neural networks are the first class of models that can train end-to-end…

Machine Learning · Computer Science 2021-08-05 Ibrahim Alshubaily

The design of neural network architectures is an important component for achieving state-of-the-art performance with machine learning systems across a broad array of tasks. Much work has endeavored to design and build architectures…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Liang-Chieh Chen , Maxwell D. Collins , Yukun Zhu , George Papandreou , Barret Zoph , Florian Schroff , Hartwig Adam , Jonathon Shlens

The automation of neural architecture design has been a coveted alternative to human experts. Recent works have small search space, which is easier to optimize but has a limited upper bound of the optimal solution. Extra human design is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Yuanzheng Ci , Chen Lin , Ming Sun , Boyu Chen , Hongwen Zhang , Wanli Ouyang
‹ Prev 1 2 3 10 Next ›