English
Related papers

Related papers: A First Step Towards Runtime Analysis of Evolution…

200 papers

The ongoing advancements in network architecture design have led to remarkable achievements in deep learning across various challenging computer vision tasks. Meanwhile, the development of neural architecture search (NAS) has provided…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Zhichao Lu , Ran Cheng , Yaochu Jin , Kay Chen Tan , Kalyanmoy Deb

Neural architecture search (NAS) promises to make deep learning accessible to non-experts by automating architecture engineering of deep neural networks. BANANAS is one state-of-the-art NAS method that is embedded within the Bayesian…

Machine Learning · Computer Science 2021-07-16 Lennart Schneider , Florian Pfisterer , Martin Binder , Bernd Bischl

Traditional neural architecture search (NAS) has a significant impact in computer vision by automatically designing network architectures for various tasks. In this paper, binarized neural architecture search (BNAS), with a search space of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Hanlin Chen , Li'an Zhuo , Baochang Zhang , Xiawu Zheng , Jianzhuang Liu , Rongrong Ji , David Doermann , Guodong Guo

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

Machine Learning · Computer Science 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

Neural architecture search (NAS) has recently been addressed from various directions, including discrete, sampling-based methods and efficient differentiable approaches. While the former are notoriously expensive, the latter suffer from…

Machine Learning · Computer Science 2021-05-13 Jovita Lukasik , David Friede , Arber Zela , Frank Hutter , Margret Keuper

The time and effort involved in hand-designing deep neural networks is immense. This has prompted the development of Neural Architecture Search (NAS) techniques to automate this design. However, NAS algorithms tend to be slow and expensive;…

Machine Learning · Computer Science 2021-06-14 Joseph Mellor , Jack Turner , Amos Storkey , Elliot J. Crowley

Architecture search optimizes the structure of a neural network for some task instead of relying on manual authoring. However, it is slow, as each potential architecture is typically trained from scratch. In this paper we present an…

Machine Learning · Computer Science 2021-10-08 Mohan Singamsetti , Anmol Mahajan , Matthew Guzdial

Neural architecture search (NAS) has emerged as a powerful paradigm that enables researchers to automatically explore vast search spaces and discover efficient neural networks. However, NAS suffers from a critical bottleneck, i.e. the…

Neural and Evolutionary Computing · Computer Science 2026-01-05 Yu Xue , Pengcheng Jiang , Chenchen Zhu , MengChu Zhou , Mohamed Wahib , Moncef Gabbouj

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

Machine Learning · Computer Science 2020-03-27 Chun-Ting Liu

Data-driven, automatic design space exploration of neural accelerator architecture is desirable for specialization and productivity. Previous frameworks focus on sizing the numerical architectural hyper-parameters while neglect searching…

Machine Learning · Computer Science 2021-05-28 Yujun Lin , Mengtian Yang , Song Han

Neural Architecture Search (NAS) is a research field concerned with utilizing optimization algorithms to design optimal neural network architectures. There are many approaches concerning the architectural search spaces, optimization…

Machine Learning · Computer Science 2020-05-25 George Kyriakides , Konstantinos Margaritis

Present day artificial neural architecture search (NAS) strategies are essentially prediction-error-optimized. That holds true for AI functions in general. From the developmental neuroscience perspective, I present evidence for the central…

Neurons and Cognition · Quantitative Biology 2023-10-06 Martin G. Frasch

Convolutional Neural Networks have been used in a variety of image related applications after their rise in popularity due to ImageNet competition. Convolutional Neural Networks have shown remarkable results in applications including face…

Machine Learning · Computer Science 2023-01-18 Anshumaan Chauhan , Siddhartha Bhattacharyya , S. Vadivel

As we advance in the fast-growing era of Machine Learning, various new and more complex neural architectures are arising to tackle problem more efficiently. On the one hand their efficient usage requires advanced knowledge and expertise,…

Machine Learning · Computer Science 2023-10-30 Léo Pouy , Fouad Khenfri , Patrick Leserf , Chokri Mraidha , Cherif Larouci

Mobile and edge computing devices for always-on classification tasks require energy-efficient neural network architectures. In this paper we present several changes to neural architecture searches (NAS) that improve the chance of success in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Daniel T. Speckhard , Karolis Misiunas , Sagi Perel , Tenghui Zhu , Simon Carlile , Malcolm Slaney

Neural Architectures Search (NAS) becomes more and more popular over these years. However, NAS-generated models tends to suffer greater vulnerability to various malicious attacks. Lots of robust NAS methods leverage adversarial training to…

Machine Learning · Computer Science 2023-04-11 Xunyu Zhu , Jian Li , Yong Liu , Weiping Wang

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Time series forecasting (TSF) is one of the most important tasks in data science given the fact that accurate time series (TS) predictive models play a major role across a wide variety of domains including finance, transportation, health…

Machine Learning · Computer Science 2023-02-22 Zimeng Lyu , Alexander Ororbia , Travis Desell

In the last decade remarkable progress has been made in development of suitable proof techniques for analysing randomised search heuristics. The theoretical investigation of these algorithms on classes of functions is essential to the…

Neural and Evolutionary Computing · Computer Science 2020-10-22 Frank Neumann , Mojgan Pourhassan , Carsten Witt

This paper extends the runtime analysis of non-elitist evolutionary algorithms (EAs) with fitness-proportionate selection from the simple OneMax function to the linear functions. Not only does our analysis cover a larger class of fitness…

Neural and Evolutionary Computing · Computer Science 2019-08-26 Duc-Cuong Dang , Anton Eremeev , Per Kristian Lehre