English
Related papers

Related papers: A Self-adaptive Neuroevolution Approach to Constru…

200 papers

Neural architecture search (NAS) is a promising method for automatically design neural architectures. NAS adopts a search strategy to explore the predefined search space to find outstanding performance architecture with the minimum…

Machine Learning · Computer Science 2020-09-11 Chen Wei , Chuang Niu , Yiping Tang , Yue Wang , Haihong Hu , Jimin Liang

Learning representations of well-trained neural network models holds the promise to provide an understanding of the inner workings of those models. However, previous work has either faced limitations when processing larger networks or was…

Machine Learning · Computer Science 2024-06-17 Konstantin Schürholt , Michael W. Mahoney , Damian Borth

An important goal for the machine learning (ML) community is to create approaches that can learn solutions with human-level capability. One domain where humans have held a significant advantage is visual processing. A significant approach…

Neural and Evolutionary Computing · Computer Science 2013-12-20 Phillip Verbancsics , Josh Harguess

Recent advancements in Artificial Intelligence (AI), driven by Neural Networks (NN), demand innovative neural architecture designs, particularly within the constrained environments of Internet of Things (IoT) systems, to balance performance…

Neural and Evolutionary Computing · Computer Science 2024-02-21 Halima Bouzidi , Smail Niar , Hamza Ouarnoughi , El-Ghazali Talbi

Despite several signs of progress have been made recently, limited research has been conducted for an inductive setting where embeddings are required for newly unseen nodes -- a setting encountered commonly in practical applications of deep…

Machine Learning · Computer Science 2020-06-23 Dai Quoc Nguyen , Tu Dinh Nguyen , Dinh Phung

In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed itself as the trending approach to automate the discovery of deep neural network architectures. This rise is mainly due to the popularity of DARTS, one…

Machine Learning · Computer Science 2023-05-02 Alexandre Heuillet , Ahmad Nasser , Hichem Arioui , Hedi Tabia

Evolutionary Algorithms (EAs) play a crucial role in the architectural configuration and training of Artificial Deep Neural Networks (DNNs), a process known as neuroevolution. However, neuroevolution is hindered by its inherent…

Neural and Evolutionary Computing · Computer Science 2024-09-17 Fergal Stapleton , Edgar Galván

As deep neural networks achieve unprecedented performance in various tasks, neural architecture search (NAS), a research field for designing neural network architectures with automated processes, is actively underway. More recently,…

Machine Learning · Computer Science 2022-06-07 Youngkee Kim , Soyi Jung , Minseok Choi , Joongheon Kim

Current grammar-based NeuroEvolution approaches have several shortcomings. On the one hand, they do not allow the generation of Artificial Neural Networks (ANNs composed of more than one hidden-layer. On the other, there is no way to evolve…

Neural and Evolutionary Computing · Computer Science 2018-01-08 Filipe Assunção , Nuno Lourenço , Penousal Machado , Bernardete Ribeiro

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

The paper provides a comprehensive overview of Neural Architecture Search (NAS), emphasizing its evolution from manual design to automated, computationally-driven approaches. It covers the inception and growth of NAS, highlighting its…

Neural and Evolutionary Computing · Computer Science 2024-04-03 Fanfei Meng , Chen-Ao Wang , Lele Zhang

Deep neural networks (DNNs) have become the driving force behind recent artificial intelligence (AI) research. An important problem with implementing a neural network is the design of its architecture. Typically, such an architecture is…

Neural and Evolutionary Computing · Computer Science 2021-03-30 Shayan Hassantabar , Zeyu Wang , Niraj K. Jha

Neuroevolution is an active and growing research field, especially in times of increasingly parallel computing architectures. Learning methods for Artificial Neural Networks (ANN) can be divided into two groups. Neuroevolution is mainly…

Neural and Evolutionary Computing · Computer Science 2011-04-11 Onay Urfalioglu , Orhan Arikan

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

Vanilla neural architecture search using evolutionary algorithms (EA) involves evaluating each architecture by training it from scratch, which is extremely time-consuming. This can be reduced by using a supernet to estimate the fitness of…

Neural and Evolutionary Computing · Computer Science 2022-03-04 Nilotpal Sinha , Kuan-Wen Chen

The performance of a deep neural network is heavily dependent on its architecture and various neural architecture search strategies have been developed for automated network architecture design. Recently, evolutionary neural architecture…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Haoyu Zhang , Yaochu Jin , Ran Cheng , Kuangrong Hao

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

NeuroEvolution (NE) methods are known for applying Evolutionary Computation to the optimisation of Artificial Neural Networks(ANNs). Despite aiding non-expert users to design and train ANNs, the vast majority of NE approaches disregard the…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Filipe Assunção , Nuno Lourenço , Bernardete Ribeiro , Penousal Machado

We present a neural architecture search (NAS) technique to enhance the performance of unsupervised image de-noising, in-painting and super-resolution under the recently proposed Deep Image Prior (DIP). We show that evolutionary search can…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Kary Ho , Andrew Gilbert , Hailin Jin , John Collomosse