English
Related papers

Related papers: Regularized Evolutionary Algorithm for Dynamic Neu…

200 papers

The interaction networks of biological systems are known to take on several non-random structural properties, some of which are believed to positively influence system robustness. Researchers are only starting to understand how these…

Neural and Evolutionary Computing · Computer Science 2011-02-08 James M. Whitacre , Ruhul A. Sarker , Q. Tuan Pham

Designing the architecture for an artificial neural network is a cumbersome task because of the numerous parameters to configure, including activation functions, layer types, and hyper-parameters. With the large number of parameters for…

Machine Learning · Computer Science 2018-10-15 Bas van Stein , Hao Wang , Thomas Bäck

Neural Architecture Search aims at automatically finding neural architectures that are competitive with architectures designed by human experts. While recent approaches have achieved state-of-the-art predictive performance for image…

Machine Learning · Statistics 2019-02-27 Thomas Elsken , Jan Hendrik Metzen , Frank Hutter

Recurrent neural networks are good at solving prediction problems. However, finding a network that suits a problem is quite hard because their performance is strongly affected by their architecture configuration. Automatic architecture…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Andrés Camero , Jamal Toutouh , Enrique Alba

The evolutionary paradigm has been successfully applied to neural network search(NAS) in recent years. Due to the vast search complexity of the global space, current research mainly seeks to repeatedly stack partial architectures to build…

Neural and Evolutionary Computing · Computer Science 2024-03-06 Juan Zou , Weiwei Jiang , Yizhang Xia , Yuan Liu , Zhanglu Hou

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

In recent years, many design automation methods have been developed to routinely create approximate implementations of circuits and programs that show excellent trade-offs between the quality of output and required resources. This paper…

Neural and Evolutionary Computing · Computer Science 2021-08-17 Lukas Sekanina

This paper presents an evolutionary metaheuristic called Multiple Search Neuroevolution (MSN) to optimize deep neural networks. The algorithm attempts to search multiple promising regions in the search space simultaneously, maintaining…

Neural and Evolutionary Computing · Computer Science 2019-01-21 Ahmed Aly , David Weikersdorfer , Claire Delaunay

Neural Architecture Search (NAS) is an important yet challenging task in network design due to its high computational consumption. To address this issue, we propose the Reinforced Evolutionary Neural Architecture Search (RE- NAS), which is…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Yukang Chen , Gaofeng Meng , Qian Zhang , Shiming Xiang , Chang Huang , Lisen Mu , Xinggang Wang

We wish to minimize the resources used for network coding while achieving the desired throughput in a multicast scenario. We employ evolutionary approaches, based on a genetic algorithm, that avoid the computational complexity that makes…

Networking and Internet Architecture · Computer Science 2016-11-15 Minkyu Kim , Muriel Medard , Varun Aggarwal , Una-May O'Reilly , Wonsik Kim , Chang Wook Ahn , Michelle Effros

In literature, Clustered Shortest-Path Tree Problem (CluSPT) is an NP-hard problem. Previous studies often search for an optimal solution in relatively large space. To enhance the performance of the search process, two approaches are…

Neural and Evolutionary Computing · Computer Science 2020-10-20 Phan Thi Hong Hanh , Pham Dinh Thanh , Huynh Thi Thanh Binh

Recently, there emerged revived interests of designing automatic programs (e.g., using genetic/evolutionary algorithms) to optimize the structure of Convolutional Neural Networks (CNNs) for a specific task. The challenge in designing such…

Neural and Evolutionary Computing · Computer Science 2018-06-05 Zhe Li , Xuehan Xiong , Zhou Ren , Ning Zhang , Xiaoyu Wang , Tianbao Yang

Convolutional Neural Networks (CNNs) have gained a remarkable success on many image classification tasks in recent years. However, the performance of CNNs highly relies upon their architectures. For most state-of-the-art CNNs, their…

Neural and Evolutionary Computing · Computer Science 2020-03-30 Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen

Evolutionary algorithms serve as a powerful paradigm for tackling optimization challenges, yet their reliance on manually engineered heuristics inherently limits their adaptability across diverse landscapes. However, the transition from the…

Neural and Evolutionary Computing · Computer Science 2026-03-04 Jiaxin Gao , Yaohua Liu , Ran Cheng , Kay Chen Tan

Evolutionary algorithms are wildly used in unmanned aerial vehicle path planning for their flexibility and effectiveness. Nevertheless, they are so sensitive to the change of environment that can't adapt to all scenarios. Due to this…

Neural and Evolutionary Computing · Computer Science 2022-04-08 Jiabin Lou , Rong Ding , Wenjun Wu

In this paper, we propose an algorithmic framework to automatically generate efficient deep neural networks and optimize their associated hyperparameters. The framework is based on evolving directed acyclic graphs (DAGs), defining a more…

Neural and Evolutionary Computing · Computer Science 2024-05-15 Julie Keisler , El-Ghazali Talbi , Sandra Claudel , Gilles Cabriel

This paper presents a new algorithm, Evolutionary eXploration of Augmenting Memory Models (EXAMM), which is capable of evolving recurrent neural networks (RNNs) using a wide variety of memory structures, such as Delta-RNN, GRU, LSTM, MGU…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Alexander Ororbia , Ahmed Ahmed Elsaid , Travis Desell

The design of compact deep neural networks is a crucial task to enable widespread adoption of deep neural networks in the real-world, particularly for edge and mobile scenarios. Due to the time-consuming and challenging nature of manually…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Mohammad Javad Shafiee , Andrew Hryniowski , Francis Li , Zhong Qiu Lin , Alexander Wong

Metalearning of deep neural network (DNN) architectures and hyperparameters has become an increasingly important area of research. At the same time, network regularization has been recognized as a crucial dimension to effective training of…

Neural and Evolutionary Computing · Computer Science 2021-07-22 Jason Liang , Santiago Gonzalez , Hormoz Shahrzad , Risto Miikkulainen

Deep Convolutional Neural Networks (CNNs) have been widely used in image classification tasks, but the process of designing CNN architectures is very complex, so Neural Architecture Search (NAS), automatically searching for optimal CNN…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Bin Wang , Bing Xue , Mengjie Zhang