English
Related papers

Related papers: Regularized Evolutionary Algorithm for Dynamic Neu…

200 papers

Evolutionary optimization algorithms are often derived from loose biological analogies and struggle to leverage information obtained during the sequential course of optimization. An alternative promising approach is to leverage data and…

Artificial Intelligence · Computer Science 2024-03-06 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

Deep Neural Networks (DNNs) have achieved great success in many applications. The architectures of DNNs play a crucial role in their performance, which is usually manually designed with rich expertise. However, such a design process is…

Neural and Evolutionary Computing · Computer Science 2022-02-07 Yuqiao Liu , Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen , Kay Chen Tan

Recent work introduced progressive network growing as a promising way to ease the training for large GANs, but the model design and architecture-growing strategy still remain under-explored and needs manual design for different image data.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Lanlan Liu , Yuting Zhang , Jia Deng , Stefano Soatto

In a recurrent setting, conventional approaches to neural architecture search find and fix a general model for all data samples and time steps. We propose a novel algorithm that can dynamically search for the structure of cells in a…

Machine Learning · Computer Science 2019-05-28 Xin Qian , Matthew Kennedy , Diego Klabjan

Neural networks have recently had a lot of success for many tasks. However, neural network architectures that perform well are still typically designed manually by experts in a cumbersome trial-and-error process. We propose a new method to…

Machine Learning · Statistics 2017-11-15 Thomas Elsken , Jan-Hendrik Metzen , Frank Hutter

In recent years, the CNN architectures designed by evolution algorithms have proven to be competitive with handcrafted architectures designed by experts. However, these algorithms need a lot of computational power, which is beyond the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Ousmane Youme , Jean Marie Dembele , Eugene C. Ezin , Christophe Cambier

he greatest weakness of evolutionary algorithms, widely used today, is the premature convergence due to the loss of population diversity over generations. To overcome this problem, several algorithms have been proposed, such as the…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Asmaa Ghoumari , Amir Nakib

Neural Architecture Search (NAS) has emerged as one of the effective methods to design the optimal neural network architecture automatically. Although neural architectures have achieved human-level performances in several tasks, few of them…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Caiyang Yu , Xianggen Liu , Yifan Wang , Yun Liu , Wentao Feng , Deng Xiong , Chenwei Tang , Jiancheng Lv

Neural Architecture Search has shown potential to automate the design of neural networks. Deep Reinforcement Learning based agents can learn complex architectural patterns, as well as explore a vast and compositional search space. On the…

Machine Learning · Computer Science 2020-02-18 Krzysztof Maziarz , Mingxing Tan , Andrey Khorlin , Marin Georgiev , Andrea Gesmundo

A new model for evolving Evolutionary Algorithms (EAs) is proposed in this paper. The model is based on the Multi Expression Programming (MEP) technique. Each MEP chromosome encodes an evolutionary pattern that is repeatedly used for…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Mihai Oltean

Convolution Neural Networks, known as ConvNets exceptionally perform well in many complex machine learning tasks. The architecture of ConvNets demands the huge and rich amount of data and involves with a vast number of parameters that leads…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pushparaja Murugan , Shanmugasundaram Durairaj

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

Neural and Evolutionary Computing · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

There is a growing interest in automated neural architecture search (NAS) methods. They are employed to routinely deliver high-quality neural network architectures for various challenging data sets and reduce the designer's effort. The NAS…

Neural and Evolutionary Computing · Computer Science 2022-06-28 Michal Pinos , Vojtech Mrazek , Lukas Sekanina

Many studies have been done to prove the vulnerability of neural networks to adversarial example. A trained and well-behaved model can be fooled by a visually imperceptible perturbation, i.e., an originally correctly classified image could…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 YiGui Luo , RuiJia Yang , Wei Sha , WeiYi Ding , YouTeng Sun , YiSi Wang

Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi-fidelity…

Neural and Evolutionary Computing · Computer Science 2021-08-10 Noor Awad , Neeratyoy Mallik , Frank Hutter

We present ECToNAS, a cost-efficient evolutionary cross-topology neural architecture search algorithm that does not require any pre-trained meta controllers. Our framework is able to select suitable network architectures for different tasks…

Machine Learning · Computer Science 2024-03-11 Elisabeth J. Schiessler , Roland C. Aydin , Christian J. Cyron

While modern convolutional neural networks achieve outstanding accuracy on many image classification tasks, they are, compared to humans, much more sensitive to image degradation. Here, we describe a variant of Batch Normalization,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Bojian Yin , Siebren Schaafsma , Henk Corporaal , H. Steven Scholte , Sander M. Bohte

Despite the recent successes in robotic locomotion control, the design of robot relies heavily on human engineering. Automatic robot design has been a long studied subject, but the recent progress has been slowed due to the large…

Machine Learning · Computer Science 2019-06-24 Tingwu Wang , Yuhao Zhou , Sanja Fidler , Jimmy Ba

Network Architecture Search and specifically Regularized Evolution is a common way to refine the structure of a deep learning model.However, little is known about how models empirically evolve over time which has design implications for…

Artificial Intelligence · Computer Science 2023-09-25 Robert Underwood , Meghana Madhastha , Randal Burns , Bogdan Nicolae

The hyper-parameters of a neural network are traditionally designed through a time consuming process of trial and error that requires substantial expert knowledge. Neural Architecture Search (NAS) algorithms aim to take the human out of the…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Andrew Nader , Danielle Azar