English
Related papers

Related papers: Evolution under Length Constraints for CNN Archite…

200 papers

Convolutional neural networks belong to the most successul image classifiers, but the adaptation of their network architecture to a particular problem is computationally expensive. We show that an evolutionary algorithm saves training time…

Neural and Evolutionary Computing · Computer Science 2018-12-20 Jonas Prellberg , Oliver Kramer

We conduct an empirical study to test the ability of Convolutional Neural Networks (CNNs) to reduce the effects of nuisance transformations of the input data, such as location, scale and aspect ratio. We isolate factors by adopting a common…

Computer Vision and Pattern Recognition · Computer Science 2016-04-29 Nikolaos Karianakis , Jingming Dong , Stefano Soatto

Compressing convolutional neural networks (CNNs) is essential for transferring the success of CNNs to a wide variety of applications to mobile devices. In contrast to directly recognizing subtle weights or filters as redundant in a given…

Machine Learning · Statistics 2017-07-26 Yunhe Wang , Chang Xu , Jiayan Qiu , Chao Xu , Dacheng Tao

We present ECToNAS, a cost-efficient evolutionary cross-topology neural architecture search algorithm that does not require any pre-trained meta controllers. Our framework is able to select suitable network architectures for different tasks…

Machine Learning · Computer Science 2024-03-11 Elisabeth J. Schiessler , Roland C. Aydin , Christian J. Cyron

In this study, we propose a novel deep learning-based method to predict an optimized structure for a given boundary condition and optimization setting without using any iterative scheme. For this purpose, first, using open-source topology…

Machine Learning · Computer Science 2018-10-30 Yonggyun Yu , Taeil Hur , Jaeho Jung , In Gwun Jang

In recent years, there have been many popular Convolutional Neural Networks (CNNs), such as Google's Inception-V4, that have performed very well for various image classification problems. These commonly used CNN models usually use the same…

Neural and Evolutionary Computing · Computer Science 2019-07-01 Luna M. Zhang

A review of the properties that bond the particles under Lennard Jones Potential allow to states properties and conditions for building evolutive algorithms using the CB lattice with other different lattices. The new lattice is called CB…

Computational Engineering, Finance, and Science · Computer Science 2017-01-05 Carlos Barrón-Romero

Convolutional Neural Networks (CNNs) have achieved remarkable success across a wide range of machine learning tasks by leveraging hierarchical feature learning through deep architectures. However, the large number of layers and millions of…

Machine Learning · Statistics 2025-11-18 Biyi Fang , Truong Vo , Jean Utke , Diego Klabjan

Optimizing a neural network's performance is a tedious and time taking process, this iterative process does not have any defined solution which can work for all the problems. Optimization can be roughly categorized into - Architecture and…

Machine Learning · Computer Science 2019-12-16 Siddhartha Dhar Choudhury , Shashank Pandey , Kunal Mehrotra

The goals of this research were to search for Convolutional Neural Network (CNN) architectures, suitable for an on-device processor with limited computing resources, performing at substantially lower Network Architecture Search (NAS) costs.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Chakkrit Termritthikun , Yeshi Jamtsho , Jirarat Ieamsaard , Paisarn Muneesawang , Ivan Lee

Recent progress in deep convolutional neural networks (CNNs) have enabled a simple paradigm of architecture design: larger models typically achieve better accuracy. Due to this, in modern CNN architectures, it becomes more important to…

Machine Learning · Computer Science 2019-05-14 Jongheon Jeong , Jinwoo Shin

Neural architecture search has attracted wide attentions in both academia and industry. To accelerate it, researchers proposed weight-sharing methods which first train a super-network to reuse computation among different operators, from…

Machine Learning · Computer Science 2020-12-16 Xin Chen , Lingxi Xie , Jun Wu , Longhui Wei , Yuhui Xu , Qi Tian

Most of the existing work on FPGA acceleration of Convolutional Neural Network (CNN) focus on employing a single strategy (algorithm, dataflow, etc.) across all the layers. Such an approach does not achieve optimal latency on complex and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-16 Yuan Meng , Sanmukh Kuppannagari , Rajgopal Kannan , Viktor Prasanna

In this work, we propose a novel evolutionary algorithm for neural architecture search, applicable to global search spaces. The algorithm's architectural representation organizes the topology in multiple hierarchical modules, while the…

Neural and Evolutionary Computing · Computer Science 2023-05-05 Aristeidis Christoforidis , George Kyriakides , Konstantinos Margaritis

Convolutional Neural Networks have dramatically improved in recent years, surpassing human accuracy on certain problems and performance exceeding that of traditional computer vision algorithms. While the compute pattern in itself is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Michaela Blott , Thomas B. Preusser , Nicholas Fraser , Giulio Gambardella , Kenneth OBrien , Yaman Umuroglu , Miriam Leeser

Current neural architecture search (NAS) algorithms still require expert knowledge and effort to design a search space for network construction. In this paper, we consider automating the search space design to minimize human interference,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daquan Zhou , Xiaojie Jin , Xiaochen Lian , Linjie Yang , Yujing Xue , Qibin Hou , Jiashi Feng

Resource constrained job scheduling is a hard combinatorial optimisation problem that originates in the mining industry. Off-the-shelf solvers cannot solve this problem satisfactorily in reasonable timeframes, while other solution methods…

Neural and Evolutionary Computing · Computer Science 2024-07-23 Su Nguyen , Dhananjay Thiruvady , Yuan Sun , Mengjie Zhang

We propose a new method for learning the structure of convolutional neural networks (CNNs) that is more efficient than recent state-of-the-art methods based on reinforcement learning and evolutionary algorithms. Our approach uses a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Chenxi Liu , Barret Zoph , Maxim Neumann , Jonathon Shlens , Wei Hua , Li-Jia Li , Li Fei-Fei , Alan Yuille , Jonathan Huang , Kevin Murphy

At present, designing convolutional neural network (CNN) architectures requires both human expertise and labor. New architectures are handcrafted by careful experimentation or modified from a handful of existing networks. We introduce…

Machine Learning · Computer Science 2017-03-24 Bowen Baker , Otkrist Gupta , Nikhil Naik , Ramesh Raskar

Despite the recent successes in robotic locomotion control, the design of robot relies heavily on human engineering. Automatic robot design has been a long studied subject, but the recent progress has been slowed due to the large…

Machine Learning · Computer Science 2019-06-24 Tingwu Wang , Yuhao Zhou , Sanja Fidler , Jimmy Ba