English
Related papers

Related papers: Particle Swarm Optimisation for Evolving Deep Neur…

200 papers

In this paper we propose DeepSwarm, a novel neural architecture search (NAS) method based on Swarm Intelligence principles. At its core DeepSwarm uses Ant Colony Optimization (ACO) to generate ant population which uses the pheromone…

Machine Learning · Computer Science 2019-05-20 Edvinas Byla , Wei Pang

Image classification is a difficult machine learning task, where Convolutional Neural Networks (CNNs) have been applied for over 20 years in order to solve the problem. In recent years, instead of the traditional way of only connecting the…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Bin Wang , Yanan Sun , Bing Xue , Mengjie Zhang

Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from…

Machine Learning · Computer Science 2019-11-13 Babak Hosseini , Romain Montagne , Barbara Hammer

Deep Neural Networks (DNNs) have achieved great success in many applications. The architectures of DNNs play a crucial role in their performance, which is usually manually designed with rich expertise. However, such a design process is…

Neural and Evolutionary Computing · Computer Science 2022-02-07 Yuqiao Liu , Yanan Sun , Bing Xue , Mengjie Zhang , Gary G. Yen , Kay Chen Tan

Convolution neural networks (CNNs) have achieved remarkable success, but typically accompany high computation cost and numerous redundant weight parameters. To reduce the FLOPs, structure pruning is a popular approach to remove the entire…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Bo Ji , Tianyi Chen

Thanks to the evolving network depth, convolutional neural networks (CNNs) have achieved remarkable success across various embedded scenarios, paving the way for ubiquitous embedded intelligence. Despite its promise, the evolving network…

Machine Learning · Computer Science 2025-12-24 Xiangzhong Luo , Weichen Liu

Parameter updating is an important stage in parallelism-based distributed deep learning. Synchronous methods are widely used in distributed training the Deep Neural Networks (DNNs). To reduce the communication and synchronization overhead…

Machine Learning · Computer Science 2020-09-09 Qing Ye , Yuxuan Han , Yanan sun , JIancheng Lv

Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant increases in computation complexity. Largescale deep learning…

Neural and Evolutionary Computing · Computer Science 2018-05-14 Zhe Li , Ji Li , Ao Ren , Caiwen Ding , Jeffrey Draper , Qinru Qiu , Bo Yuan , Yanzhi Wang

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

Deep Convolutional Neural Networks (CNNs) are widely employed in modern computer vision algorithms, where the input image is convolved iteratively by many kernels to extract the knowledge behind it. However, with the depth of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Chih-Ting Liu , Yi-Heng Wu , Yu-Sheng Lin , Shao-Yi Chien

Weight pruning is among the most popular approaches for compressing deep convolutional neural networks. Recent work suggests that in a randomly initialized deep neural network, there exist sparse subnetworks that achieve performance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Vinay Kumar Verma , Nikhil Mehta , Shijing Si , Ricardo Henao , Lawrence Carin

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

Binary Convolutional Neural Networks (CNNs) have significantly reduced the number of arithmetic operations and the size of memory storage needed for CNNs, which makes their deployment on mobile and embedded systems more feasible. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Baozhou Zhu , Zaid Al-Ars , Peter Hofstee

Convolutional neural network (CNN) is one of the most prominent architectures and algorithm in Deep Learning. It shows a remarkable improvement in the recognition and classification of objects. This method has also been proven to be very…

Computer Vision and Pattern Recognition · Computer Science 2016-10-10 Vina Ayumi , L. M. Rasdi Rere , Mohamad Ivan Fanany , Aniati Murni Arymurthy

Deep Convolutional Neural Networks (CNN) provides an "end-to-end" solution for image pattern recognition with impressive performance in many areas of application including medical imaging. Most CNN models of high performance use…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Mohammed Ahmed , Hongbo Du , Alaa AlZoubi

Convolutional Neural Networks (CNNs) have been proven to be extremely successful at solving computer vision tasks. State-of-the-art methods favor such deep network architectures for its accuracy performance, with the cost of having massive…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Jiahui Huang , Kshitij Dwivedi , Gemma Roig

This paper addresses the difficult problem of finding an optimal neural architecture design for a given image classification task. We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Juan-Manuel Perez-Rua , Moez Baccouche , Stephane Pateux

Convolutional Neural Networks (CNNs) have achieved remarkable success across a wide range of machine learning tasks by leveraging hierarchical feature learning through deep architectures. However, the large number of layers and millions of…

Machine Learning · Statistics 2025-11-18 Biyi Fang , Truong Vo , Jean Utke , Diego Klabjan

We propose a new method for learning the structure of convolutional neural networks (CNNs) that is more efficient than recent state-of-the-art methods based on reinforcement learning and evolutionary algorithms. Our approach uses a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Chenxi Liu , Barret Zoph , Maxim Neumann , Jonathon Shlens , Wei Hua , Li-Jia Li , Li Fei-Fei , Alan Yuille , Jonathan Huang , Kevin Murphy

Neural Architecture Search (NAS) methods have shown to output networks that largely outperform human-designed networks. However, conventional NAS methods have mostly tackled the single dataset scenario, incuring in a large computational…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Sofia Casarin , Oswald Lanz , Sergio Escalera