English
Related papers

Related papers: Particle Swarm Optimisation for Evolving Deep Neur…

200 papers

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

Machine Learning · Computer Science 2022-01-03 Marcin Pietroń , Dominik Żurek

In this paper, we present a novel method for dynamically expanding Convolutional Neural Networks (CNNs) during training, aimed at meeting the increasing demand for efficient and sustainable deep learning models. Our approach, drawing from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Blaise Appolinary , Alex Deaconu , Sophia Yang , Qingze , Li

Network virtualization has caught the attention of many researchers in recent years. It facilitates the process of creating several virtual networks over a single physical network. Despite this advantage, however, network virtualization…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-01 Amal S. Alzahrani , Ashraf A. Shahin

We develop an approach to growing deep network architectures over the course of training, driven by a principled combination of accuracy and sparsity objectives. Unlike existing pruning or architecture search techniques that operate on…

Machine Learning · Computer Science 2023-06-07 Xin Yuan , Pedro Savarese , Michael Maire

Convolutional neural networks (CNNs) have achieved remarkable success in image recognition. Although the internal patterns of the input images are effectively learned by the CNNs, these patterns only constitute a small proportion of useful…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhengsu Chen , Jianwei Niu , Xuefeng Liu , Shaojie Tang

Neural architecture search (NAS) has emerged as a promising avenue for automatically designing task-specific neural networks. Existing NAS approaches require one complete search for each deployment specification of hardware or objective.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zhichao Lu , Gautam Sreekumar , Erik Goodman , Wolfgang Banzhaf , Kalyanmoy Deb , Vishnu Naresh Boddeti

Conventional deep convolutional neural networks (CNNs) apply convolution operators uniformly in space across all feature maps for hundreds of layers - this incurs a high computational cost for real-time applications. For many problems such…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mengye Ren , Andrei Pokrovsky , Bin Yang , Raquel Urtasun

Deep Convolutional Neural Network (DCNN) and Transformer have achieved remarkable successes in image recognition. However, their performance in fine-grained image recognition is still difficult to meet the requirements of actual needs. This…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Chaorong Li , Malu Zhang , Wei Huang , Fengqing Qin , Anping Zeng , Yuanyuan Huang

Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Convolutional Neural Networks (CNNs) are the predominant model used for a variety of medical image analysis tasks. At inference time, these models are computationally intensive, especially with volumetric data. In principle, it is possible…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Jose Javier Gonzalez Ortiz , John Guttag , Adrian Dalca

The evolutionary paradigm has been successfully applied to neural network search(NAS) in recent years. Due to the vast search complexity of the global space, current research mainly seeks to repeatedly stack partial architectures to build…

Neural and Evolutionary Computing · Computer Science 2024-03-06 Juan Zou , Weiwei Jiang , Yizhang Xia , Yuan Liu , Zhanglu Hou

Deep neural networks have enjoyed remarkable success for various vision tasks, however it remains challenging to apply CNNs to domains lacking a regular underlying structures such as 3D point clouds. Towards this we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Yifan Xu , Tianqi Fan , Mingye Xu , Long Zeng , Yu Qiao

Remarkable achievements have been attained by deep neural networks in various applications. However, the increasing depth and width of such models also lead to explosive growth in both storage and computation, which has restricted the…

Machine Learning · Computer Science 2019-06-11 Linfeng Zhang , Zhanhong Tan , Jiebo Song , Jingwei Chen , Chenglong Bao , Kaisheng Ma

Ensuring energy-efficient design in neuromorphic computing systems necessitates a tailored architecture combined with algorithmic approaches. This manuscript focuses on enhancing brain-inspired perceptual computing machines through a novel…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Ali Shiri Sichani , Sai Kankatala

With recent rapid advances in photonic integrated circuits, it has been demonstrated that programmable photonic chips can be used to implement artificial neural networks. Convolutional neural networks (CNN) are a class of deep learning…

Signal Processing · Electrical Eng. & Systems 2020-03-30 Jun Rong Ong , Chin Chun Ooi , Thomas Y. L. Ang , Soon Thor Lim , Ching Eng Png

To address memory and computation resource limitations for hardware-oriented acceleration of deep convolutional neural networks (CNNs), we present a computation flow, stacked filters stationary flow (SFS), and a corresponding data encoding…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Yuechao Gao , Nianhong Liu , Sheng Zhang

Deep neural networks have been remarkable successful in various AI tasks but often cast high computation and energy cost for energy-constrained applications such as mobile sensing. We address this problem by proposing a novel framework that…

Machine Learning · Computer Science 2017-10-11 Jiaqi Guan , Yang Liu , Qiang Liu , Jian Peng

The recent advancement in deep learning (DL) for automatic modulation classification (AMC) of wireless signals has encouraged numerous possible applications on resource-constrained edge devices. However, developing optimized DL models…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Nayan Moni Baishya , B. R. Manoj , Prabin K. Bora

Most edge-cloud collaboration frameworks rely on the substantial computational and storage capabilities of cloud-based artificial neural networks (ANNs). However, this reliance results in significant communication overhead between edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Di Yu , Changze Lv , Xin Du , Linshan Jiang , Wentao Tong , Zhenyu Liao , Xiaoqing Zheng , Shuiguang Deng

With the edge computing becoming an increasingly adopted concept in system architectures, it is expected its utilization will be additionally heightened when combined with deep learning (DL) techniques. The idea behind integrating demanding…

Networking and Internet Architecture · Computer Science 2020-03-12 Mounir Bensalem , Jasenka Dizdarević , Admela Jukan