English
Related papers

Related papers: Enhancing Convolutional Neural Networks with Highe…

200 papers

In this paper, we present a novel method for dynamically expanding Convolutional Neural Networks (CNNs) during training, aimed at meeting the increasing demand for efficient and sustainable deep learning models. Our approach, drawing from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Blaise Appolinary , Alex Deaconu , Sophia Yang , Qingze , Li

Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant increases in computation complexity. Largescale deep learning…

Neural and Evolutionary Computing · Computer Science 2018-05-14 Zhe Li , Ji Li , Ao Ren , Caiwen Ding , Jeffrey Draper , Qinru Qiu , Bo Yuan , Yanzhi Wang

We propose methodologies to train highly accurate and efficient deep convolutional neural networks (CNNs) for image super resolution (SR). A cascade training approach to deep learning is proposed to improve the accuracy of the neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

Convolutional Neural Networks (CNNs) are currently adopted to solve an ever greater number of problems, ranging from speech recognition to image classification and segmentation. The large amount of processing required by CNNs calls for…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-06 Kamel Abdelouahab , Maxime Pelcat , Jocelyn Serot , François Berry

Deep convolutional neural networks (DCNNs) are a class of artificial neural networks, primarily for computer vision tasks such as segmentation and classification. Many nonlinear operations, such as activation functions and pooling…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zuocheng Wen , Lingzhong Guo

Deep convolutional networks based super-resolution is a fast-growing field with numerous practical applications. In this exposition, we extensively compare 30+ state-of-the-art super-resolution Convolutional Neural Networks (CNNs) over…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Saeed Anwar , Salman Khan , Nick Barnes

Convolutional Neural Networks (CNNs) have been successfully applied to many computer vision tasks, such as image classification. By performing linear combinations and element-wise nonlinear operations, these networks can be thought of as…

Computer Vision and Pattern Recognition · Computer Science 2017-03-21 Kaicheng Yu , Mathieu Salzmann

Scaling CNN training is necessary to keep up with growing datasets and reduce training time. We also see an emerging need to handle datasets with very large samples, where memory requirements for training are large. Existing training…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-18 Nikoli Dryden , Naoya Maruyama , Tom Benson , Tim Moon , Marc Snir , Brian Van Essen

We introduce a new method for speeding up the inference of deep neural networks. It is somewhat inspired by the reduced-order modeling techniques for dynamical systems.The cornerstone of the proposed method is the maximum volume algorithm.…

Machine Learning · Computer Science 2020-11-26 Julia Gusak , Talgat Daulbaev , Evgeny Ponomarev , Andrzej Cichocki , Ivan Oseledets

Discriminative learning based on convolutional neural networks (CNNs) aims to perform image restoration by learning from training examples of noisy-clean image pairs. It has become the go-to methodology for tackling image restoration and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Junaid Malik , Serkan Kiranyaz , Moncef Gabbouj

Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Zhichao Lu , Ian Whalen , Yashesh Dhebar , Kalyanmoy Deb , Erik Goodman , Wolfgang Banzhaf , Vishnu Naresh Boddeti

Object detection systems based on the deep convolutional neural network (CNN) have recently made ground- breaking advances on several object detection benchmarks. While the features learned by these high-capacity neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2016-01-15 Yuting Zhang , Kihyuk Sohn , Ruben Villegas , Gang Pan , Honglak Lee

Deep learning, especially convolutional neural networks, has triggered accelerated advancements in computer vision, bringing changes into our daily practice. Furthermore, the standardized deep learning modules (also known as backbone…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Hongzhi Zhu , Robert Rohling , Septimiu Salcudean

NeuroEvolution (NE) methods are known for applying Evolutionary Computation to the optimisation of Artificial Neural Networks(ANNs). Despite aiding non-expert users to design and train ANNs, the vast majority of NE approaches disregard the…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Filipe Assunção , Nuno Lourenço , Bernardete Ribeiro , Penousal Machado

Convolutional neural network (CNN) and its variants have led to many state-of-art results in various fields. However, a clear theoretical understanding about them is still lacking. Recently, multi-layer convolutional sparse coding (ML-CSC)…

Machine Learning · Computer Science 2020-07-22 Zhiyang Zhang , Shihua Zhang

Real-world face detection and alignment demand an advanced discriminative model to address challenges by pose, lighting and expression. Illuminated by the deep learning algorithm, some convolutional neural networks based face detection and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Weilin Cong , Sanyuan Zhao , Hui Tian , Jianbing Shen

Convolutional neural networks (CNNs) have been tremendously successful in solving imaging inverse problems. To understand their success, an effective strategy is to construct simpler and mathematically more tractable convolutional sparse…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Tianlin Liu , Anadi Chaman , David Belius , Ivan Dokmanić

Current deep convolutional networks are fixed in their topology. We explore the possibilites of making the convolutional topology a parameter itself by combining NeuroEvolution of Augmenting Topologies (NEAT) with Convolutional Neural…

Neural and Evolutionary Computing · Computer Science 2022-12-01 Jan Hohenheim , Mathias Fischler , Sara Zarubica , Jeremy Stucki

This article presents a reduced-order modeling methodology via deep convolutional neural networks (CNNs) for shape optimization applications. The CNN provides a nonlinear mapping between the shapes and their associated attributes while…

Optimization and Control · Mathematics 2022-02-16 Wrik Mallik , Neil Farvolden , Jasmin Jelovica , Rajeev K. Jaiman

Convolutional neural networks (CNNs) demand huge DRAM bandwidth for computational imaging tasks, and block-based processing has recently been applied to greatly reduce the bandwidth. However, the induced additional computation for feature…

Machine Learning · Computer Science 2020-01-31 Chao-Tsung Huang