English
Related papers

Related papers: Hybrid-Layers Neural Network Architectures for Mod…

200 papers

Deep convolutional neural networks (DCNNs) have recently demonstrated high-quality results in single-image super-resolution (SR). DCNNs often suffer from over-parametrization and large amounts of redundancy, which results in inefficient…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Yinglan Ma , Hongyu Xiong , Zhe Hu , Lizhuang Ma

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

The extraction and proper utilization of convolution neural network (CNN) features have a significant impact on the performance of image super-resolution (SR). Although CNN features contain both the spatial and channel information, current…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Abdul Muqeet , Md Tauhid Bin Iqbal , Sung-Ho Bae

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Zhigang Wang , Hangyu Yang , Ning Wang , Chuanfei Xu , Jie Nie , Zhiqiang Wei , Yu Gu , Ge Yu

Convolutional Neural Networks (CNNs) have demonstrated their superiority in image classification, and evolutionary computation (EC) methods have recently been surging to automatically design the architectures of CNNs to save the tedious…

Neural and Evolutionary Computing · Computer Science 2018-08-23 Bin Wang , Yanan Sun , Bing Xue , Mengjie Zhang

With the demand of high data rate and low latency in fifth generation (5G), deep neural network decoder (NND) has become a promising candidate due to its capability of one-shot decoding and parallel computing. In this paper, three types of…

Signal Processing · Electrical Eng. & Systems 2018-02-01 Wei Lyu , Zhaoyang Zhang , Chunxu Jiao , Kangjian Qin , Huazi Zhang

Intrinsic image decomposition is the process of separating the reflectance and shading layers of an image, which is a challenging and underdetermined problem. In this paper, we propose to systematically address this problem using a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Sai Bi , Nima Khademi Kalantari , Ravi Ramamoorthi

We introduce a new class of non-linear models for functional data based on neural networks. Deep learning has been very successful in non-linear modeling, but there has been little work done in the functional data setting. We propose two…

Machine Learning · Computer Science 2023-05-11 Aniruddha Rajendra Rao , Matthew Reimherr

Hyperspectral image (HSI) denoising is critical for the effective analysis and interpretation of hyperspectral data. However, simultaneously modeling global and local features is rarely explored to enhance HSI denoising. In this letter, we…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Shuai Hu , Feng Gao , Xiaowei Zhou , Junyu Dong , Qian Du

Recurrent neural networks (RNNs) are omnipresent in sequence modeling tasks. Practical models usually consist of several layers of hundreds or thousands of neurons which are fully connected. This places a heavy computational and memory…

Machine Learning · Computer Science 2019-05-30 Matthijs Van Keirsbilck , Alexander Keller , Xiaodong Yang

We propose a multigrid extension of convolutional neural networks (CNNs). Rather than manipulating representations living on a single spatial grid, our network layers operate across scale space, on a pyramid of grids. They consume multigrid…

Computer Vision and Pattern Recognition · Computer Science 2017-05-15 Tsung-Wei Ke , Michael Maire , Stella X. Yu

With the rise of artificial intelligence in recent years, Deep Neural Networks (DNNs) have been widely used in many domains. To achieve high performance and energy efficiency, hardware acceleration (especially inference) of DNNs is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-17 Linghao Song , Jiachen Mao , Youwei Zhuo , Xuehai Qian , Hai Li , Yiran Chen

A novel hybrid deep neural network architecture is designed to capture the spatial-temporal features of unsteady flows around moving boundaries directly from high-dimensional unsteady flow fields data. The hybrid deep neural network is…

Computational Physics · Physics 2020-06-02 Renkun Han , Zhong Zhang , Yixing Wang , Ziyang Liu , Yang Zhang , Gang Chen

Understanding the inner workings of deep neural networks (DNNs) is essential to provide trustworthy artificial intelligence techniques for practical applications. Existing studies typically involve linking semantic concepts to units or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jie Hu , Liujuan Cao , Qixiang Ye , Tong Tong , ShengChuan Zhang , Ke Li , Feiyue Huang , Rongrong Ji , Ling Shao

Recent work has shown that recurrent neural networks (RNNs) can implicitly capture and exploit hierarchical information when trained to solve common natural language processing tasks such as language modeling (Linzen et al., 2016) and…

Computation and Language · Computer Science 2018-08-29 Ke Tran , Arianna Bisazza , Christof Monz

Over the long history of machine learning, which dates back several decades, recurrent neural networks (RNNs) have been used mainly for sequential data and time series and generally with 1D information. Even in some rare studies on 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Nguyen Huu Phong , Bernardete Ribeiro

Improving existing neural network architectures can involve several design choices such as manipulating the loss functions, employing a diverse learning strategy, exploiting gradient evolution at training time, optimizing the network…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti

Hypergraph neural networks (HNNs) using neural networks to encode hypergraphs provide a promising way to model higher-order relations in data and further solve relevant prediction tasks built upon such higher-order relations. However,…

Machine Learning · Computer Science 2023-02-16 Peihao Wang , Shenghao Yang , Yunyu Liu , Zhangyang Wang , Pan Li

Different neural network (NN) architectures have different advantages. Convolutional neural networks (CNNs) achieved enormous success in computer vision, while recurrent neural networks (RNNs) gained popularity in speech recognition. It is…

Signal Processing · Electrical Eng. & Systems 2019-07-18 Ziyu Ye , Andrew Gilman , Qihang Peng , Kelly Levick , Pamela Cosman , Larry Milstein