English
Related papers

Related papers: Hybrid-Layers Neural Network Architectures for Mod…

200 papers

Recently, single-image super-resolution has made great progress owing to the development of deep convolutional neural networks (CNNs). The vast majority of CNN-based models use a pre-defined upsampling operator, such as bicubic…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Xin Yang , Haiyang Mei , Jiqing Zhang , Ke Xu , Baocai Yin , Qiang Zhang , Xiaopeng Wei

Binary Neural Networks (BNNs), neural networks with weights and activations constrained to -1(0) and +1, are an alternative to deep neural networks which offer faster training, lower memory consumption and lightweight models, ideal for use…

Machine Learning · Computer Science 2022-05-23 Kinshuk Dua

Deep neural networks (DNNs) have found applications in diverse signal processing (SP) problems. Most efforts either directly adopt the DNN as a black-box approach to perform certain SP tasks without taking into account of any known…

Signal Processing · Electrical Eng. & Systems 2022-04-27 Zhe Zhang , Xiang Chen , Zhi Tian

The flexible duplex (FD) technique, including dynamic time-division duplex (D-TDD) and dynamic frequency-division duplex (D-FDD), is regarded as a promising solution to achieving a more flexible uplink/downlink transmission in 5G-Advanced…

Artificial Intelligence · Computer Science 2023-04-26 Jing-Sheng Tan , Shaoshi Yang , Kuo Meng , Jianhua Zhang , Yurong Tang , Yan Bu , Guizhen Wang

How can local-search methods such as stochastic gradient descent (SGD) avoid bad local minima in training multi-layer neural networks? Why can they fit random labels even given non-convex and non-smooth architectures? Most existing theory…

Machine Learning · Computer Science 2019-05-28 Zeyuan Allen-Zhu , Yuanzhi Li , Zhao Song

In this work, we study the problem of non-blind image deconvolution and propose a novel recurrent network architecture that leads to very competitive restoration results of high image quality. Motivated by the computational efficiency and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Iaroslav Koshelev , Daniil Selikhanovych , Stamatios Lefkimmiatis

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

Recurrent neural networks can be large and compute-intensive, yet many applications that benefit from RNNs run on small devices with very limited compute and storage capabilities while still having run-time constraints. As a result, there…

Machine Learning · Computer Science 2020-08-14 Urmish Thakker , Jesse Beu , Dibakar Gope , Ganesh Dasika , Matthew Mattina

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Approaches to machine intelligence based on brain models have stressed the use of neural networks for generalization. Here we propose the use of a hybrid neural network architecture that uses two kind of neural networks simultaneously: (i)…

Neural and Evolutionary Computing · Computer Science 2008-10-01 Yuhua Chen , Subhash Kak , Lei Wang

Conventional Convolutional neural networks (CNN) are trained on large domain datasets and are hence typically over-represented and inefficient in limited class applications. An efficient way to convert such large many-class pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 K. Sai Ram , Jayanta Mukherjee , Amit Patra , Partha Pratim Das

In this paper, we explore the application of Recurrent Neural Network (RNN) for still images. Typically, Convolutional Neural Networks (CNNs) are the prevalent method applied for this type of data, and more recently, transformers have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Dmitri , Lvov , Yair Smadar , Ran Bezen

Advances in image super-resolution (SR) have recently benefited significantly from rapid developments in deep neural networks. Inspired by these recent discoveries, we note that many state-of-the-art deep SR architectures can be…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Wei Han , Shiyu Chang , Ding Liu , Mo Yu , Michael Witbrock , Thomas S. Huang

Convolutional Neural Networks (CNNs) have achieved significant breakthroughs in various fields. However, these advancements have led to a substantial increase in the complexity and size of these networks. This poses a challenge when…

Machine Learning · Computer Science 2025-09-11 Ahmed Sadaqa , Di Liu

Efficient processing of large-scale time series data is an intricate problem in machine learning. Conventional sensor signal processing pipelines with hand engineered feature extraction often involve huge computational cost with high…

Nowadays, we mainly use various convolution neural network (CNN) structures to extract features from radio data or spectrogram in AMR. Based on expert experience and spectrograms, they not only increase the difficulty of preprocessing, but…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Miao Du , Qin Yu , Shaomin Fei , Chen Wang , Xiaofeng Gong , Ruisen Luo

Recently, deep neural networks have achieved impressive performance in terms of both reconstruction accuracy and efficiency for single image super-resolution (SISR). However, the network model of these methods is a fully convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Yongliang Tang , Jiashui Huang , Faen Zhang , Weiguo Gong

Hyperspectral image (HSI) denoising is an essential procedure for HSI applications. Unfortunately, the existing Transformer-based methods mainly focus on non-local modeling, neglecting the importance of locality in image denoising.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Hao Liang , Chengjie , Kun Li , Xin Tian

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan

The rapid development of deep learning provides a better solution for the end-to-end reconstruction of hyperspectral image (HSI). However, existing learning-based methods have two major defects. Firstly, networks with self-attention usually…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Xiaowan Hu , Yuanhao Cai , Jing Lin , Haoqian Wang , Xin Yuan , Yulun Zhang , Radu Timofte , Luc Van Gool