English
Related papers

Related papers: Performance versus Complexity Study of Neural Netw…

200 papers

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

To satisfy the growing throughput demand of data-intensive applications, the performance of optical communication systems increased dramatically in recent years. With higher throughput, more advanced equalizers are crucial, to compensate…

Hardware Architecture · Computer Science 2024-05-07 Jonas Ney , Christoph Füllner , Vincent Lauinger , Laurent Schmalen , Sebastian Randel , Norbert Wehn

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Convolutional neural networks (CNNs) have enabled the state-of-the-art performance in many computer vision tasks. However, little effort has been devoted to establishing convolution in non-linear space. Existing works mainly leverage on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Chen Wang , Jianfei Yang , Lihua Xie , Junsong Yuan

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Qingzhong Wang , Antoni B. Chan

We introduce for the first time the utilization of Long short-term memory (LSTM) neural network architectures for the compensation of fiber nonlinearities in digital coherent systems. We conduct numerical simulations considering either…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Stavros Deligiannidis , Adonis Bogris , Charis Mesaritakis , Yannis Kopsinis

In this work, we address the question of the adaptability of artificial neural networks (NNs) used for impairments mitigation in optical transmission systems. We demonstrate that by using well-developed techniques based on the concept of…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Pedro J. Freire , Daniel Abode , Jaroslaw E. Prilepsky , Nelson Costa , Bernhard Spinnler , Antonio Napoli , Sergei K. Turitsyn

This paper presents a new hybrid architecture for voice activity detection (VAD) incorporating both convolutional neural network (CNN) and bidirectional long short-term memory (BiLSTM) layers trained in an end-to-end manner. In addition, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-08 Nicholas Wilkinson , Thomas Niesler

In this paper, we propose a scheme that utilizes the optimization ability of artificial intelligence (AI) for optimal transceiver-joint equalization in compensating for the optical filtering impairments caused by wavelength selective…

Signal Processing · Electrical Eng. & Systems 2021-09-29 Zhiqun Zhai , Hexun Jiang , Mengfan Fu , Lei Liu , Lilin Yi , Weisheng Hu , Qunbi Zhuge

The quantization of neural networks for the mitigation of the nonlinear and components' distortions in dual-polarization optical fiber transmission is studied. Two low-complexity neural network equalizers are applied in three 16-QAM 34.4…

Signal Processing · Electrical Eng. & Systems 2023-10-11 Jamal Darweesh , Nelson Costa , Antonio Napoli , Bernhard Spinnler , Yves Jaouen , Mansoor Yousefi

Fiber Kerr nonlinearity is a fundamental limitation to the achievable capacity of long-distance optical fiber communication. Digital back-propagation (DBP) is a primary methodology to mitigate both linear and nonlinear impairments by…

Signal Processing · Electrical Eng. & Systems 2022-04-20 Hao Ming , Xinyu Chen , Xiansong Fang , Lei Zhang , Chenjia Li , Fan Zhang

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

In this paper, we introduce a new nonlinear optical channel equalizer based on Transformers. By leveraging parallel computation and attending directly to the memory across a sequence of symbols, we show that Transformers can be used…

Information Theory · Computer Science 2024-08-02 Behnam Behinaein Hamgini , Hossein Najafi , Ali Bakhshali , Zhuhong Zhang

Capsule network has shown various advantages over convolutional neural network (CNN). It keeps more precise spatial information than CNN and uses equivariance instead of invariance during inference and highly potential to be a new effective…

Machine Learning · Computer Science 2019-05-06 Zonglin Yang , Xinggang Wang

We study performance characteristics of convolutional neural networks (CNN) for mobile computer vision systems. CNNs have proven to be a powerful and efficient approach to implement such systems. However, the system performance depends…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jussi Hanhirova , Teemu Kämäräinen , Sipi Seppälä , Matti Siekkinen , Vesa Hirvisalo , Antti Ylä-Jääski

Binarized convolutional neural networks (BCNNs) are widely used to improve memory and computation efficiency of deep convolutional neural networks (DCNNs) for mobile and AI chips based applications. However, current BCNNs are not able to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Chunlei Liu , Wenrui Ding , Xin Xia , Yuan Hu , Baochang Zhang , Jianzhuang Liu , Bohan Zhuang , Guodong Guo

The solution of nonlinear electromagnetic (EM) inverse scattering problems is typically hindered by several challenges such as ill-posedness, strong nonlinearity, and high computational costs. Recently, deep learning has been demonstrated…

Computational Physics · Physics 2020-01-08 Lianlin Li , Long Gang Wang , Fernando L. Teixeira

Convolutional neural networks (CNNs) are similar to "ordinary" neural networks in the sense that they are made up of hidden layers consisting of neurons with "learnable" parameters. These neurons receive inputs, performs a dot product, and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Abien Fred Agarap

A convolutional neural network is proposed to mitigate fiber transmission effects, achieving a five-fold reduction in trainable parameters compared to alternative equalizers, and 3.5 dB improvement in MSE compared to DBP with comparable…

Signal Processing · Electrical Eng. & Systems 2022-10-12 Mohannad Abu-romoh , Nelson Costa , Antonio Napoli , João Pedro , Yves Jaouën , Mansoor Yousefi