English
Related papers

Related papers: Stochastic Digital Backpropagation with Residual M…

200 papers

Digital backpropagation (DBP) is one of the most effective techniques for compensating nonlinear distortions in coherent optical fiber communication systems. However, its practical application to wideband transmission remains limited by…

We propose a memory efficient method, named Stochastic Backpropagation (SBP), for training deep neural networks on videos. It is based on the finding that gradients from incomplete execution for backpropagation can still effectively train…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Feng Cheng , Mingze Xu , Yuanjun Xiong , Hao Chen , Xinyu Li , Wei Li , Wei Xia

In this paper, we provide an in-depth study of Stochastic Backpropagation (SBP) when training deep neural networks for standard image classification and object detection tasks. During backward propagation, SBP calculates the gradients by…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Jun Fang , Mingze Xu , Hao Chen , Bing Shuai , Zhuowen Tu , Joseph Tighe

Enhanced-SSFM digital backpropagation (DBP) is experimentally demonstrated and compared to conventional DBP. A 112 Gb/s PM-QPSK signal is transmitted over a 3200 km dispersion-unmanaged link. The intradyne coherent receiver includes…

Other Computer Science · Computer Science 2015-07-06 Marco Secondini , Simon Rommel , Francesco Fresi , Enrico Forestieri , Gianluca Meloni , Luca Potì

We propose a novel digital backpropagation (DBP) technique that combines perturbation theory, subband processing, and splitting ratio optimization. We obtain 0.23 dB, 0.47 dB, or 0.91 dB gains w.r.t. dispersion compensation with only 74,…

Information Theory · Computer Science 2024-05-15 Stella Civelli , Debi Pada Jana , Enrico Forestieri , Marco Secondini

Efficient nonlinearity compensation in fiber-optic communication systems is considered a key element to go beyond the "capacity crunch''. One guiding principle for previous work on the design of practical nonlinearity compensation schemes…

This work proposes a novel low-complexity digital backpropagation (DBP) method, with the goal of optimizing the trade-off between backpropagation accuracy and complexity. The method combines a split step Fourier method (SSFM)-like structure…

Information Theory · Computer Science 2025-04-04 Stella Civelli , Debi Pada Jana , Enrico Forestieri , Marco Secondini

Nonlinearity mitigation using digital signal processing has been shown to increase the achievable data rates of optical fiber transmission links. One especially effective technique is digital back propagation (DBP), an algorithm capable of…

Signal Processing · Electrical Eng. & Systems 2018-08-31 Tom Sherborne , Benjamin Banks , Daniel Semrau , Robert I. Killey , Polina Bayvel , Domaniç Lavery

In fiber-optic communications, evaluation of mutual information (MI) is still an open issue due to the unavailability of an exact and mathematically tractable channel model. Traditionally, lower bounds on MI are computed by approximating…

Information Theory · Computer Science 2024-01-25 Naga V. Irukulapati , Marco Secondini , Erik Agrell , Pontus Johannisson , Henk Wymeersch

Derived from the regular perturbation treatment of the nonlinear Schrodinger equation, a machine learning-based scheme to mitigate the intra-channel optical fiber nonlinearity is proposed. Referred to as the perturbation theory-aided (PA)…

Signal Processing · Electrical Eng. & Systems 2022-04-06 Xiang Lin , Shenghang Luo , Sunish Kumar Orappanpara Soman , Octavia A. Dobre , Lutz Lampe , Deyuan Chang , Chuandong Li

Spiking Neural Networks (SNNs) use spatio-temporal spike patterns to represent and transmit information, which is not only biologically realistic but also suitable for ultra-low-power event-driven neuromorphic implementation. Motivated by…

Neural and Evolutionary Computing · Computer Science 2020-11-05 Malu Zhang , Jiadong Wang , Burin Amornpaisannon , Zhixuan Zhang , VPK Miriyala , Ammar Belatreche , Hong Qu , Jibin Wu , Yansong Chua , Trevor E. Carlson , Haizhou Li

Random backpropagation (RBP) is a variant of the backpropagation algorithm for training neural networks, where the transpose of the forward matrices are replaced by fixed random matrices in the calculation of the weight updates. It is…

Machine Learning · Computer Science 2017-12-25 Pierre Baldi , Peter Sadowski , Zhiqin Lu

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

We recently proposed the STiDi-BP algorithm, which avoids backward recursive gradient computation, for training multi-layer spiking neural networks (SNNs) with single-spike-based temporal coding. The algorithm employs a linear approximation…

Neural and Evolutionary Computing · Computer Science 2021-09-01 Maryam Mirsadeghi , Majid Shalchian , Saeed Reza Kheradpisheh , Timothée Masquelier

Dynamic Spectral Backpropagation (DSBP) enhances neural network training under resource constraints by projecting gradients onto principal eigenvectors, reducing complexity and promoting flat minima. Five extensions are proposed, dynamic…

Machine Learning · Computer Science 2025-05-30 Mannmohan Muthuraman

A neural-network-based approach is presented to efficiently implement digital backpropagation (DBP). For a 32x100 km fiber-optic link, the resulting "learned" DBP significantly reduces the complexity compared to conventional DBP…

Information Theory · Computer Science 2017-10-18 Christian Häger , Henry D. Pfister

The a posteriori speech presence probability (SPP) is the fundamental component of noise power spectral density (PSD) estimation, which can contribute to speech enhancement and speech recognition systems. Most existing SPP estimators can…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-24 Shuai Tao , Jesper Rindom Jensen , Yang Xiang , Himavanth Reddy , Qingzheng Zhang , Mads Græsbøll Christensen

Neural network learning is usually time-consuming since backpropagation needs to compute full gradients and backpropagate them across multiple layers. Despite its success of existing works in accelerating propagation through sparseness, the…

Machine Learning · Computer Science 2020-10-28 Zhiyuan Zhang , Pengcheng Yang , Xuancheng Ren , Qi Su , Xu Sun

A novel technique for digital backpropagation (DBP) in wavelength-division multiplexing systems is introduced and shown, by simulations, to outperform existing DBP techniques for approximately the same complexity.

Information Theory · Computer Science 2021-02-17 S. Civelli , E. Forestieri , A. Lotsmanov , D. Razdoburdin , M. Secondini

Nonlinear effects in high-speed optical fiber systems fundamentally limit channel capacity. While traditional Digital Backward Propagation (DBP) with adaptive filters addresses these effects, its computational complexity remains…

Signal Processing · Electrical Eng. & Systems 2025-06-11 Xinyu Xiao , Zhennan Zhou , Bin Dong , Dingjiong Ma , Li Zhou , Jie Sun
‹ Prev 1 2 3 10 Next ›