English
Related papers

Related papers: Wideband Time-Domain Digital Backpropagation via S…

200 papers

Deep Neural Networks are successful but highly computationally expensive learning systems. One of the main sources of time and energy drains is the well known backpropagation (backprop) algorithm, which roughly accounts for 2/3 of the…

Machine Learning · Computer Science 2020-04-17 Simon Wiedemann , Temesgen Mehari , Kevin Kepp , Wojciech Samek

As Deep Neural Networks (DNNs) grow in size and complexity, they often exceed the memory capacity of a single accelerator, necessitating the sharding of model parameters across multiple accelerators. Pipeline parallelism is a commonly used…

Machine Learning · Computer Science 2024-05-29 Christopher Rae , Joseph K. L. Lee , James Richings

The backpropagation algorithm remains the dominant and most successful method for training deep neural networks (DNNs). At the same time, training DNNs at scale comes at a significant computational cost and therefore a high carbon…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Joshua Offergeld , Nasir Ahmad , Marcel van Gerven

Efficient nonlinearity compensation in fiber-optic communication systems is considered a key element to go beyond the "capacity crunch''. One guiding principle for previous work on the design of practical nonlinearity compensation schemes…

Spatial signal processors (SSP) for emerging millimeter-wave wireless networks are critically dependent on link discovery. To avoid loss in communication, mobile devices need to locate narrow directional beams with millisecond latency. In…

Signal Processing · Electrical Eng. & Systems 2021-06-03 Chung-Ching Lin , Chase Puglisi , Veljko Boljanovic , Soumen Mohapatra , Han Yan , Erfan Ghaderi , Deukhyoun Heo , Danijela Cabric , Subhanshu Gupta

In order to solve the problems of waveform distortion and signal delay by many physical and electrical systems with multi-pole linear low-pass transfer characteristics, a simple digital-signal-processing (DSP)-based method of real-time…

Instrumentation and Detectors · Physics 2017-09-15 Jhinhwan Lee

Compensating for nonlinear effects using digital signal processing (DSP) is complex and computationally expensive in long-haul optical communication systems due to intractable interactions between Kerr nonlinearity, chromatic dispersion…

Signal Processing · Electrical Eng. & Systems 2023-08-24 Naveenta Gautam , Sai Vikranth Pendem , Brejesh Lall , Amol Choudhary

The vulnerability of deep neural networks (DNNs) to adversarial examples has drawn great attention from the community. In this paper, we study the transferability of such examples, which lays the foundation of many black-box attacks on…

Machine Learning · Computer Science 2020-12-08 Yiwen Guo , Qizhang Li , Hao Chen

Digital Predistortion (DPD) is a popular technique to enhance signal quality in wideband RF power amplifiers (PAs). With increasing bandwidth and data rates, DPD faces significant energy consumption challenges during deployment, contrasting…

Signal Processing · Electrical Eng. & Systems 2025-08-26 Yizhuo Wu , Yi Zhu , Kun Qian , Qinyu Chen , Anding Zhu , John Gajadharsing , Leo C. N. de Vreede , Chang Gao

Nonlinear and dispersive transmission impairments in coherent fiber-optic communication systems are often compensated by reverting the nonlinear Schr\"odinger equation, which describes the evolution of the signal in the link, numerically.…

Information Theory · Computer Science 2015-09-30 Sander Wahls , Son T. Le , Jaroslaw E. Prilepsky , H. Vincent Poor , Sergei K. Turitsyn

Backpropagation algorithm is indispensable for the training of feedforward neural networks. It requires propagating error gradients sequentially from the output layer all the way back to the input layer. The backward locking in…

Machine Learning · Computer Science 2018-07-24 Zhouyuan Huo , Bin Gu , Qian Yang , Heng Huang

Deep spiking neural networks (SNNs) hold great potential for improving the latency and energy efficiency of deep neural networks through event-based computation. However, training such networks is difficult due to the non-differentiable…

Neural and Evolutionary Computing · Computer Science 2016-09-01 Jun Haeng Lee , Tobi Delbruck , Michael Pfeiffer

Nonlinear effects in high-speed optical fiber systems fundamentally limit channel capacity. While traditional Digital Backward Propagation (DBP) with adaptive filters addresses these effects, its computational complexity remains…

Signal Processing · Electrical Eng. & Systems 2025-06-11 Xinyu Xiao , Zhennan Zhou , Bin Dong , Dingjiong Ma , Li Zhou , Jie Sun

We propose a fiber nonlinearity post-compensation technique using the DNN and the second-order perturbation theory. We achieve 1 dB Q-factor improvement for a 32 Gbaud PDM-64-QAM at 1200 km compared to the linear dispersion compensation.

Signal Processing · Electrical Eng. & Systems 2021-06-29 O. S. Sunish Kumar , Lutz Lampe , Shenghang Luo , Mrinmoy Jana , Jeebak Mitra , Chuandong Li

Spiking Neural Networks (SNNs) use spatio-temporal spike patterns to represent and transmit information, which is not only biologically realistic but also suitable for ultra-low-power event-driven neuromorphic implementation. Motivated by…

Neural and Evolutionary Computing · Computer Science 2020-11-05 Malu Zhang , Jiadong Wang , Burin Amornpaisannon , Zhixuan Zhang , VPK Miriyala , Ammar Belatreche , Hong Qu , Jibin Wu , Yansong Chua , Trevor E. Carlson , Haizhou Li

Derived from the regular perturbation treatment of the nonlinear Schrodinger equation, a machine learning-based scheme to mitigate the intra-channel optical fiber nonlinearity is proposed. Referred to as the perturbation theory-aided (PA)…

Signal Processing · Electrical Eng. & Systems 2022-04-06 Xiang Lin , Shenghang Luo , Sunish Kumar Orappanpara Soman , Octavia A. Dobre , Lutz Lampe , Deyuan Chang , Chuandong Li

Speech enhancement methods based on deep learning have surpassed traditional methods. While many of these new approaches are operating on the wideband (16kHz) sample rate, a new fullband (48kHz) speech enhancement system is proposed in this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-31 Xu Zhang , Lianwu Chen , Xiguang Zheng , Xinlei Ren , Chen Zhang , Liang Guo , Bing Yu

Stochastic digital backpropagation (SDBP) is an extension of digital backpropagation (DBP) and is based on the maximum a posteriori principle. SDBP takes into account noise from the optical amplifiers in addition to handling deterministic…

Information Theory · Computer Science 2024-01-25 Naga V. Irukulapati , Domenico Marsella , Pontus Johannisson , Erik Agrell , Marco Secondini , Henk Wymeersch

We propose a novel deep learning-based channel estimation technique for high-dimensional communication signals that does not require any training. Our method is broadly applicable to channel estimation for multicarrier signals with any…

Signal Processing · Electrical Eng. & Systems 2019-04-23 Eren Balevi , Jeffrey G. Andrews

Spiking neural networks (SNNs) can utilize spatio-temporal information and have a nature of energy efficiency which is a good alternative to deep neural networks(DNNs). The event-driven information processing makes SNNs can reduce the…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Changqing Xu , Yi Liu , Yintang Yang