English
Related papers

Related papers: Neural Turbo Equalization: Deep Learning for Fiber…

200 papers

Deep neural networks (DNNs) are often coupled with physics-based models or data-driven surrogate models to perform fault detection and health monitoring of systems in the low data regime. These models serve as digital twins to generate…

Machine Learning · Computer Science 2023-03-21 Laya Das , Blazhe Gjorgiev , Giovanni Sansavini

Deep Neural Networks (DNNs) have demonstrated remarkable performance across various domains, including computer vision and natural language processing. However, they often struggle to accurately quantify the uncertainty of their…

Machine Learning · Computer Science 2025-11-14 Adrien Lafage , Olivier Laurent , Firas Gabetni , Gianni Franchi

This work considers a challenging Deep Neural Network(DNN) quantization task that seeks to train quantized DNNs without involving any full-precision operations. Most previous quantization approaches are not applicable to this task since…

Neural and Evolutionary Computing · Computer Science 2022-05-24 Fu Peng , Shengcai Liu , Ning Lu , Ke Tang

The superior performance of Deep Neural Networks (DNNs) has led to their application in various aspects of human life. Safety-critical applications are no exception and impose rigorous reliability requirements on DNNs. Quantized Neural…

Machine Learning · Computer Science 2023-06-19 Mohammad Hasan Ahmadilivani , Mahdi Taheri , Jaan Raik , Masoud Daneshtalab , Maksim Jenihhin

A neural-network-based approach is presented to efficiently implement digital backpropagation (DBP). For a 32x100 km fiber-optic link, the resulting "learned" DBP significantly reduces the complexity compared to conventional DBP…

Information Theory · Computer Science 2017-10-18 Christian Häger , Henry D. Pfister

We propose a novel {\it Equilibrated Recurrent Neural Network} (ERNN) to combat the issues of inaccuracy and instability in conventional RNNs. Drawing upon the concept of autapse in neuroscience, we propose augmenting an RNN with a…

Machine Learning · Computer Science 2019-03-05 Ziming Zhang , Anil Kag , Alan Sullivan , Venkatesh Saligrama

The recently discovered Neural collapse (NC) phenomenon states that the last-layer weights of Deep Neural Networks (DNN), converge to the so-called Equiangular Tight Frame (ETF) simplex, at the terminal phase of their training. This ETF…

Machine Learning · Computer Science 2024-03-01 Hafiz Tiomoko Ali , Umberto Michieli , Ji Joong Moon , Daehyun Kim , Mete Ozay

In the past years, artificial neural networks (ANNs) have become the de-facto standard to solve tasks in communications engineering that are difficult to solve with traditional methods. In parallel, the artificial intelligence community…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Eike-Manuel Bansbach , Alexander von Bank , Laurent Schmalen

The prediction accuracy of the deep neural networks (DNNs) after deployment at the edge can suffer with time due to shifts in the distribution of the new data. To improve robustness of DNNs, they must be able to update themselves to enhance…

Machine Learning · Computer Science 2022-03-23 Kshitij Bhardwaj , James Diffenderfer , Bhavya Kailkhura , Maya Gokhale

Hardware accelerations of deep learning systems have been extensively investigated in industry and academia. The aim of this paper is to achieve ultra-high energy efficiency and performance for hardware implementations of deep neural…

Machine Learning · Computer Science 2018-02-20 Yanzhi Wang , Caiwen Ding , Zhe Li , Geng Yuan , Siyu Liao , Xiaolong Ma , Bo Yuan , Xuehai Qian , Jian Tang , Qinru Qiu , Xue Lin

In this paper, we present a topology optimization (TO) framework to simultaneously optimize the matrix topology and fiber distribution of functionally graded continuous fiber-reinforced composites (FRC). Current approaches in density-based…

Computational Engineering, Finance, and Science · Computer Science 2022-05-16 Aaditya Chandrasekhar , Amir Mirzendehdel , Morad Behandish , Krishnan Suresh

This paper proposes to use graph neural networks (GNNs) for equalization, that can also be used to perform joint equalization and decoding (JED). For equalization, the GNN is build upon the factor graph representations of the channel, while…

Information Theory · Computer Science 2024-01-30 Jannis Clausius , Marvin Geiselhart , Daniel Tandler , Stephan ten Brink

In this paper, we present a novel Deep Triphone Embedding (DTE) representation derived from Deep Neural Network (DNN) to encapsulate the discriminative information present in the adjoining speech frames. DTEs are generated using a four…

Sound · Computer Science 2017-10-25 Mohit Yadav , Vivek Tyagi

Deep neural networks (DNNs) have demonstrated their great potential in recent years, exceeding the per-formance of human experts in a wide range of applications. Due to their large sizes, however, compressiontechniques such as weight…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Wentao Chen , Hailong Qiu , Jian Zhuang , Chutong Zhang , Yu Hu , Qing Lu , Tianchen Wang , Yiyu Shi , Meiping Huang , Xiaowe Xu

The deep layers of modern neural networks extract a rather rich set of features as an input propagates through the network. This paper sets out to harvest these rich intermediate representations for quantization with minimal accuracy loss…

Machine Learning · Computer Science 2020-03-04 Ahmed T. Elthakeb , Prannoy Pilligundla , Alex Cloninger , Hadi Esmaeilzadeh

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Deep Neural Networks (DNNs) have been successfully implemented across various signal processing fields, resulting in significant enhancements in performance. However, DNNs generally require substantial computational resources, leading to…

Signal Processing · Electrical Eng. & Systems 2024-07-09 Shuai Wang , Dehao Zhang , Ammar Belatreche , Yichen Xiao , Hongyu Qing , Wenjie We , Malu Zhang , Yang Yang

Deep neural networks (DNNs) trained with the logistic loss (i.e., the cross entropy loss) have made impressive advancements in various binary classification tasks. However, generalization analysis for binary classification with DNNs and…

Machine Learning · Statistics 2024-04-23 Zihan Zhang , Lei Shi , Ding-Xuan Zhou

Machine learning techniques often lack formal correctness guarantees, evidenced by the widespread adversarial examples that plague most deep-learning applications. This lack of formal guarantees resulted in several research efforts that aim…

Machine Learning · Computer Science 2024-06-11 Anahita Baninajjar , Ahmed Rezine , Amir Aminifar

Distant speech recognition is a challenge, particularly due to the corruption of speech signals by reverberation caused by large distances between the speaker and microphone. In order to cope with a wide range of reverberations in…

Computation and Language · Computer Science 2016-08-18 Jeehye Lee , Myungin Lee , Joon-Hyuk Chang