English
Related papers

Related papers: Learning Robust Representations for Communications…

200 papers

We investigate end-to-end optimized optical transmission systems based on feedforward or bidirectional recurrent neural networks (BRNN) and deep learning. In particular, we report the first experimental demonstration of a BRNN auto-encoder,…

Signal Processing · Electrical Eng. & Systems 2020-05-19 Boris Karanov , Mathieu Chagnon , Vahid Aref , Domanic Lavery , Polina Bayvel , Laurent Schmalen

Federated learning (FL) is a privacy-preserving machine learning setting that enables many devices to jointly train a shared global model without the need to reveal their data to a central server. However, FL involves a frequent exchange of…

Machine Learning · Computer Science 2021-10-07 Yuzhi Yang , Zhaoyang Zhang , Qianqian Yang

Building on recent advances in representation learning for wireless channels, this work investigates the cost-benefit trade-offs of high-dimensional channel embeddings in practical systems. We benchmark multiple wireless representations:…

Signal Processing · Electrical Eng. & Systems 2026-05-05 Murilo Batista , Shirin Salehi , Saeed Mashdour , Paul Zheng , Rodrigo C. de Lamare , Anke Schmeink

Recurrent neural networks (RNNs) are omnipresent in sequence modeling tasks. Practical models usually consist of several layers of hundreds or thousands of neurons which are fully connected. This places a heavy computational and memory…

Machine Learning · Computer Science 2019-05-30 Matthijs Van Keirsbilck , Alexander Keller , Xiaodong Yang

Network robustness is critical for various societal and industrial networks again malicious attacks. In particular, connectivity robustness and controllability robustness reflect how well a networked system can maintain its connectedness…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Yang Lou , Ruizi Wu , Junli Li , Lin Wang , Xiang Li , Guanrong Chen

Pre-trained convolutional neural networks (CNNs) are powerful off-the-shelf feature generators and have been shown to perform very well on a variety of tasks. Unfortunately, the generated features are high dimensional and expensive to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Saurabh Singh , Sami Abu-El-Haija , Nick Johnston , Johannes Ballé , Abhinav Shrivastava , George Toderici

Recurrent Neural networks (RNN) have shown promising potential for learning dynamics of sequential data. However, artificial neural networks are known to exhibit poor robustness in presence of input noise, where the sequential architecture…

Machine Learning · Computer Science 2021-05-05 Arash Amini , Guangyi Liu , Nader Motee

Spiking Neural Networks (SNNs) have recently gained significant interest in on-chip learning in embedded devices and emerged as an energy-efficient alternative to conventional Artificial Neural Networks (ANNs). However, to extend SNNs to a…

Machine Learning · Computer Science 2024-09-20 Manh V. Nguyen , Liang Zhao , Bobin Deng , William Severa , Honghui Xu , Shaoen Wu

Learning intents and slot labels from user utterances is a fundamental step in all spoken language understanding (SLU) and dialog systems. State-of-the-art neural network based methods, after deployment, often suffer from performance…

Computation and Language · Computer Science 2018-09-19 Avik Ray , Yilin Shen , Hongxia Jin

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

Recent studies have shown that Convolutional Neural Networks (CNNs) are vulnerable to a small perturbation of input called "adversarial examples". In this work, we propose a new feedforward CNN that improves robustness in the presence of…

Machine Learning · Computer Science 2016-02-26 Jonghoon Jin , Aysegul Dundar , Eugenio Culurciello

To enhance the reproducibility and reliability of deep learning models, we address a critical gap in current training methodologies: the lack of mechanisms that ensure consistent and robust performance across runs. Our empirical analysis…

Machine Learning · Computer Science 2026-01-05 Waqas Ahmed , Sheeba Samuel , Kevin Coakley , Birgitta Koenig-Ries , Odd Erik Gundersen

Reliably transmitting messages despite information loss due to a noisy channel is a core problem of information theory. One of the most important aspects of real world communication, e.g. via wifi, is that it may happen at varying levels of…

Machine Learning · Computer Science 2020-04-02 Karen Ullrich , Fabio Viola , Danilo Jimenez Rezende

End-to-end learning of communication systems enables joint optimization of transmitter and receiver, implemented as deep neural network-based autoencoders, over any type of channel and for an arbitrary performance metric. Recently, an…

Information Theory · Computer Science 2019-06-25 Mathieu Goutay , Fayçal Ait Aoudia , Jakob Hoydis

Designing channel codes under low-latency constraints is one of the most demanding requirements in 5G standards. However, a sharp characterization of the performance of traditional codes is available only in the large block-length limit.…

Signal Processing · Electrical Eng. & Systems 2020-07-27 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

Deep convolutional neural networks (CNNs) have been shown to perform extremely well at a variety of tasks including subtasks of autonomous driving such as image segmentation and object classification. However, networks designed for these…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Yiqi Hou , Sascha Hornauer , Karl Zipser

Many approaches to transform classification problems from non-linear to linear by feature transformation have been recently presented in the literature. These notably include sparse coding methods and deep neural networks. However, many of…

Machine Learning · Computer Science 2015-07-08 Alessandro Montalto , Giovanni Tessitore , Roberto Prevete

The convergence of communication and computation, along with the integration of machine learning and artificial intelligence, stand as key empowering pillars for the sixth-generation of communication systems (6G). This paper considers a…

Information Theory · Computer Science 2024-06-07 Robert-Jeron Reifert , Hayssam Dahrouj , Alaa Alameer Ahmad , Haris Gacanin , Aydin Sezgin

The complexity of deep neural network algorithms for hardware implementation can be lowered either by scaling the number of units or reducing the word-length of weights. Both approaches, however, can accompany the performance degradation…

Machine Learning · Computer Science 2016-11-22 Sungho Shin , Kyuyeon Hwang , Wonyong Sung

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert