中文
相关论文

相关论文: Learning to Communicate: Channel Auto-encoders, Do…

200 篇论文

We introduce a novel physical layer scheme for single user Multiple-Input Multiple-Output (MIMO) communications based on unsupervised deep learning using an autoencoder. This method extends prior work on the joint optimization of physical…

信息论 · 计算机科学 2017-07-26 Timothy J. O'Shea , Tugba Erpek , T. Charles Clancy

This work shows how to improve and interpret the commonly used dual encoder model for response suggestion in dialogue. We present an attentive dual encoder model that includes an attention mechanism on top of the extracted word-level…

计算与语言 · 计算机科学 2020-03-12 Yitong Li , Dianqi Li , Sushant Prakash , Peng Wang

Autoencoders can be challenged by spatially non-uniform sampling of image content. This is common in medical imaging, biology, and physics, where informative patterns occur rarely at specific image coordinates, as background dominates these…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Alejandro Castañeda Garcia , Jan van Gemert , Daan Brinks , Nergis Tömen

An autoencoder-based codec employs quantization to turn its bottleneck layer activation into bitstrings, a process that hinders information flow between the encoder and decoder parts. To circumvent this issue, we employ additional skip…

音频与语音处理 · 电气工程与系统科学 2021-07-26 Darius Petermann , Seungkwon Beack , Minje Kim

Nowadays, attention models are one of the popular candidates for speech recognition. So far, many studies mainly focus on the encoder structure or the attention module to enhance the performance of these models. However, mostly ignore the…

音频与语音处理 · 电气工程与系统科学 2020-10-29 Tobias Watzel , Ludwig Kürzinger , Lujun Li , Gerhard Rigoll

In distributed optimization and machine learning, multiple nodes coordinate to solve large problems. To do this, the nodes need to compress important algorithm information to bits so that it can be communicated over a digital channel. The…

最优化与控制 · 数学 2020-12-02 Sindri Magnússon , Hossein Shokri-Ghadikolaei , Na Li

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

信息论 · 计算机科学 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

Autoencoders provide a powerful framework for learning compressed representations by encoding all of the information needed to reconstruct a data point in a latent code. In some cases, autoencoders can "interpolate": By decoding the convex…

机器学习 · 计算机科学 2018-07-25 David Berthelot , Colin Raffel , Aurko Roy , Ian Goodfellow

Deep Learning has a wide application in the area of natural language processing and image processing due to its strong ability of generalization. In this paper, we propose a novel neural network structure for jointly optimizing the…

信号处理 · 电气工程与系统科学 2018-08-10 Banghua Zhu , Jintao Wang , Longzhuang He , Jian Song

Variational autoencoders learn unsupervised data representations, but these models frequently converge to minima that fail to preserve meaningful semantic information. For example, variational autoencoders with autoregressive decoders often…

机器学习 · 计算机科学 2019-05-21 Bryan Seybold , Emily Fertig , Alex Alemi , Ian Fischer

We propose to exploit {\em reconstruction} as a layer-local training signal for deep learning. Reconstructions can be propagated in a form of target propagation playing a role similar to back-propagation but helping to reduce the reliance…

机器学习 · 计算机科学 2014-09-19 Yoshua Bengio

The idea of end-to-end learning of communications systems through neural network -based autoencoders has the shortcoming that it requires a differentiable channel model. We present in this paper a novel learning algorithm which alleviates…

信息论 · 计算机科学 2018-12-06 Fayçal Ait Aoudia , Jakob Hoydis

We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Yunmei Chen , Chi Ding , Xiaojing Ye

Constituting highly informative network embeddings is an important tool for network analysis. It encodes network topology, along with other useful side information, into low-dimensional node-based feature representations that can be…

计算与语言 · 计算机科学 2019-06-06 Liqun Chen , Guoyin Wang , Chenyang Tao , Dinghan Shen , Pengyu Cheng , Xinyuan Zhang , Wenlin Wang , Yizhe Zhang , Lawrence Carin

In the context of cellular networks, users located at the periphery of cells are particularly vulnerable to substantial interference from neighbouring cells, which can be represented as a two-user interference channel. This study introduces…

信息论 · 计算机科学 2024-10-29 Shubham Paul , Sudharsan Senthil , Preethi Seshadri , Nambi Seshadri , R David Koilpillai

The point process is a solid framework to model sequential data, such as videos, by exploring the underlying relevance. As a challenging problem for high-level video understanding, weakly supervised action recognition and localization in…

计算机视觉与模式识别 · 计算机科学 2019-11-28 Xiao-Yu Zhang , Changsheng Li , Haichao Shi , Xiaobin Zhu , Peng Li , Jing Dong

Research in dolphin communication and cognition requires detailed inspection of audible dolphin signals. The manual analysis of these signals is cumbersome and time-consuming. We seek to automate parts of the analysis using modern deep…

音频与语音处理 · 电气工程与系统科学 2020-05-18 Daniel Kohlsdorf , Denise Herzing , Thad Starner

Recently, the Transformer model that is based solely on attention mechanisms, has advanced the state-of-the-art on various machine translation tasks. However, recent studies reveal that the lack of recurrence hinders its further improvement…

计算与语言 · 计算机科学 2019-04-08 Jie Hao , Xing Wang , Baosong Yang , Longyue Wang , Jinfeng Zhang , Zhaopeng Tu

This paper presents an innovative approach to enhancing machine learning based communication systems, specifically focusing on multiple-input multiple-output (MIMO) configurations using autoencoders. We optimize the transmitter, receiver,…

信号处理 · 电气工程与系统科学 2026-05-26 Mohammad Reza Ghavidel Aghdam , Alireza Naghavi

Due to the rapid development of autonomous driving, the Internet of Things and streaming services, modern communication systems have to cope with varying channel conditions and a steadily rising number of users and devices. This, and the…

信号处理 · 电气工程与系统科学 2022-09-16 Vincent Lauinger , Manuel Hoffmann , Jonas Ney , Norbert Wehn , Laurent Schmalen