中文
相关论文

相关论文: Unveiling the Power of Complex-Valued Transformers…

200 篇论文

This work deals with the use of emerging deep learning techniques in future wireless communication networks. It will be shown that data-driven approaches should not replace, but rather complement traditional design techniques based on…

信号处理 · 电气工程与系统科学 2019-06-14 Alessio Zappone , Marco Di Renzo , Mérouane Debbah

A complex-valued convolutional network (convnet) implements the repeated application of the following composition of three operations, recursively applying the composition to an input vector of nonnegative real numbers: (1) convolution with…

机器学习 · 计算机科学 2016-05-04 Joan Bruna , Soumith Chintala , Yann LeCun , Serkan Piantino , Arthur Szlam , Mark Tygert

In recent years, with the rapid enhancement of computing power, deep learning methods have been widely applied in wireless networks and achieved impressive performance. To effectively exploit the information of graph-structured data as well…

信息论 · 计算机科学 2021-11-19 S. He , S. Xiong , Y. Ou , J. Zhang , J. Wang , Y. Huang , Y. Zhang

In this work we propose CVKAN, a complex-valued Kolmogorov-Arnold Network (KAN), to join the intrinsic interpretability of KANs and the advantages of Complex-Valued Neural Networks (CVNNs). We show how to transfer a KAN and the necessary…

机器学习 · 计算机科学 2025-12-01 Matthias Wolff , Florian Eilers , Xiaoyi Jiang

The growing number of devices using the wireless spectrum makes it important to find ways to minimize interference and optimize the use of the spectrum. Deep learning models, such as convolutional neural networks (CNNs), have been widely…

信号处理 · 电气工程与系统科学 2023-09-14 Taiwo Oyedare , Vijay K. Shah , Daniel J. Jakubisin , Jeffrey H. Reed

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

机器学习 · 计算机科学 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

This study proposes a fully convolutional network (FCN) model for raw waveform-based speech enhancement. The proposed system performs speech enhancement in an end-to-end (i.e., waveform-in and waveform-out) manner, which dif-fers from most…

机器学习 · 统计学 2017-06-16 Szu-Wei Fu , Yu Tsao , Xugang Lu , Hisashi Kawai

Reconstructing the room transfer functions needed to calculate the complex sound field in a room has several important real-world applications. However, an unpractical number of microphones is often required. Recently, in addition to…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Francesca Ronchini , Luca Comanducci , Mirco Pezzoli , Fabio Antonacci , Augusto Sarti

Existing communication systems exhibit inherent limitations in translating theory to practice when handling the complexity of optimization for emerging wireless applications with high degrees of freedom. Deep learning has a strong potential…

网络与互联网体系结构 · 计算机科学 2020-05-14 Tugba Erpek , Timothy J. O'Shea , Yalin E. Sagduyu , Yi Shi , T. Charles Clancy

Most deep learning pipelines are built on real-valued operations to deal with real-valued inputs such as images, speech or music signals. However, a lot of applications naturally make use of complex-valued signals or images, such as MRI or…

机器学习 · 计算机科学 2023-06-19 Florian Eilers , Xiaoyi Jiang

Convolutional neural networks (CNNs) are a standard component of many current state-of-the-art Large Vocabulary Continuous Speech Recognition (LVCSR) systems. However, CNNs in LVCSR have not kept pace with recent advances in other domains…

计算与语言 · 计算机科学 2016-01-26 Tom Sercu , Christian Puhrsch , Brian Kingsbury , Yann LeCun

Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong representation capabilities, researchers are looking at ways to…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Kai Han , Yunhe Wang , Hanting Chen , Xinghao Chen , Jianyuan Guo , Zhenhua Liu , Yehui Tang , An Xiao , Chunjing Xu , Yixing Xu , Zhaohui Yang , Yiman Zhang , Dacheng Tao

Deep learning models like Transformers and Convolutional Neural Networks (CNNs) have revolutionized various domains, but their parameter-intensive nature hampers deployment in resource-constrained settings. In this paper, we introduce a…

机器学习 · 计算机科学 2024-01-31 Onur Can Koyun , Behçet Uğur Töreyin

Recently, deep learning (DL) has been emerging as a promising approach for channel estimation and signal detection in wireless communications. The majority of the existing studies investigating the use of DL techniques in this domain focus…

网络与互联网体系结构 · 计算机科学 2024-04-04 Khalid Albagami , Nguyen Van Huynh , Geoffrey Ye Li

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript, we describe a custom DNN specially designed to solve problems in the RF…

信号处理 · 电气工程与系统科学 2021-09-23 Brian Shevitski , Yijing Watkins , Nicole Man , Michael Girard

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

机器学习 · 计算机科学 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

Transformer-based models have transformed the landscape of natural language processing (NLP) and are increasingly applied to computer vision tasks with remarkable success. These models, renowned for their ability to capture long-range…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Gracile Astlin Pereira , Muhammad Hussain

Speech dereverberation is an important stage in many speech technology applications. Recent work in this area has been dominated by deep neural network models. Temporal convolutional networks (TCNs) are deep learning models that have been…

声音 · 计算机科学 2022-07-26 William Ravenscroft , Stefan Goetze , Thomas Hain

Complex-valued neural networks are not a new concept, however, the use of real-valued models has often been favoured over complex-valued models due to difficulties in training and performance. When comparing real-valued versus…

机器学习 · 计算机科学 2018-11-30 Nils Mönning , Suresh Manandhar

Neural networks in the real domain have been studied for a long time and achieved promising results in many vision tasks for recent years. However, the extensions of the neural network models in other number fields and their potential…

计算机视觉与模式识别 · 计算机科学 2019-03-05 Xuanyu Zhu , Yi Xu , Hongteng Xu , Changjian Chen