English
Related papers

Related papers: The Radio-Frequency Transformer for Signal Separat…

200 papers

Source separation and other audio applications have traditionally relied on the use of short-time Fourier transforms as a front-end frequency domain representation step. The unavailability of a neural network equivalent to forward and…

Sound · Computer Science 2017-11-01 Shrikant Venkataramani , Jonah Casebeer , Paris Smaragdis

Balancing the trade-off between accuracy and robustness is a long-standing challenge in time series forecasting. While most of existing robust algorithms have achieved certain suboptimal performance on clean data, sustaining the same…

Machine Learning · Computer Science 2024-02-15 Romain Ilbert , Thai V. Hoang , Zonghua Zhang , Themis Palpanas

Utilizing transformer architectures for semantic segmentation of high-resolution images is hindered by the attention's quadratic computational complexity in the number of tokens. A solution to this challenge involves decreasing the number…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Daniel Kienzle , Marco Kantonis , Robin Schön , Rainer Lienhart

The fifth generation of wireless communications (5G) promises massive increases in traffic volume and data rates, as well as improved reliability in voice calls. Jointly optimizing beamforming, power control, and interference coordination…

Networking and Internet Architecture · Computer Science 2020-01-01 Faris B. Mismar , Brian L. Evans , Ahmed Alkhateeb

Considerable effort in experimental quantum computing is devoted to noisy intermediate scale quantum computers (NISQ computers). Understanding the effect of noise is important for various aspects of this endeavor including notable claims…

Quantum Physics · Physics 2024-04-02 Gil Kalai , Yosef Rinott , Tomer Shoham

We study the training of Vision Transformers for semi-supervised image classification. Transformers have recently demonstrated impressive performance on a multitude of supervised learning tasks. Surprisingly, we show Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Zejia Weng , Xitong Yang , Ang Li , Zuxuan Wu , Yu-Gang Jiang

It is challenging to precisely configure the phase shifts of the reflecting elements at the reconfigurable intelligent surface (RIS) due to inherent hardware impairments (HIs). In this paper, the mean square error (MSE) performance is…

Information Theory · Computer Science 2022-08-17 Jingwen Zhao , Ming Chen , Cunhua Pan , Zhiyang Li , Gui Zhou , Xiao Chen

Recently, a variety of acoustic tasks and related applications arised. For many acoustic tasks, the labeled data size may be limited. To handle this problem, we propose an unsupervised pre-training method using Transformer based encoder to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Ruixiong Zhang , Haiwei Wu , Wubo Li , Dongwei Jiang , Wei Zou , Xiangang Li

We present AttDet, a Transformer-inspired MIMO (Multiple Input Multiple Output) detection method that treats each transmit layer as a token and learns inter-stream interference via a lightweight self-attention mechanism. Queries and keys…

Signal Processing · Electrical Eng. & Systems 2025-10-24 András Rácz , Tamás Borsos , András Veres , Benedek Csala

In recent years, a number of works have studied methods for computing the Fourier transform in sublinear time if the output is sparse. Most of these have focused on the discrete setting, even though in many applications the input signal is…

Data Structures and Algorithms · Computer Science 2016-09-06 Eric Price , Zhao Song

Finite-rate-of-innovation (FRI) signals are ubiquitous in applications such as radar, ultrasound, and time of flight imaging. Due to their finite degrees of freedom, FRI signals can be sampled at sub-Nyquist rates using appropriate sampling…

Signal Processing · Electrical Eng. & Systems 2021-07-02 Satish Mulleti , Haiyang Zhang , Yonina C. Eldar

Image demoir\'eing remains a challenging task due to the complex interplay between texture corruption and color distortions caused by moir\'e patterns. Existing methods, especially those relying on direct image-to-image restoration, often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xiaoyang Liu , Bolin Qiu , Jiezhang Cao , Zheng Chen , Yulun Zhang , Xiaokang Yang

In recent years, rapid progress has been made on the problem of single-channel sound separation using supervised training of deep neural networks. In such supervised approaches, a model is trained to predict the component sources from…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Scott Wisdom , Efthymios Tzinis , Hakan Erdogan , Ron J. Weiss , Kevin Wilson , John R. Hershey

We consider the problem of robust deconvolution, and particularly the recovery of an unknown deterministic signal convolved with a known filter and corrupted by additive noise. We present a novel, non-iterative data-driven approach.…

Signal Processing · Electrical Eng. & Systems 2021-11-04 Amir Weiss , Boaz Nadler

Online audio source separation has been an important part of auditory scene analysis and robot audition. The main type of technique to carry this out, because of its online capabilities, has been spatial filtering (or beamforming), where it…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-21 Alejandro Maldonado , Caleb Rascon , Ivette Velez

In this paper, we address the intricate issue of RF signal separation by presenting a novel adaptation of the WaveNet architecture that introduces learnable dilation parameters, significantly enhancing signal separation in dense RF…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Yu Tian , Ahmed Alhammadi , Abdullah Quran , Abubakar Sani Ali

Wideband channel frequency response (CFR) estimation is challenging in multi-band wireless systems, especially when one or more sub-bands are temporarily blocked by co-channel interference. We present a physics-informed complex Transformer…

Networking and Internet Architecture · Computer Science 2026-04-03 Anatolij Zubow , Joana Angjo , Sigrid Dimce , Falko Dressler

Separating signals from an additive mixture may be an unnecessarily hard problem when one is only interested in specific properties of a given signal. In this work, we tackle simpler "statistical component separation" problems that focus on…

Machine Learning · Statistics 2024-03-01 Bruno Régaldo-Saint Blancard , Michael Eickenberg

We investigate quantization and feedback of channel state information in a multiuser (MU) multiple input multiple output (MIMO) system. Each user may receive multiple data streams. Our design minimizes the sum mean squared error (SMSE)…

Information Theory · Computer Science 2011-11-30 Muhammad Nazmul Islam , Raviraj Adve

Most codec designs rely on the mean squared error (MSE) as a fidelity metric in rate-distortion optimization, which allows to choose the optimal parameters in the transform domain but may fail to reflect perceptual quality. Alternative…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Samuel Fernández-Menduiña , Eduardo Pavez , Antonio Ortega