English
Related papers

Related papers: Radio Foundation Models: Pre-training Transformers…

200 papers

Federated Learning (FL) is a distributed learning paradigm that preserves privacy by eliminating the need to exchange raw data during training. In its prototypical edge instantiation with underlying wireless transmissions enabled by analog…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Haifeng Wen , Kaishun Wu , Hong Xing

Agents trained with deep reinforcement learning algorithms are capable of performing highly complex tasks including locomotion in continuous environments. We investigate transferring the learning acquired in one task to a set of previously…

Machine Learning · Computer Science 2024-03-06 Suzan Ece Ada , Emre Ugur , H. Levent Akin

Indoor localization is of particular interest due to its immense practical applications. However, the rich multipath and high penetration loss of indoor wireless signal propagation make this task arduous. Though recently studied…

Signal Processing · Electrical Eng. & Systems 2019-08-07 Guojun Xiong , Taejoon Kim , Erik Perrins

Following its success for vision and text, the "foundation model" (FM) paradigm -- pretraining large models on massive data, then fine-tuning on target tasks -- has rapidly expanded to domains in the sciences, engineering, healthcare, and…

Machine Learning · Computer Science 2025-03-24 Zongzhe Xu , Ritvik Gupta , Wenduo Cheng , Alexander Shen , Junhong Shen , Ameet Talwalkar , Mikhail Khodak

This work introduces DeepCRF, a deep learning framework designed for channel state information-based radio frequency fingerprinting (CSI-RFF). The considered CSI-RFF is built on micro-CSI, a recently discovered radio-frequency (RF)…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Ruiqi Kong , He Chen

Cellular traffic prediction is of great importance on the path of enabling 5G mobile networks to perform intelligent and efficient infrastructure planning and management. However, available data are limited to base station logging…

Machine Learning · Computer Science 2023-08-29 Vasileios Perifanis , Nikolaos Pavlidis , Remous-Aris Koutsiamanis , Pavlos S. Efraimidis

An efficient data-driven prediction strategy for multi-antenna frequency-selective channels must operate based on a small number of pilot symbols. This paper proposes novel channel prediction algorithms that address this goal by integrating…

Signal Processing · Electrical Eng. & Systems 2022-03-25 Sangwoo Park , Osvaldo Simeone

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

Machine Learning · Computer Science 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta

Hardware imperfections in RF transmitters introduce features that can be used to identify a specific transmitter amongst others. Supervised deep learning has shown good performance in this task but using datasets not applicable to real…

Signal Processing · Electrical Eng. & Systems 2019-05-21 Cyrille Morin , Leonardo Cardoso , Jakob Hoydis , Jean-Marie Gorce , Thibaud Vial

Foundation deep learning (DL) models are general models, designed to learn general, robust and adaptable representations of their target modality, enabling finetuning across a range of downstream tasks. These models are pretrained on large,…

Signal Processing · Electrical Eng. & Systems 2024-11-18 Ahmed Aboulfotouh , Ashkan Eshaghbeigi , Hatem Abou-Zeid

Most artificial intelligence (AI) research have concentrated in high-income countries, where imaging data, IT infrastructures and clinical expertise are plentiful. However, slower progress has been made in limited-resource environments…

Recent progress on vision-language foundation models have brought significant advancement to building general-purpose robots. By using the pre-trained models to encode the scene and instructions as inputs for decision making, the…

Machine Learning · Computer Science 2023-03-22 Yuying Ge , Annabella Macaluso , Li Erran Li , Ping Luo , Xiaolong Wang

The successful training of deep neural networks requires addressing challenges such as overfitting, numerical instabilities leading to divergence, and increasing variance in the residual stream. A common solution is to apply regularization…

Machine Learning · Computer Science 2025-11-20 Jörg K. H. Franke , Urs Spiegelhalter , Marianna Nezhurina , Jenia Jitsev , Frank Hutter , Michael Hefenbrock

We propose a supervised learning algorithm for machine learning applications. Contrary to the model developing in the classical methods, which treat training, validation, and test as separate steps, in the presented approach, there is a…

Machine Learning · Computer Science 2019-09-24 Soheil Mehrabkhani

In this article, we present an intelligent framework for 5G new radio (NR) indoor positioning under a monostatic configuration. The primary objective is to estimate both the angle of arrival and time of arrival simultaneously. This requires…

Signal Processing · Electrical Eng. & Systems 2024-12-12 Shengheng Liu , Hao Wang , Mengguan Pan , Peng Liu , Yahui Ma , Yongming Huang

The short-time Fourier transform (STFT) is widely used for analyzing non-stationary signals. However, its performance is highly sensitive to its parameters, and manual or heuristic tuning often yields suboptimal results. To overcome this…

Sound · Computer Science 2025-06-27 Maxime Leiber , Yosra Marnissi , Axel Barrau , Sylvain Meignen , Laurent Massoulié

Communication is fundamental for multi-robot collaboration, with accurate radio mapping playing a crucial role in predicting signal strength between robots. However, modeling radio signal propagation in large and occluded environments is…

Robotics · Computer Science 2025-04-22 Yiming Luo , Yunfei Wang , Hongming Chen , Chengkai Wu , Ximin Lyu , Jinni Zhou , Jun Ma , Fu Zhang , Boyu Zhou

The use of transfer learning (TL) techniques has become common practice in fields such as computer vision (CV) and natural language processing (NLP). Leveraging prior knowledge gained from data with different distributions, TL offers higher…

Signal Processing · Electrical Eng. & Systems 2022-06-17 Lauren J. Wong , Sean McPherson , Alan J. Michaels

We present the Graph Forward-Forward (GFF) algorithm, an extension of the Forward-Forward procedure to graphs, able to handle features distributed over a graph's nodes. This allows training graph neural networks with forward passes only,…

Machine Learning · Computer Science 2023-02-13 Daniele Paliotta , Mathieu Alain , Bálint Máté , François Fleuret

Radio frequency interference (RFI) detection and excision are key steps in the data-processing pipeline of the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Because of its high sensitivity and large data rate, FAST requires…

Instrumentation and Methods for Astrophysics · Physics 2020-06-14 Zhicheng Yang , Ce Yu , Jian Xiao , Bo Zhang