English
Related papers

Related papers: SPA-MAE: A Physics-Guided CSI Foundation Model for…

200 papers

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Fully supervised skeleton-based action recognition has achieved great progress with the blooming of deep learning techniques. However, these methods require sufficient labeled data which is not easy to obtain. In contrast, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Wenhan Wu , Yilei Hua , Ce Zheng , Shiqian Wu , Chen Chen , Aidong Lu

Deep learning (DL), a branch of artificial intelligence (AI) techniques, has shown great promise in various disciplines such as image classification and segmentation, speech recognition, language translation, among others. This remarkable…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Wonjun Kim , Yongjun Ahn , Jinhong Kim , Byonghyo Shim

Large, pretrained models are commonly finetuned with imagery that is heavily augmented to mimic different conditions and scales, with the resulting models used for various tasks with imagery from a range of spatial scales. Such models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Colorado J. Reed , Ritwik Gupta , Shufan Li , Sarah Brockman , Christopher Funk , Brian Clipp , Kurt Keutzer , Salvatore Candido , Matt Uyttendaele , Trevor Darrell

The development of robust and generalisable models for encoding the spatio-temporal dynamics of human brain activity is crucial for advancing neuroscientific discoveries. However, significant individual variation in the organisation of the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Simon Dahan , Logan Z. J. Williams , Yourong Guo , Daniel Rueckert , Emma C. Robinson

For a complete comprehension of multi-person scenes, it is essential to go beyond basic tasks like detection and tracking. Higher-level tasks, such as understanding the interactions and social activities among individuals, are also crucial.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mahsa Ehsanpour , Ian Reid , Hamid Rezatofighi

Recent advancements in foundation models have significantly impacted various fields, including natural language processing, computer vision, and multi-modal tasks. One area that stands to benefit greatly is Earth observation, where these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Yohei Nakayama , Jiawei Su , Luis M. Pazos-Outón

Pre-training strategies based on self-supervised learning (SSL) have proven to be effective pretext tasks for many downstream tasks in computer vision. Due to the significant disparity between medical and natural images, the application of…

We introduce a self-supervised framework for learning predictive and structured representations of wireless channels by modeling the temporal evolution of channel state information (CSI) in a compact latent space. Our method casts the…

Signal Processing · Electrical Eng. & Systems 2026-03-23 Salmane Naoumi , Mehdi Bennis , Marwa Chafii

Accurate and effective channel state information (CSI) feedback is a key technology for massive multiple-input and multiple-output systems. Recently, deep learning (DL) has been introduced for CSI feedback enhancement through massive…

Signal Processing · Electrical Eng. & Systems 2023-10-26 Han Xiao , Wenqiang Tian , Wendong Liu , Jiajia Guo , Zhi Zhang , Shi Jin , Zhihua Shi , Li Guo , Jia Shen

Intelligent communication is gradually considered as the mainstream direction in future wireless communications. As a major branch of machine learning, deep learning (DL) has been applied in physical layer communications and has…

Information Theory · Computer Science 2019-02-26 Hengtao He , Shi Jin , Chao-Kai Wen , Feifei Gao , Geoffrey Ye Li , Zongben Xu

Integrating AI into the physical layer is a cornerstone of 6G networks. However, current data-driven approaches struggle to generalize across dynamic environments because they lack an intrinsic understanding of electromagnetic wave…

Networking and Internet Architecture · Computer Science 2026-03-27 Ziqi Chen , Yi Ren , Yixuan Huang , Qi Sun , Nan Li , Yuhong Huang , Chih-Lin I , Yifan Li , Liang Xia

To support future intelligent multifunctional sixth-generation (6G) wireless communication networks, Synesthesia of Machines (SoM) is proposed as a novel paradigm for artificial intelligence (AI)-native intelligent multi-modal…

Signal Processing · Electrical Eng. & Systems 2025-06-10 Xiang Cheng , Boxun Liu , Xuanyu Liu , Ensong Liu , Ziwei Huang

Infrared imaging plays a critical role in low-light and adverse weather conditions. However, due to the distinct characteristics of infrared images, existing foundation models such as Masked Autoencoder (MAE) trained on visible data perform…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Yinghui Xing , Xiaoting Su , Shizhou Zhang , Donghao Chu , Di Xu

Future wireless systems increasingly require predictive and transferable representations that can support multiple physical-layer (PHY) tasks under dynamic environments. However, most existing supervised learning-based methods are designed…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Can Zheng , Jiguang He , Guofa Cai , Nannan Li , Mehdi Bennis , Henk Wymeersch , Merouane Debbah

In this work, we propose a novel data-driven machine learning (ML) technique to model and predict the dynamics of the wireless propagation environment in latent space. Leveraging the idea of channel charting, which learns compressed…

Machine Learning · Computer Science 2024-09-17 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis

Deep learning (DL) has revolutionized wireless communication systems by introducing datadriven end-to-end (E2E) learning, where the physical layer (PHY) is transformed into DL architectures to achieve peak optimization. Leveraging DL for…

Networking and Internet Architecture · Computer Science 2024-11-12 Nazmul Islam , Seokjoo Shin

Unsupervised pre-training methods for large vision models have shown to enhance performance on downstream supervised tasks. Developing similar techniques for satellite imagery presents significant opportunities as unlabelled data is…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yezhen Cong , Samar Khanna , Chenlin Meng , Patrick Liu , Erik Rozi , Yutong He , Marshall Burke , David B. Lobell , Stefano Ermon

Reconfigurable intelligent surfaces (RIS) have emerged as a promising technology for enhancing wireless communication by dynamically controlling signal propagation in the environment. However, their efficient deployment relies on accurate…

Signal Processing · Electrical Eng. & Systems 2025-06-12 Mohammad Ghassemi , Sara Farrag Mobarak , Han Zhang , Ali Afana , Akram Bin Sediq , Melike Erol-Kantarci

Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and…

Machine Learning · Computer Science 2026-03-17 Vlad Medvedev , Leon Armbruster , Christopher Straub , Georg Kruse , Andreas Rosskopf