English
Related papers

Related papers: CSI-JEPA: Towards Foundation Representations for U…

200 papers

Ultrasound (US) imaging poses unique challenges for representation learning due to its inherently noisy acquisition process. The low signal-to-noise ratio and stochastic speckle patterns hinder standard self-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ashwath Radhachandran , Vedrana Ivezić , Shreeram Athreya , Ronit Anilkumar , Corey W. Arnold , William Speier

This paper demonstrates an approach for learning highly semantic image representations without relying on hand-crafted data-augmentations. We introduce the Image-based Joint-Embedding Predictive Architecture (I-JEPA), a non-generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Mahmoud Assran , Quentin Duval , Ishan Misra , Piotr Bojanowski , Pascal Vincent , Michael Rabbat , Yann LeCun , Nicolas Ballas

Machine learning techniques have shown remarkable accuracy in localization tasks, but their dependency on vast amounts of labeled data, particularly Channel State Information (CSI) and corresponding coordinates, remains a bottleneck.…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Ankan Dash , Jingyi Gu , Guiling Wang , Nirwan Ansari

Because each indoor site has its own radio propagation characteristics, a site survey process is essential to optimize a Wi-Fi ranging strategy for range-based positioning solutions. This paper studies an unsupervised learning technique…

Networking and Internet Architecture · Computer Science 2020-07-14 Jeongsik Choi

World models require robust relational understanding to support prediction, reasoning, and control. While object-centric representations provide a useful abstraction, they are not sufficient to capture interaction-dependent dynamics. We…

Artificial Intelligence · Computer Science 2026-05-29 Heejeong Nam , Quentin Le Lidec , Lucas Maes , Yann LeCun , Randall Balestriero

Accurate channel state information (CSI) underpins reliable and efficient wireless communication. However, acquiring CSI via pilot estimation incurs substantial overhead, especially in massive multiple-input multiple-output (MIMO) systems…

Information Theory · Computer Science 2025-12-05 Guangming Liang , Mingjie Yang , Dongzhu Liu , Paul Henderson , Lajos Hanzo

Self-supervised learning has seen great success recently in unsupervised representation learning, enabling breakthroughs in natural language and image processing. However, these methods often rely on autoregressive and masked modeling,…

Machine Learning · Computer Science 2025-10-01 Sofiane Ennadir , Siavash Golkar , Leopoldo Sarra

Joint-Embedding Predictive Architectures (JEPAs) have recently emerged as a novel and powerful technique for self-supervised representation learning. They aim to learn an energy-based model by predicting the latent representation of a…

Machine Learning · Computer Science 2025-01-22 Geri Skenderi , Hang Li , Jiliang Tang , Marco Cristani

WiFi sensing has emerged as a compelling contactless modality for human activity monitoring by capturing fine-grained variations in Channel State Information (CSI). Its ability to operate continuously and non-intrusively while preserving…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Guozhen Zhu , Yuqian Hu , Weihang Gao , Wei-Hsiang Wang , Beibei Wang , K. J. Ray Liu

Learning efficient representations for decision-making policies is a challenge in imitation learning (IL). Current IL methods require expert demonstrations, which are expensive to collect. Additionally, they are not explicitly trained to…

Machine Learning · Computer Science 2026-03-19 Aleksandar Vujinovic , Aleksandar Kovacevic

Building upon the foundational work of the Bachelor's Degree Thesis titled "Analysis and Characterization of Wi-Fi Channel State Information'', this thesis significantly advances the research by conducting an in-depth analysis of CSIs,…

Networking and Internet Architecture · Computer Science 2024-11-06 Elena Tonini

Image-based Joint-Embedding Predictive Architecture (IJEPA) offers an attractive alternative to Masked Autoencoder (MAE) for representation learning using the Masked Image Modeling framework. IJEPA drives representations to capture useful…

Machine Learning · Computer Science 2024-10-15 Etai Littwin , Vimal Thilak , Anand Gopalakrishnan

Invariance-based and generative methods have shown a conspicuous performance for 3D self-supervised representation learning (SSRL). However, the former relies on hand-crafted data augmentations that introduce bias not universally applicable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Naiwen Hu , Haozhe Cheng , Yifan Xie , Shiqi Li , Jihua Zhu

The cornerstone of cognitive intelligence lies in extracting hidden patterns from observations and leveraging these principles to systematically predict future outcomes. However, current image tokenization methods demonstrate significant…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Junyeob Baek , Hosung Lee , Christopher Hoang , Mengye Ren , Sungjin Ahn

Recently, deep learning-enabled joint-source channel coding (JSCC) has received increasing attention due to its great success in image transmission. However, most existing JSCC studies only focus on single-input single-output (SISO)…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Guangyi Zhang , Qiyu Hu , Yunlong Cai , Guanding Yu

Joint Embedding Predictive Architectures (JEPA) have emerged as a powerful framework for learning general-purpose representations. However, these models often lack interpretability and suffer from inefficiencies due to dense embedding…

Machine Learning · Computer Science 2025-04-24 Max Hartman , Lav Varshney

Channel state information (CSI) is a fundamental component in both wireless communication and sensing systems, enabling critical functions such as radio resource optimization and environmental perception. In wireless sensing, data scarcity…

Machine Learning · Computer Science 2025-12-09 Zijian Zhao , Fanyi Meng , Zhonghao Lyu , Hang Li , Xiaoyang Li , Guangxu Zhu

We present EB-JEPA, an open-source library for learning representations and world models using Joint-Embedding Predictive Architectures (JEPAs). JEPAs learn to predict in representation space rather than pixel space, avoiding the pitfalls…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Basile Terver , Randall Balestriero , Megi Dervishi , David Fan , Quentin Garrido , Tushar Nagarajan , Koustuv Sinha , Wancong Zhang , Mike Rabbat , Yann LeCun , Amir Bar

In this paper, we consider people counting and localization systems exploiting channel state information (CSI) measured from commodity WiFi network interface cards (NICs). While CSI has useful information of amplitude and phase to describe…

Information Theory · Computer Science 2026-05-01 Jihoon Cha , Hwanjin Kim , Junil Choi

Channel prediction permits to acquire channel state information (CSI) without signaling overhead. However, almost all existing channel prediction methods necessitate the deployment of a dedicated model to accommodate a specific…

Signal Processing · Electrical Eng. & Systems 2025-03-20 Boxun Liu , Shijian Gao , Xuanyu Liu , Xiang Cheng , Liuqing Yang