English
Related papers

Related papers: JEPA-MSAC: A Joint-Embedding Predictive Architectu…

200 papers

In this work, we aim to optimize the radio resource management of a communication system between a remote controller and its device, whose state is represented through image frames, without compromising the performance of the control task.…

Machine Learning · Computer Science 2025-06-23 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis

Motivated by the challenge of seamless cross-dataset transfer in EEG signal processing, this article presents an exploratory study on the use of Joint Embedding Predictive Architectures (JEPAs). In recent years, self-supervised learning has…

Machine Learning · Computer Science 2024-10-10 Pierre Guetschel , Thomas Moreau , Michael Tangermann

In remote control systems, transmitting large data volumes (e.g., images, video frames) from wireless sensors to remote controllers is challenging when uplink capacity is limited (e.g., RedCap devices or massive wireless sensor networks).…

Information Theory · Computer Science 2025-07-03 Abanoub M. Girgis , Alvaro Valcarce , Mehdi Bennis

Channel state information (CSI) provides a widely available sensing modality for human and environment perception, but existing CSI sensing models usually rely on task-specific supervised training and require substantial labeled data for…

Machine Learning · Computer Science 2026-05-15 Xuanhao Luo , Zhizhen Li , Yuchen Liu

We present EB-JEPA, an open-source library for learning representations and world models using Joint-Embedding Predictive Architectures (JEPAs). JEPAs learn to predict in representation space rather than pixel space, avoiding the pitfalls…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Basile Terver , Randall Balestriero , Megi Dervishi , David Fan , Quentin Garrido , Tushar Nagarajan , Koustuv Sinha , Wancong Zhang , Mike Rabbat , Yann LeCun , Amir Bar

Integrated sensing and communication (ISAC) is a key enabler for low-altitude wireless networks (LAWNs), providing simultaneous environmental perception and data transmission in complex aerial scenarios. By combining heterogeneous sensing…

Signal Processing · Electrical Eng. & Systems 2025-12-02 Kai Zhang , Wentao Yu , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

This paper addresses the problem of self-supervised general-purpose audio representation learning. We explore the use of Joint-Embedding Predictive Architectures (JEPA) for this task, which consists of splitting an input mel-spectrogram…

Sound · Computer Science 2024-05-15 Alain Riou , Stefan Lattner , Gaëtan Hadjeres , Geoffroy Peeters

Learning efficient representations for decision-making policies is a challenge in imitation learning (IL). Current IL methods require expert demonstrations, which are expensive to collect. Additionally, they are not explicitly trained to…

Machine Learning · Computer Science 2026-03-19 Aleksandar Vujinovic , Aleksandar Kovacevic

This paper demonstrates an approach for learning highly semantic image representations without relying on hand-crafted data-augmentations. We introduce the Image-based Joint-Embedding Predictive Architecture (I-JEPA), a non-generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Mahmoud Assran , Quentin Duval , Ishan Misra , Piotr Bojanowski , Pascal Vincent , Michael Rabbat , Yann LeCun , Nicolas Ballas

Multivariate time series underpin modern critical infrastructure, making the prediction of anomalies a vital necessity for proactive risk mitigation. While Joint-Embedding Predictive Architectures (JEPA) offer a promising framework for…

Machine Learning · Computer Science 2026-02-05 Yanan He , Yunshi Wen , Xin Wang , Tengfei Ma

We introduce a two-stage self-supervised framework that combines the Joint-Embedding Predictive Architecture (JEPA) with a Density Adaptive Attention Mechanism (DAAM) for learning robust speech representations. Stage~1 uses JEPA with DAAM…

Joint-Embedding Predictive Architectures (JEPAs) provide a simpleframework for learning world models by predicting future latent representations.However, JEPA training is subject to a bias-variance tradeoff.Without sufficient structural…

Machine Learning · Computer Science 2026-05-12 Kai Zhao , Dongliang Nie , Yuchen Lin , Zhehan Luo , Yixiao Gu , Deng-Ping Fan , Dan Zeng

Integrated sensing and communication (ISAC) systems operating at terahertz (THz) bands are envisioned to enable both ultra-high data-rate communication and precise environmental awareness for next-generation wireless networks. However, the…

Signal Processing · Electrical Eng. & Systems 2025-05-06 Kai Zhang , Wentao Yu , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Self-Supervised Learning (SSL) has shifted from pixel-level reconstruction to latent space prediction, spearheaded by the Joint Embedding Predictive Architecture (JEPA). While effective, standard JEPA models typically rely on a…

Machine Learning · Computer Science 2026-03-03 Yongchao Huang

Joint Embedding Predictive Architectures (JEPA) offer a scalable paradigm for self-supervised learning by predicting latent representations rather than reconstructing high-entropy observations. However, existing formulations rely on…

Machine Learning · Computer Science 2026-01-22 Yongchao Huang

Integrated Sensing and Communications (ISAC) will become a service in future mobile communication networks. It enables the detection and recognition of passive objects and environments using radar-like sensing. The ultimate advantage is the…

World models for partially observed environments must imagine multiple compatible hidden futures and steer between them under counterfactual actions. Joint Embedding Predictive Architectures (JEPAs) do this in latent space, but a…

Machine Learning · Computer Science 2026-05-26 Santosh Kumar Radha , Oktay Goktas

Joint-Embedding Predictive Architecture (JEPA) has emerged as a promising self-supervised approach that learns by leveraging a world model. While previously limited to predicting missing parts of an input, we explore how to generalize the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Quentin Garrido , Mahmoud Assran , Nicolas Ballas , Adrien Bardes , Laurent Najman , Yann LeCun

Integrated sensing and communication (ISAC) aims to unify radar and communication systems through a combination of joint hardware, joint waveforms, joint signal design, and joint signal processing. At high carrier frequencies, where ISAC is…

Signal Processing · Electrical Eng. & Systems 2021-11-04 José Miguel Mateos-Ramos , Jinxiang Song , Yibo Wu , Christian Häger , Musa Furkan Keskin , Vijaya Yajnanarayana , Henk Wymeersch

Robotic imitation learning is often treated as reproducing demonstrated actions, but actions are inherently embodiment-specific. When demonstrations come from humans or robots with different morphology, kinematics, or action spaces, this…

Robotics · Computer Science 2026-05-21 Jingyang He , Guangrun Li , Jieyu Zhang , Chengkai Hou , Zhengping Che , Shanghang Zhang