English
Related papers

Related papers: A Latent Space Framework for Modeling Transient En…

200 papers

Building on the Joint-Embedding Predictive Architecture (JEPA) paradigm, a recent self-supervised learning framework that predicts latent representations of masked regions in high-level feature spaces, we propose Audio-JEPA (Audio…

Sound · Computer Science 2025-07-08 Ludovic Tuncay , Etienne Labbé , Emmanouil Benetos , Thomas Pellegrini

In remote control systems, transmitting large data volumes (e.g., images, video frames) from wireless sensors to remote controllers is challenging when uplink capacity is limited (e.g., RedCap devices or massive wireless sensor networks).…

Information Theory · Computer Science 2025-07-03 Abanoub M. Girgis , Alvaro Valcarce , Mehdi Bennis

This paper presents that the masked-modeling principle driving the success of large foundational vision models can be effectively applied to audio by making predictions in a latent space. We introduce Audio-based Joint-Embedding Predictive…

Sound · Computer Science 2024-01-12 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Emerging generative world models and vision-language-action (VLA) systems are rapidly reshaping automated driving by enabling scalable simulation, long-horizon forecasting, and capability-rich decision making. Across these directions,…

Robotics · Computer Science 2026-03-11 Rongxiang Zeng , Yongqi Dong

Learning manipulable representations of the world and its dynamics is central to AI. Joint-Embedding Predictive Architectures (JEPAs) offer a promising blueprint, but lack of practical guidance and theory has led to ad-hoc R&D. We present a…

Machine Learning · Computer Science 2025-11-17 Randall Balestriero , Yann LeCun

In this work, we introduce Mask-JEPA, a self-supervised learning framework tailored for mask classification architectures (MCA), to overcome the traditional constraints associated with training segmentation models. Mask-JEPA combines a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Dong-Hee Kim , Sungduk Cho , Hyeonwoo Cho , Chanmin Park , Jinyoung Kim , Won Hwa Kim

Joint-Embedding Predictive Architecture (JEPA) has emerged as a promising self-supervised approach that learns by leveraging a world model. While previously limited to predicting missing parts of an input, we explore how to generalize the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Quentin Garrido , Mahmoud Assran , Nicolas Ballas , Adrien Bardes , Laurent Najman , Yann LeCun

Learning efficient representations for decision-making policies is a challenge in imitation learning (IL). Current IL methods require expert demonstrations, which are expensive to collect. Additionally, they are not explicitly trained to…

Machine Learning · Computer Science 2026-03-19 Aleksandar Vujinovic , Aleksandar Kovacevic

Building deep learning models that can reason about their environment requires capturing its underlying dynamics. Joint-Embedded Predictive Architectures (JEPA) provide a promising framework to model such dynamics by learning…

Machine Learning · Computer Science 2026-01-06 Matthieu Destrade , Oumayma Bounou , Quentin Le Lidec , Jean Ponce , Yann LeCun

Motivated by the challenge of seamless cross-dataset transfer in EEG signal processing, this article presents an exploratory study on the use of Joint Embedding Predictive Architectures (JEPAs). In recent years, self-supervised learning has…

Machine Learning · Computer Science 2024-10-10 Pierre Guetschel , Thomas Moreau , Michael Tangermann

In this work, we propose a novel data-driven machine learning (ML) technique to model and predict the dynamics of the wireless propagation environment in latent space. Leveraging the idea of channel charting, which learns compressed…

Machine Learning · Computer Science 2024-09-17 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis

Image-based Joint-Embedding Predictive Architecture (IJEPA) offers an attractive alternative to Masked Autoencoder (MAE) for representation learning using the Masked Image Modeling framework. IJEPA drives representations to capture useful…

Machine Learning · Computer Science 2024-10-15 Etai Littwin , Vimal Thilak , Anand Gopalakrishnan

The representation of urban trajectory data plays a critical role in effectively analyzing spatial movement patterns. Despite considerable progress, the challenge of designing trajectory representations that can capture diverse and…

Machine Learning · Computer Science 2025-07-02 Lihuan Li , Hao Xue , Shuang Ao , Yang Song , Flora Salim

Current attempts of Reinforcement Learning for Autonomous Controller are data-demanding while the results are under-performed, unstable, and unable to grasp and anchor on the concept of safety, and over-concentrating on noise features due…

Robotics · Computer Science 2026-01-06 Tran Tien Dat , Nguyen Hai An , Nguyen Khanh Viet Dung , Nguyen Duy Duc

In wireless networked control systems, ensuring timely and reliable state updates from distributed devices to remote controllers is essential for robust control performance. However, when multiple devices transmit high-dimensional states…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Abanoub M. Girgis , Ibtissam Labriji , Mehdi Bennis

We propose WirelessJEPA, a novel wireless foundation model (WFM) that uses the Joint Embedding Predictive Architecture (JEPA). WirelessJEPA learns general-purpose representations directly from real-world multi-antenna IQ data by predicting…

Signal Processing · Electrical Eng. & Systems 2026-01-29 Viet Chu , Omar Mashaal , Hatem Abou-Zeid

We introduce VL-JEPA, a vision-language model built on a Joint Embedding Predictive Architecture (JEPA). Instead of autoregressively generating tokens as in classical VLMs, VL-JEPA predicts continuous embeddings of the target texts. By…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Delong Chen , Mustafa Shukor , Theo Moutakanni , Willy Chung , Jade Yu , Tejaswi Kasarla , Yejin Bang , Allen Bolourchi , Yann LeCun , Pascale Fung

Recent advances in self-supervised visual representation learning have demonstrated the effectiveness of predictive latent-space objectives for learning transferable features. In particular, Image-based Joint-Embedding Predictive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xiangteng He , Shunsuke Sakai , Shivam Chandhok , Sara Beery , Kun Yuan , Nicolas Padoy , Tatsuhito Hasegawa , Leonid Sigal

World models compress rich sensory streams into compact latent codes that anticipate future observations. We let separate agents acquire such models from distinct viewpoints of the same environment without any parameter sharing or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Haoran Zhang , Youjin Wang , Yi Duan , Rong Fu , Dianyu Zhao , Sicheng Fan , Shuaishuai Cao , Wentao Guo , Xiao Zhou

This paper explores the automated process of determining stem compatibility by identifying audio recordings of single instruments that blend well with a given musical context. To tackle this challenge, we present Stem-JEPA, a novel…

Sound · Computer Science 2024-08-06 Alain Riou , Stefan Lattner , Gaëtan Hadjeres , Michael Anslow , Geoffroy Peeters