English
Related papers

Related papers: LeWorldModel: Stable End-to-End Joint-Embedding Pr…

200 papers

In recent advancements in unsupervised visual representation learning, the Joint-Embedding Predictive Architecture (JEPA) has emerged as a significant method for extracting visual features from unlabeled imagery through an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Shentong Mo , Shengbang Tong

Joint-Embedding Predictive Architectures (JEPA) are a promising framework for self-supervised video representation learning, yet the behavior of auxiliary objectives in small-scale Video-JEPA training is not well characterized. We report a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Santosh Premi

Self-supervised learning has emerged as a powerful paradigm for learning visual representations without manual annotations, yet most methods still operate on a single modality and therefore miss the complementary structure available from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Ciem Cornelissen , Sam Leroux , Pieter Simoens

Building deep learning models that can reason about their environment requires capturing its underlying dynamics. Joint-Embedded Predictive Architectures (JEPA) provide a promising framework to model such dynamics by learning…

Machine Learning · Computer Science 2026-01-06 Matthieu Destrade , Oumayma Bounou , Quentin Le Lidec , Jean Ponce , Yann LeCun

In wireless networked control systems, ensuring timely and reliable state updates from distributed devices to remote controllers is essential for robust control performance. However, when multiple devices transmit high-dimensional states…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Abanoub M. Girgis , Ibtissam Labriji , Mehdi Bennis

Pretraining Vision-Language-Action (VLA) policies on internet-scale video is appealing, yet current latent-action objectives often learn the wrong thing: they remain anchored to pixel variation rather than action-relevant state transitions,…

Robotics · Computer Science 2026-02-17 Jingwen Sun , Wenyao Zhang , Zekun Qi , Shaojie Ren , Zezhi Liu , Hanxin Zhu , Guangzhong Sun , Xin Jin , Zhibo Chen

The rapid expansion of remote sensing image archives demands the development of strong and efficient techniques for content-based image retrieval (RS-CBIR). This paper presents REJEPA (Retrieval with Joint-Embedding Predictive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Shabnam Choudhury , Yash Salunkhe , Sarthak Mehrotra , Biplab Banerjee

This paper addresses the problem of self-supervised general-purpose audio representation learning. We explore the use of Joint-Embedding Predictive Architectures (JEPA) for this task, which consists of splitting an input mel-spectrogram…

Sound · Computer Science 2024-05-15 Alain Riou , Stefan Lattner , Gaëtan Hadjeres , Geoffroy Peeters

This paper presents that the masked-modeling principle driving the success of large foundational vision models can be effectively applied to audio by making predictions in a latent space. We introduce Audio-based Joint-Embedding Predictive…

Sound · Computer Science 2024-01-12 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Future wireless systems increasingly require predictive and transferable representations that can support multiple physical-layer (PHY) tasks under dynamic environments. However, most existing supervised learning-based methods are designed…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Can Zheng , Jiguang He , Guofa Cai , Nannan Li , Mehdi Bennis , Henk Wymeersch , Merouane Debbah

Electroencephalography (EEG) is a widely used tool for studying brain function, with applications in clinical neuroscience, diagnosis, and brain-computer interfaces (BCIs). Recent EEG foundation models trained on large unlabeled corpora aim…

Machine Learning · Computer Science 2026-05-08 Saarang Panchavati , Uddhav Panchavati , Hiroki Nariai , Corey Arnold , William Speier

Learning predictive world models from unlabelled video is a foundational challenge in artificial intelligence. While Joint Embedding Predictive Architectures (JEPA) have set new benchmarks in semantic classification, they often remain…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Santosh Kumar Paidi

World model-based policy evaluation is a practical proxy for testing real-world robot control by rolling out candidate actions in action-conditioned video diffusion models. As these models increasingly adopt latent diffusion modeling (LDM),…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Nilaksh , Saurav Jha , Artem Zholus , Sarath Chandar

Recently, self-supervised representation learning relying on vast amounts of unlabeled data has been explored as a pre-training method for autonomous driving. However, directly applying popular contrastive or generative methods to this…

Robotics · Computer Science 2025-10-08 Haoran Zhu , Zhenyuan Dong , Kristi Topollai , Beiyao Sha , Anna Choromanska

Image-to-point cross-modal learning has emerged to address the scarcity of large-scale 3D datasets in 3D representation learning. However, current methods that leverage 2D data often result in large, slow-to-train models, making them…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Avishka Perera , Kumal Hewagamage , Saeedha Nazar , Kavishka Abeywardana , Hasitha Gallella , Ranga Rodrigo , Mohamed Afham

Joint-embedding self-supervised learning (SSL) commonly relies on transformations such as data augmentation and masking to learn visual representations, a task achieved by enforcing invariance or equivariance with respect to these…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Hafez Ghaemi , Eilif Muller , Shahab Bakhtiari

Joint-embedding predictive architectures (JEPAs) have shown substantial promise in self-supervised representation learning, yet their application in generative modeling remains underexplored. Conversely, diffusion models have demonstrated…

Machine Learning · Computer Science 2025-02-05 Dengsheng Chen , Jie Hu , Xiaoming Wei , Enhua Wu

We introduce Latent-WAM, an efficient end-to-end autonomous driving framework that achieves strong trajectory planning through spatially-aware and dynamics-informed latent world representations. Existing world-model-based planners suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Linbo Wang , Yupeng Zheng , Qiang Chen , Shiwei Li , Yichen Zhang , Zebin Xing , Qichao Zhang , Xiang Li , Deheng Qian , Pengxuan Yang , Yihang Dong , Ce Hao , Xiaoqing Ye , Junyu han , Yifeng Pan , Dongbin Zhao

World models require robust relational understanding to support prediction, reasoning, and control. While object-centric representations provide a useful abstraction, they are not sufficient to capture interaction-dependent dynamics. We…

Artificial Intelligence · Computer Science 2026-05-29 Heejeong Nam , Quentin Le Lidec , Lucas Maes , Yann LeCun , Randall Balestriero

In this work, we propose a novel data-driven machine learning (ML) technique to model and predict the dynamics of the wireless propagation environment in latent space. Leveraging the idea of channel charting, which learns compressed…

Machine Learning · Computer Science 2024-09-17 Charbel Bou Chaaya , Abanoub M. Girgis , Mehdi Bennis