English
Related papers

Related papers: Discrete JEPA: Learning Discrete Token Representat…

200 papers

Recent advances in self-supervised visual representation learning have demonstrated the effectiveness of predictive latent-space objectives for learning transferable features. In particular, Image-based Joint-Embedding Predictive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xiangteng He , Shunsuke Sakai , Shivam Chandhok , Sara Beery , Kun Yuan , Nicolas Padoy , Tatsuhito Hasegawa , Leonid Sigal

Current autoregressive language models couple high-level reasoning and low-level token generation into a single sequential process, making the reasoning trajectory vulnerable to compounding expression errors. We propose JEPA-Reasoner, a…

Computation and Language · Computer Science 2026-01-29 Bingyang Kelvin Liu , Ziyu Patrick Chen , David P. Woodruff

This paper demonstrates an approach for learning highly semantic image representations without relying on hand-crafted data-augmentations. We introduce the Image-based Joint-Embedding Predictive Architecture (I-JEPA), a non-generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Mahmoud Assran , Quentin Duval , Ishan Misra , Piotr Bojanowski , Pascal Vincent , Michael Rabbat , Yann LeCun , Nicolas Ballas

Image-based Joint-Embedding Predictive Architecture (I-JEPA) offers a promising approach to visual self-supervised learning through masked feature prediction. However with the inherent visual uncertainty at masked positions, feature…

Machine Learning · Computer Science 2026-05-06 Chen Huang , Xianhang Li , Vimal Thilak , Etai Littwin , Josh Susskind

Modern self-supervised predictive architectures excel at capturing complex statistical correlations from high-dimensional data but lack mechanisms to internalize verifiable human logic, leaving them susceptible to spurious correlations and…

Machine Learning · Computer Science 2026-03-17 Yongchao Huang , Hassan Raza

Two competing paradigms exist for self-supervised learning of data representations. Joint Embedding Predictive Architecture (JEPA) is a class of architectures in which semantically similar inputs are encoded into representations that are…

Machine Learning · Computer Science 2024-07-08 Etai Littwin , Omid Saremi , Madhu Advani , Vimal Thilak , Preetum Nakkiran , Chen Huang , Joshua Susskind

Generative models, from diffusion models to large language models, achieve remarkable performance but at a cost in training data orders of magnitude larger than what biological learners require. An alternative paradigm has emerged in which…

Machine Learning · Computer Science 2026-05-28 Daniel J. Korchinski , Alessandro Favero , Matthieu Wyart

The joint-embedding predictive architecture (JEPA) recently has shown impressive results in extracting visual representations from unlabeled imagery under a masking strategy. However, we reveal its disadvantages, notably its insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Shentong Mo , Sukmin Yun

Joint-embedding predictive architectures (JEPAs) have shown substantial promise in self-supervised representation learning, yet their application in generative modeling remains underexplored. Conversely, diffusion models have demonstrated…

Machine Learning · Computer Science 2025-02-05 Dengsheng Chen , Jie Hu , Xiaoming Wei , Enhua Wu

We introduce a two-stage self-supervised framework that combines the Joint-Embedding Predictive Architecture (JEPA) with a Density Adaptive Attention Mechanism (DAAM) for learning robust speech representations. Stage~1 uses JEPA with DAAM…

Joint Embedding Predictive Architectures (JEPA) offer a scalable paradigm for self-supervised learning by predicting latent representations rather than reconstructing high-entropy observations. However, existing formulations rely on…

Machine Learning · Computer Science 2026-01-22 Yongchao Huang

Recent progress in latent world models (e.g., V-JEPA2) has shown promising capability in forecasting future world states from video observations. Nevertheless, dense prediction from a short observation window limits temporal context and can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Haichao Zhang , Yijiang Li , Shwai He , Tushar Nagarajan , Mingfei Chen , Jianglin Lu , Ang Li , Yun Fu

Invariance-based and generative methods have shown a conspicuous performance for 3D self-supervised representation learning (SSRL). However, the former relies on hand-crafted data augmentations that introduce bias not universally applicable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Naiwen Hu , Haozhe Cheng , Yifan Xie , Shiqi Li , Jihua Zhu

Joint-Embedding Predictive Architectures (JEPAs) have recently emerged as a novel and powerful technique for self-supervised representation learning. They aim to learn an energy-based model by predicting the latent representation of a…

Machine Learning · Computer Science 2025-01-22 Geri Skenderi , Hang Li , Jiliang Tang , Marco Cristani

We present V-JEPA 2.1, a family of self-supervised models that learn dense, high-quality visual representations for both images and videos while retaining strong global scene understanding. The approach combines four key components. First,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Lorenzo Mur-Labadia , Matthew Muckley , Amir Bar , Mido Assran , Koustuv Sinha , Mike Rabbat , Yann LeCun , Nicolas Ballas , Adrien Bardes

Recently, autoregressive models have demonstrated remarkable performance in class-conditional image generation. However, the application of next-token prediction to high-resolution text-to-image generation remains largely unexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Dengsheng Chen , Jie Hu , Tiezhu Yue , Xiaoming Wei , Enhua Wu

Learning manipulable representations of the world and its dynamics is central to AI. Joint-Embedding Predictive Architectures (JEPAs) offer a promising blueprint, but lack of practical guidance and theory has led to ad-hoc R&D. We present a…

Machine Learning · Computer Science 2025-11-17 Randall Balestriero , Yann LeCun

Self-supervised learning has seen great success recently in unsupervised representation learning, enabling breakthroughs in natural language and image processing. However, these methods often rely on autoregressive and masked modeling,…

Machine Learning · Computer Science 2025-10-01 Sofiane Ennadir , Siavash Golkar , Leopoldo Sarra

Joint Embedding Predictive Architectures (JEPA) have emerged as a powerful framework for learning general-purpose representations. However, these models often lack interpretability and suffer from inefficiencies due to dense embedding…

Machine Learning · Computer Science 2025-04-24 Max Hartman , Lav Varshney

Self-Supervised Learning (SSL) has shifted from pixel-level reconstruction to latent space prediction, spearheaded by the Joint Embedding Predictive Architecture (JEPA). While effective, standard JEPA models typically rely on a…

Machine Learning · Computer Science 2026-03-03 Yongchao Huang
‹ Prev 1 2 3 10 Next ›