English
Related papers

Related papers: Clin-JEPA: A Multi-Phase Co-Training Framework for…

200 papers

Future wireless systems increasingly require predictive and transferable representations that can support multiple physical-layer (PHY) tasks under dynamic environments. However, most existing supervised learning-based methods are designed…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Can Zheng , Jiguang He , Guofa Cai , Nannan Li , Mehdi Bennis , Henk Wymeersch , Merouane Debbah

Large Language Model (LLM) pretraining, finetuning, and evaluation rely on input-space reconstruction and generative capabilities. Yet, it has been observed in vision that embedding-space training objectives, e.g., with Joint Embedding…

Computation and Language · Computer Science 2025-10-08 Hai Huang , Yann LeCun , Randall Balestriero

Accurately modeling and controlling vehicle exhaust emissions during transient events, such as rapid acceleration, is critical for meeting environmental regulations and optimizing powertrains. Conventional data-driven methods, such as…

Systems and Control · Electrical Eng. & Systems 2026-01-28 Ganesh Sundaram , Tobias Gehra , Jonas Ulmen , Mirjan Heubaum , Daniel Görges , Michael Günthner

We present a transformer architecture-based foundation model for tasks at high-energy particle colliders such as the Large Hadron Collider. We train the model to classify jets using a self-supervised strategy inspired by the Joint Embedding…

Machine Learning · Computer Science 2025-02-07 Jai Bardhan , Radhikesh Agrawal , Abhiram Tilak , Cyrin Neeraj , Subhadip Mitra

Invariance-based and generative methods have shown a conspicuous performance for 3D self-supervised representation learning (SSRL). However, the former relies on hand-crafted data augmentations that introduce bias not universally applicable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Naiwen Hu , Haozhe Cheng , Yifan Xie , Shiqi Li , Jihua Zhu

Single-cell foundation models learn by reconstructing masked gene expression, implicitly treating technical noise as signal. With dropout rates exceeding 90%, reconstruction objectives encourage models to encode measurement artifacts rather…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Ali ElSheikh , Rui-Xi Wang , Weimin Wu , Yibo Wen , Payam Dibaeinia , Jennifer Yuntong Zhang , Jerry Yao-Chieh Hu , Mei Knudson , Sudarshan Babu , Shao-Hua Sun , Aly A. Khan , Han Liu

Robotic imitation learning is often treated as reproducing demonstrated actions, but actions are inherently embodiment-specific. When demonstrations come from humans or robots with different morphology, kinematics, or action spaces, this…

Robotics · Computer Science 2026-05-21 Jingyang He , Guangrun Li , Jieyu Zhang , Chengkai Hou , Zhengping Che , Shanghang Zhang

Electrocardiogram (ECG) captures the heart's electrical signals, offering valuable information for diagnosing cardiac conditions. However, the scarcity of labeled data makes it challenging to fully leverage supervised learning in the…

Machine Learning · Computer Science 2026-04-13 Sehun Kim

Joint-Embedding Predictive Architectures (JEPAs) have recently emerged as a novel and powerful technique for self-supervised representation learning. They aim to learn an energy-based model by predicting the latent representation of a…

Machine Learning · Computer Science 2025-01-22 Geri Skenderi , Hang Li , Jiliang Tang , Marco Cristani

Joint Embedding Predictive Architectures (JEPA) have emerged as a powerful framework for learning general-purpose representations. However, these models often lack interpretability and suffer from inefficiencies due to dense embedding…

Machine Learning · Computer Science 2025-04-24 Max Hartman , Lav Varshney

In wireless networked control systems, ensuring timely and reliable state updates from distributed devices to remote controllers is essential for robust control performance. However, when multiple devices transmit high-dimensional states…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Abanoub M. Girgis , Ibtissam Labriji , Mehdi Bennis

End-to-end autonomous driving increasingly leverages self-supervised video pretraining to learn transferable planning representations. However, pretraining video world models for scene understanding has so far brought only limited…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Linhan Wang , Zichong Yang , Chen Bai , Guoxiang Zhang , Xiaotong Liu , Xiaoyin Zheng , Xiao-Xiao Long , Chang-Tien Lu , Cheng Lu

This paper explores the automated process of determining stem compatibility by identifying audio recordings of single instruments that blend well with a given musical context. To tackle this challenge, we present Stem-JEPA, a novel…

Sound · Computer Science 2024-08-06 Alain Riou , Stefan Lattner , Gaëtan Hadjeres , Michael Anslow , Geoffroy Peeters

Recently, self-supervised representation learning relying on vast amounts of unlabeled data has been explored as a pre-training method for autonomous driving. However, directly applying popular contrastive or generative methods to this…

Robotics · Computer Science 2025-10-08 Haoran Zhu , Zhenyuan Dong , Kristi Topollai , Beiyao Sha , Anna Choromanska

Protein language models are trained primarily with masked language modeling (MLM), which predicts amino-acid identities at masked positions. We ask whether latent-space prediction can complement these token-level objectives under matched…

Machine Learning · Computer Science 2026-05-11 Dan Ofer , Dafna Shahaf , Michal Linial

The development of multimodal models for pulmonary nodule diagnosis is limited by the scarcity of labeled data and the tendency for these models to overfit on the training distribution. In this work, we leverage self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Thomas Z. Li , Aravind R. Krishnan , Lianrui Zuo , John M. Still , Kim L. Sandler , Fabien Maldonado , Thomas A. Lasko , Bennett A. Landman

World models for partially observed environments must imagine multiple compatible hidden futures and steer between them under counterfactual actions. Joint Embedding Predictive Architectures (JEPAs) do this in latent space, but a…

Machine Learning · Computer Science 2026-05-26 Santosh Kumar Radha , Oktay Goktas

Reservoir simulation workflows face a fundamental data asymmetry: input parameter fields (geostatistical permeability realizations, porosity distributions) are free to generate in arbitrary quantities, yet existing neural operator…

Machine Learning · Computer Science 2026-04-10 Brandon Yee , Pairie Koh

Joint Embedding Predictive Architectures (JEPA) offer a scalable paradigm for self-supervised learning by predicting latent representations rather than reconstructing high-entropy observations. However, existing formulations rely on…

Machine Learning · Computer Science 2026-01-22 Yongchao Huang

Video Joint Embedding Predictive Architectures (V-JEPA) learn generalizable off-the-shelf video representation by predicting masked regions in latent space with an exponential moving average (EMA)-updated teacher. While EMA prevents…

Machine Learning · Computer Science 2025-09-30 Xianhang Li , Chen Huang , Chun-Liang Li , Eran Malach , Josh Susskind , Vimal Thilak , Etai Littwin