English
Related papers

Related papers: JEPA-MSAC: A Joint-Embedding Predictive Architectu…

200 papers

Aerodynamic surrogate models are increasingly used to replace repeated high-fidelity CFD evaluations in many-query design settings, but current approaches still face two important limitations: they often scale poorly to the very large…

The development of multimodal models for pulmonary nodule diagnosis is limited by the scarcity of labeled data and the tendency for these models to overfit on the training distribution. In this work, we leverage self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Thomas Z. Li , Aravind R. Krishnan , Lianrui Zuo , John M. Still , Kim L. Sandler , Fabien Maldonado , Thomas A. Lasko , Bennett A. Landman

Environmental sensing can significantly enhance mmWave communications by assisting beam training, yet its benefits must be balanced against the associated sensing costs. To this end, we propose a unified machine learning framework that…

Signal Processing · Electrical Eng. & Systems 2025-09-26 Abolfazl Zakeri , Nhan Thanh Nguyen , Ahmed Alkhateeb , Markku Juntti

Self-supervised learning has emerged as a powerful paradigm for learning visual representations without manual annotations, yet most methods still operate on a single modality and therefore miss the complementary structure available from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Ciem Cornelissen , Sam Leroux , Pieter Simoens

Integrated sensing and communication (ISAC) is envisioned to be one of the pillars of 6G. However, 6G is also expected to be severely affected by hardware impairments. Under such impairments, standard model-based approaches might fail if…

Signal Processing · Electrical Eng. & Systems 2022-12-21 José Miguel Mateos-Ramos , Christian Häger , Musa Furkan Keskin , Luc Le Magoarou , Henk Wymeersch

Semi-supervised learning has emerged as a powerful paradigm for leveraging large amounts of unlabeled data to improve the performance of machine learning models when labeled data are scarce. Among existing approaches, methods derived from…

Machine Learning · Computer Science 2026-04-29 Ali Aghababaei-Harandi , Aude Sportisse , Massih-Reza Amini

Existing methods for self-supervised representation learning of geospatial regions and map entities rely extensively on the design of pretext tasks, often involving augmentations or heuristic sampling of positive and negative pairs based on…

Machine Learning · Computer Science 2025-03-11 Theodor Lundqvist , Ludvig Delvret

This work introduces JEMA (Joint Embedding with Multimodal Alignment), a novel co-learning framework tailored for laser metal deposition (LMD), a pivotal process in metal additive manufacturing. As Industry 5.0 gains traction in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Joao Sousa , Roya Darabi , Armando Sousa , Frank Brueckner , Luís Paulo Reis , Ana Reis

Invariance-based and generative methods have shown a conspicuous performance for 3D self-supervised representation learning (SSRL). However, the former relies on hand-crafted data augmentations that introduce bias not universally applicable…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Naiwen Hu , Haozhe Cheng , Yifan Xie , Shiqi Li , Jihua Zhu

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Recently, self-supervised learning methods based on masked latent prediction have proven to encode input data into powerful representations. However, during training, the learned latent space can be further transformed to extract…

Sound · Computer Science 2025-06-05 Aurian Quelennec , Pierre Chouteau , Geoffroy Peeters , Slim Essid

Integrated sensing and communication (ISAC) can reduce beam-training overhead in mmWave vehicle-to-infrastructure (V2I) links by enabling in-band sensing-based beam prediction, while exteroceptive sensors can further enhance the prediction…

Signal Processing · Electrical Eng. & Systems 2026-01-06 Abidemi Orimogunje , Hyunwoo Park , Igbafe Orikumhi , Sunwoo Kim , Dejan Vukobratovic

Recent advances in integrated sensing and communication (ISAC) unmanned aerial vehicles (UAVs) have enabled their widespread deployment in critical applications such as emergency management. This paper investigates the challenge of…

Information Theory · Computer Science 2025-03-26 Ziji Guo , Haonan Tong , Zhilong Zhang , Danpu Liu

The capacity-maximization design philosophy has driven the growth of wireless networks for decades. However, with the slowdown in recent data traffic demand, the mobile industry can no longer rely solely on communication services to sustain…

Signal Processing · Electrical Eng. & Systems 2025-10-17 Yuanhao Cui , Jiali Nie , Fan Liu , Weijie Yuan , Zhiyong Feng , Xiaojun Jing , Yulin Liu , Jie Xu , Christos Masouros , Shuguang Cui

Multi-modal learning relates information across observation modalities of the same physical phenomenon to leverage complementary information. Most multi-modal machine learning methods require that all the modalities used for training are…

Machine Learning · Computer Science 2021-03-10 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

Joint Embedding Predictive Architectures (JEPA) are a novel self supervised training technique that have shown recent promise across domains. We introduce BERT-JEPA (BEPA), a training paradigm that adds a JEPA training objective to…

Computation and Language · Computer Science 2026-01-05 Taj Gillin , Adam Lalani , Kenneth Zhang , Marcel Mateos Salles

Accurate diagnosis of heart arrhythmias requires the interpretation of electrocardiograms (ECG), which capture the electrical activity of the heart. Automating this process through machine learning is challenging due to the need for large…

Signal Processing · Electrical Eng. & Systems 2024-10-21 Kuba Weimann , Tim O. F. Conrad

The emergence of multimodal foundation models has revolutionized learning paradigms by enabling joint understanding across diverse data types. In the context of next-generation wireless networks, integrating sensing and communication…

Networking and Internet Architecture · Computer Science 2026-01-01 Mohammad Farzanullah , Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Modern Text-to-Image (T2I) generation increasingly relies on token-centric architectures that are trained with self-supervision, yet effectively fusing text with visual tokens remains a challenge. We propose \textbf{JEPA-T}, a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Siheng Wan , Zhengtao Yao , Zhengdao Li , Junhao Dong , Yanshu Li , Yikai Li , Linshan Li , Haoyan Xu , Yijiang Li , Zhikang Dong , Huacan Wang , Jifeng Shen

Millimeter-wave or terahertz communications can meet demands of low-altitude economy networks for high-throughput sensing and real-time decision making. However, high-frequency characteristics of wireless channels result in severe…

Networking and Internet Architecture · Computer Science 2026-03-13 Min Hao , Zhizhuo Li , Zirui Zhang , Maoqiang Wu , Han Zhang , Rong Yu