English
Related papers

Related papers: JEPA-MSAC: A Joint-Embedding Predictive Architectu…

200 papers

The integration of multimodal sensing and millimeter-wave (mmWave) communications is a key enabler for highly mobile vehicle-to-infrastructure (V2I) networks. However, continuous high-resolution visual sensing incurs prohibitive…

Signal Processing · Electrical Eng. & Systems 2026-04-09 Wenqi Fan , Ning Wei , Rongyan Xi , Ahmad Bazzi , Yue Xiu , Chadi Assi , Jing Dong , Jing Jin

This paper explores the automated process of determining stem compatibility by identifying audio recordings of single instruments that blend well with a given musical context. To tackle this challenge, we present Stem-JEPA, a novel…

Sound · Computer Science 2024-08-06 Alain Riou , Stefan Lattner , Gaëtan Hadjeres , Michael Anslow , Geoffroy Peeters

Integrated Sensing and Communications (ISAC) is emerging as a foundational paradigm for next-generation wireless networks, enabling communication infrastructures to simultaneously support data transmission and environment sensing. By…

Networking and Internet Architecture · Computer Science 2026-01-07 S. Zhang , M. Feizarefi , A. F. Mirzaei

The Joint-Embedding Predictive Architecture (JEPA) is often seen as a non-generative alternative to likelihood-based self-supervised learning, emphasizing prediction in representation space rather than reconstruction in observation space.…

Machine Learning · Computer Science 2026-03-23 Moritz Gögl , Christopher Yau

We present Clin-JEPA, a multi-phase co-training framework for joint-embedding predictive (JEPA) pretraining on EHR patient trajectories. JEPA architectures have enabled latent-space planning in robotics and high-quality representation…

Image-based Joint-Embedding Predictive Architecture (I-JEPA) offers a promising approach to visual self-supervised learning through masked feature prediction. However with the inherent visual uncertainty at masked positions, feature…

Machine Learning · Computer Science 2026-05-06 Chen Huang , Xianhang Li , Vimal Thilak , Etai Littwin , Josh Susskind

This paper proposes a reinforcement learning (RL)-aided cognitive framework for massive MIMO-based integrated sensing and communication (ISAC) systems employing a uniform planar array (UPA). The focus is on enhancing radar sensing…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Adam Umra , Aya M. Ahmed , Aydin Sezgin

Joint Embedding Predictive Architectures (JEPAs) learn representations able to solve numerous downstream tasks out-of-the-box. JEPAs combine two objectives: (i) a latent-space prediction term, i.e., the representation of a slightly…

Machine Learning · Computer Science 2025-10-08 Randall Balestriero , Nicolas Ballas , Mike Rabbat , Yann LeCun

Integrated sensing and communication (ISAC) has opened up numerous game-changing opportunities for realizing future wireless systems. In this paper, we propose an ISAC processing framework relying on millimeter-wave (mmWave) massive…

Information Theory · Computer Science 2022-09-12 Zhen Gao , Ziwei Wan , Dezhi Zheng , Shufeng Tan , Christos Masouros , Derrick Wing Kwan Ng , Sheng Chen

Sixth generation (6G) wireless technology is anticipated to introduce Integrated Sensing and Communication (ISAC) as a transformative paradigm. ISAC unifies wireless communication and RADAR or other forms of sensing to optimize spectral and…

Signal Processing · Electrical Eng. & Systems 2025-03-13 Mohammad Farzanullah , Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

This paper presents an end-to-end deep learning framework in a movable antenna (MA)-enabled multiuser communication system. In contrast to the conventional works assuming perfect channel state information (CSI), we address the practical CSI…

Information Theory · Computer Science 2025-09-16 Ruizhi Zhang , Yuchen Zhang , Lipeng Zhu , Ying Zhang , Rui Zhang

Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing…

Image and Video Processing · Electrical Eng. & Systems 2024-10-25 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Jun Zhang

Integrated Sensing and Communications (ISAC) has emerged as a key enabler for sixth generation (6G) wireless systems by jointly supporting data transmission and environmental awareness within a unified framework. However, communication and…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Ahmet Yazar , Yusuf Islam Demir , Ahmed Naeem , Seyit Karatepe

Large AI models have been widely adopted in wireless communications for channel modeling, beamforming, and resource optimization. However, most existing efforts remain limited to single-modality inputs and channel-specific objec- tives,…

Machine Learning · Computer Science 2025-11-18 Zhizhen Li , Xuanhao Luo , Xueren Ge , Longyu Zhou , Xingqin Lin , Yuchen Liu

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

Human-Computer Interaction · Computer Science 2020-12-21 Darshana Rathnayake , Ashen de Silva , Dasun Puwakdandawa , Lakmal Meegahapola , Archan Misra , Indika Perera

Multi-static cooperative sensing emerges as a promising technology for advancing integrated sensing and communication (ISAC), enhancing sensing accuracy and range. In this paper, we develop a unified design framework for joint active and…

Signal Processing · Electrical Eng. & Systems 2025-10-09 Yan Yang , Zhendong Li , Jianwei Zhao , Qingqing Wu , Zhiqing Wei , Wen Chen , Weimin Jia

Integrated Sensing and Communication (ISAC) has emerged as a key enabler for future wireless systems. The recently developed symbol-level precoding (SLP) technique holds significant potential for ISAC waveform design, as it leverages both…

Signal Processing · Electrical Eng. & Systems 2025-02-21 Peng Jiang , Ming Li , Rang Liu , Wei Wang , Qian Liu

Traditional single-modality sensing faces limitations in accuracy and capability, and its decoupled implementation with communication systems increases latency in bandwidth-constrained environments. Additionally, single-task-oriented…

Machine Learning · Computer Science 2025-03-13 Yubo Peng , Luping Xiang , Kun Yang , Feibo Jiang , Kezhi Wang , Dapeng Oliver Wu

The programmable metasurface is regarded as one of the most promising transformative technologies for next-generation wireless system applications. Due to the lack of effective perception ability of the external electromagnetic environment,…

Recent vision-language-action (VLA) models built upon pretrained vision-language models (VLMs) have achieved significant improvements in robotic manipulation. However, current VLAs still suffer from low sample efficiency and limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Shangchen Miao , Ningya Feng , Jialong Wu , Ye Lin , Xu He , Dong Li , Mingsheng Long