English
Related papers

Related papers: JEPA-MSAC: A Joint-Embedding Predictive Architectu…

200 papers

Wireless communications at high-frequency bands with large antenna arrays face challenges in beam management, which can potentially be improved by multimodality sensing information from cameras, LiDAR, radar, and GPS. In this paper, we…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Yu Tian , Qiyang Zhao , Zine el abidine Kherroubi , Fouzi Boukhalfa , Kebin Wu , Faouzi Bader

This paper introduces a novel multi-objective integrated sensing and communications (ISAC) framework to enable collaborative wireless sensing in conjunction with over-the-air federated-edge learning (OTA-FEEL). The framework enables…

Information Theory · Computer Science 2026-03-18 Saba Asaad , Hina Tabassum , Ping Wang

This paper proposes a Learnable Multiplicative absolute position Embedding based Conformer (LMEC). It contains a kernelized linear attention (LA) module called LMLA to solve the time-consuming problem for long sequence speech recognition as…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Yuguang Yang , Yu Pan , Jingjing Yin , Heng Lu

Building deep learning models that can reason about their environment requires capturing its underlying dynamics. Joint-Embedded Predictive Architectures (JEPA) provide a promising framework to model such dynamics by learning…

Machine Learning · Computer Science 2026-01-06 Matthieu Destrade , Oumayma Bounou , Quentin Le Lidec , Jean Ponce , Yann LeCun

Integrated sensing and communication (ISAC) emerges as a promising technology for B5G/6G, particularly in the millimeter-wave (mmWave) band. However, the widely utilized hybrid architecture in mmWave systems compromises multiplexing gain…

Signal Processing · Electrical Eng. & Systems 2025-02-20 Boxun Liu , Shijian Gao , Zonghui Yang , Xiang Cheng , Liuqing Yang

With the continuous increase of the spectrum and antennas, endogenous sensing is now possible in the fifth generation and future wireless communication systems. However, sensing is a highly complex task for a heterogeneous communication…

Information Theory · Computer Science 2021-05-10 Jie Yang , Xi Yang , Chao-Kai Wen , Shi Jin

Latent representations learned by neural networks often exhibit semantic structure, where concept similarity is reflected by geometric proximity in embedding space. However, comparing such spaces across models remains difficult: changes in…

Models of acoustic word embeddings (AWEs) learn to map variable-length spoken word segments onto fixed-dimensionality vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding…

Computation and Language · Computer Science 2022-09-20 Badr M. Abdullah , Bernd Möbius , Dietrich Klakow

This letter investigates the problem of energy efficient collaborative strategy for mobile embodied artificial intelligence network (MEAN) over wireless communication. In the considered model, the agents execute the tasks through…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Chenliang Wu , Zhouxiang Zhao , Jiaxiang Wang , Ruopeng Xu , Chen Zhu , Zhaohui Yang , Zhaoyang Zhang

Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links…

Machine Learning · Computer Science 2026-01-22 Hang Zhao , Hongru Li , Dongfang Xu , Shenghui Song , Khaled B. Letaief

This letter studies the sensing-assisted channel prediction for a multi-antenna orthogonal frequency division multiplexing (OFDM) system operating in realistic and complex wireless environments. In this system,an integrated sensing and…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Junjie He , Zixiang Ren , Jianping Yao , Han Hu , Tony Xiao Han , Jie Xu

Behavioral patterns captured in embeddings learned from interaction data are pivotal across various stages of production recommender systems. However, in the initial retrieval stage, practitioners face an inherent tradeoff between embedding…

Information Retrieval · Computer Science 2026-02-11 Vojtěch Vančura , Martin Spišák , Rodrigo Alves , Ladislav Peška

Low-altitude economy (LAE) is an emerging business model, which heavily relies on integrated sensing and communications (ISAC), mobile edge computing (MEC), and covert communications. This paper investigates the convert transmission design…

Information Theory · Computer Science 2025-07-25 Weihao Mao , Yang Lu , Bo Ai , Tony Q. S. Quek

Recent advances in deep learning-based joint source-channel coding (DJSCC) have shown promise for end-to-end semantic image transmission. However, most existing schemes primarily focus on optimizing pixel-wise metrics, which often fail to…

Signal Processing · Electrical Eng. & Systems 2024-12-24 Pujing Yang , Guangyi Zhang , Yunlong Cai

Integrated sensing and communication (ISAC) is considered to be a promising technology for future wireless systems due to its ability to provide communication and sensing services using shared hardware and spectrum resources. Moreover, the…

Information Theory · Computer Science 2026-05-19 Nemanja Stefan Perović , Keshav Singh , Chih-Peng Li

We propose a targeted communication architecture for multi-agent reinforcement learning, where agents learn both what messages to send and whom to address them to while performing cooperative tasks in partially-observable environments. This…

Machine Learning · Computer Science 2020-02-25 Abhishek Das , Théophile Gervet , Joshua Romoff , Dhruv Batra , Devi Parikh , Michael Rabbat , Joelle Pineau

Vision-language pretraining has driven much of the recent progress in medical image representation learning, but this paradigm is constrained by the availability of paired image-text data and by the reporting bias of clinical narratives. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Anas Anwarul Haq Khan , Mariam Husain , Pratik Jalan , Kshitij Jadhav

Vision-language models are increasingly employed as multimodal conversational agents (MCAs) for diverse conversational tasks. Recently, reinforcement learning (RL) has been widely explored for adapting MCAs to various human-AI interaction…

Computation and Language · Computer Science 2026-04-14 Yongqi Li , Hao Lang , Tieyun Qian , Yongbin Li

In this paper, we propose an integrated sensing and communication (ISAC) system enabled by movable antennas (MAs), which can dynamically adjust antenna positions to enhance both sensing and communication performance for future wireless…

Information Theory · Computer Science 2025-07-17 Lebin Chen , Ming-Min Zhao , Min-Jian Zhao , Rui Zhang

In this paper, we consider an integrated sensing and communication (ISAC) system with wireless power transfer (WPT) where multiple unmanned aerial vehicle (UAV)-based radars serve multiple clusters of energy-limited communication users in…

Signal Processing · Electrical Eng. & Systems 2025-06-02 Omid Rezaei , Mohammad Mahdi Naghsh , Seyed Mohammad Karbasi , Mohammad Mahdi Nayebi