English
Related papers

Related papers: Task-Oriented Mulsemedia Communication using Unifi…

200 papers

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate…

Human-Computer Interaction · Computer Science 2020-12-21 Darshana Rathnayake , Ashen de Silva , Dasun Puwakdandawa , Lakmal Meegahapola , Archan Misra , Indika Perera

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data transmission and…

Machine Learning · Computer Science 2025-07-08 Yusong Zhang , Yuxuan Sun , Lei Guo , Wei Chen , Bo Ai , Deniz Gunduz

Semantic communication has emerged as new paradigm shifts in 6G from the conventional syntax-oriented communications. Recently, the wireless broadcast technology has been introduced to support semantic communication system toward higher…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Mingze Gong , Shuoyao Wang , Fangwei Ye , Suzhi Bi

The sixth generation (6G) of mobile communication system is witnessing a new paradigm shift, i.e., integrated sensing-communication system. A comprehensive dataset is a prerequisite for 6G integrated sensing-communication research. This…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Xiang Cheng , Ziwei Huang , Lu Bai , Haotian Zhang , Mingran Sun , Boxun Liu , Sijiang Li , Jianan Zhang , Minson Lee

Driven by the development goal of network paradigm and demand for various functions in the sixth-generation (6G) mission-critical Internet-of-Things (MC-IoT), we foresee a goal-oriented integration of sensing, communication, computing, and…

Networking and Internet Architecture · Computer Science 2024-01-03 Jie Cao , Ernest Kurniawan , Amnart Boonkajay , Sumei Sun , Petar Popovski , Xu Zhu

In the 6G era, semantic collaboration among multiple embodied intelligent devices (MEIDs) becomes crucial for complex task execution. However, existing systems face challenges in multimodal information fusion, adaptive communication, and…

Artificial Intelligence · Computer Science 2025-11-26 Mingkai Chen , Zijie Feng , Lei Wang , Yaser Khamayseh

Benefitting from the vast spatial degrees of freedom, the amalgamation of integrated sensing and communication (ISAC) and massive multiple-input multiple-output (MIMO) is expected to simultaneously improve spectral and energy efficiencies…

Information Theory · Computer Science 2024-01-18 Ruoyu Zhang , Lei Cheng , Shuai Wang , Yi Lou , Yulong Gao , Wen Wu , Derrick Wing Kwan Ng

Semantic communication (SemCom) has emerged as a promising paradigm for 6G wireless systems by transmitting task-relevant information rather than raw bits, yet existing approaches remain vulnerable to dual sources of uncertainty: semantic…

Networking and Internet Architecture · Computer Science 2026-01-26 Long Tan Le , Senura Hansaja Wanasekara , Zerun Niu , Nguyen H. Tran , Phuong Vo , Walid Saad , Dusit Niyato , Zhu Han , Choong Seon Hong , H. Vincent Poor

Future wireless networks will integrate sensing, learning and communication to provide new services beyond communication and to become more resilient. Sensors at the network infrastructure, sensors on the user equipment, and the sensing…

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

In recent years, there has been significant progress in semantic communication systems empowered by deep learning techniques. It has greatly improved the efficiency of information transmission. Nevertheless, traditional semantic…

Signal Processing · Electrical Eng. & Systems 2025-12-01 Zengle Zhu , Rongqing Zhang , Xiang Cheng , Liuqing Yang

Cellular-connected unmanned aerial vehicles (UAVs) represent a promising technology for extending the coverage of 5G and 6G networks in a cost-effective manner. Additionally, Massive multiple-input multiple-output (MIMO) serves as an…

Signal Processing · Electrical Eng. & Systems 2024-01-01 Byunghyun Lee , Andrew Marcum , David Love , James Krogmeier

The task-oriented semantic communication systems have achieved significant performance gain, however, the paradigm that employs a model for a specific task might be limited, since the system has to be updated once the task is changed or…

Signal Processing · Electrical Eng. & Systems 2022-06-02 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu

Collaborative Perception (CP) has shown great potential to achieve more holistic and reliable environmental perception in intelligent unmanned systems (IUSs). However, implementing CP still faces key challenges due to the characteristics of…

Multiagent Systems · Computer Science 2024-06-06 Sheng Zhou , Yukuan Jia , Ruiqing Mao , Zhaojun Nan , Yuxuan Sun , Zhisheng Niu

The emergence of multimodal foundation models has revolutionized learning paradigms by enabling joint understanding across diverse data types. In the context of next-generation wireless networks, integrating sensing and communication…

Networking and Internet Architecture · Computer Science 2026-01-01 Mohammad Farzanullah , Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while…

Signal Processing · Electrical Eng. & Systems 2021-12-15 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Metaverse over wireless networks is an emerging use case of the sixth generation (6G) wireless systems, posing unprecedented challenges in terms of its multi-modal data transmissions with stringent latency and reliability requirements.…

Networking and Internet Architecture · Computer Science 2022-12-15 Jihong Park , Jinho Choi , Seong-Lyun Kim , Mehdi Bennis

This paper presents an initial investigation into the combination of integrated sensing and communication (ISAC) and massive communication, both of which are largely regarded as key scenarios in sixth-generation (6G) wireless networks.…

Signal Processing · Electrical Eng. & Systems 2025-10-17 Junyuan Gao , Weifeng Zhu , Shuowen Zhang , Yongpeng Wu , Jiannong Cao , Giuseppe Caire , Liang Liu

In task-oriented communications, most existing work designed the physical-layer communication modules and learning based codecs with distinct objectives: learning is targeted at accurate execution of specific tasks, while communication aims…

Signal Processing · Electrical Eng. & Systems 2024-05-29 Chang Cai , Xiaojun Yuan , Ying-Jun Angela Zhang

This paper introduces a deep learning approach to dynamic spectrum access, leveraging the synergy of multi-modal image and spectrum data for the identification of potential transmitters. We consider an edge device equipped with a camera…

Networking and Internet Architecture · Computer Science 2023-12-22 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus