English
Related papers

Related papers: DeepSense 6G: A Large-Scale Real-World Multi-Modal…

200 papers

Our experience of the world is multisensory, spanning a synthesis of language, sight, sound, touch, taste, and smell. Yet, artificial intelligence has primarily advanced in digital modalities like text, vision, and audio. This paper…

Machine Learning · Computer Science 2026-01-14 Paul Pu Liang

This article comprehensively reviews recent developments and research on deep learning-based (DL-based) techniques for integrated sensing and communication (ISAC) systems. ISAC, which combines sensing and communication functionalities, is…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Murat Temiz , Yongwei Zhang , Yanwei Fu , Chi Zhang , Chenfeng Meng , Orhan Kaplan , Christos Masouros

The upcoming Sixth Generation (6G) mobile communications system envisions supporting a variety of use cases with differing characteristics, e.g., very low to extremely high data rates, diverse latency needs, ultra massive connectivity,…

Networking and Internet Architecture · Computer Science 2024-07-15 Rashmi Yadav , Rashmi Kamran , Pranav Jha , Abhay Karandikar

In the coming 6G communications, the internet of things (IoT) serves as a key enabler to collect environmental information and is expected to achieve ubiquitous deployment. However, it is challenging for traditional IoT sensors to meet this…

Signal Processing · Electrical Eng. & Systems 2021-10-07 Jingzhi Hu , Hongliang Zhang , Boya Di , Kaigui Bian , Lingyang Song

Multimodal deep learning has been used to predict clinical endpoints and diagnoses from clinical routine data. However, these models suffer from scaling issues: they have to learn pairwise interactions between each piece of information in…

This paper introduces a deep learning approach to dynamic spectrum access, leveraging the synergy of multi-modal image and spectrum data for the identification of potential transmitters. We consider an edge device equipped with a camera…

Networking and Internet Architecture · Computer Science 2023-12-22 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

Integrated Sensing and Communication (ISAC), combined with data-driven approaches, has emerged as a highly significant field, garnering considerable attention from academia and industry. Its potential to enable wide-scale applications in…

Signal Processing · Electrical Eng. & Systems 2023-08-21 Hammam Salem , MD Muzakkir Quamar , Adeb Mansoor , Mohammed Elrashidy , Nasir Saeed , Mudassir Masood

As humans, we experience the world with all our senses or modalities (sound, sight, touch, smell, and taste). We use these modalities, particularly sight and touch, to convey and interpret specific meanings. Multimodal expressions are…

Machine Learning · Computer Science 2022-05-17 Anirudh Sundar , Larry Heck

6G technology offers a broader range of possibilities for communication systems to perform ubiquitous sensing tasks, including health monitoring, object recognition, and autonomous driving. Since even minor environmental changes can…

Information Theory · Computer Science 2025-04-10 Fei Shang , Haohua Du , Panlong Yang , Xin He , Jingjing Wang , Xiang-Yang Li

A tensegrity-based system is a promising approach for dynamic exploration of uneven and unpredictable environments, particularly, space exploration. However, implementing such systems presents challenges in terms of intelligent aspects:…

Robotics · Computer Science 2024-12-04 Zebing Mao , Ryota Kobayashi , Hiroyuki Nabae , Koichi Suzumori

Artificial intelligence is a key enabler for next-generation wireless communication and sensing. Yet, today's learning-based wireless techniques do not generalize well: most models are task-specific, environment-dependent, and limited to…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Vahid Yazdnian , Yasaman Ghasempour

Transportation mode detection is an important topic within GeoAI and transportation research. In this study, we introduce SpeedTransformer, a novel Transformer-based model that relies solely on speed inputs to infer transportation modes…

Machine Learning · Computer Science 2026-03-19 Yuandong Zhang , Othmane Echchabi , Tianshu Feng , Wenyi Zhang , Hsuai-Kai Liao , Charles Chang

Motivated by the need for increased spectral efficiency and the proliferation of intelligent applications, the sixth-generation (6G) mobile network is anticipated to integrate the dual-functions of communication and sensing (C&S). Although…

Information Theory · Computer Science 2024-01-18 Yifei Zhang , Zhen Gao , Jingjing Zhao , Ziming He , Yunsheng Zhang , Chen Lu , Pei Xiao

Earth observation offers new insight into anthropogenic changes to nature, and how these changes are effecting (and are effected by) the built environment and the real economy. With the global availability of medium-resolution (10-30m)…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Lucas Kruitwagen

The Distributed Intelligent Sensing and Communication (DISAC) framework redefines Integrated Sensing and Communication (ISAC) for 6G by leveraging distributed architectures to enhance scalability, adaptability, and resource efficiency. This…

Many concepts for future generations of wireless communication systems use coherent processing of signals from many distributed antennas. The aim is to improve communication reliability, capacity, and energy efficiency and provide…

Information Theory · Computer Science 2024-03-06 Christian Nelson , Xuhong Li , Aleksei Fedorov , Benjamin J. B. Deutschmann , Fredrik Tufvesson

6th Generation (6G) mobile networks are envisioned to support several new capabilities and data-centric applications for unprecedented number of users, potentially raising significant energy efficiency and sustainability concerns. This…

Networking and Internet Architecture · Computer Science 2025-09-16 Rashmi Kamran , Mahesh Ganesh Bhat , Pranav Jha , Shana Moothedath , Manjesh Hanawal , Prasanna Chaporkar

As integrated sensing and communication (ISAC) capabilities become more prevalent in the mobile 6G radio landscape, there is a substantial opportunity to enhance situational awareness across diverse applications through multi-static radar…

The 6th generation (6G) wireless networks will likely to support a variety of capabilities beyond communication, such as sensing and localization, through the use of communication networks empowered by advanced technologies. Integrated…

Information Theory · Computer Science 2024-02-20 Ruiqi Liu , Mengnan Jian , Dawei Chen , Xu Lin , Yichao Cheng , Wei Cheng , Shijun Chen

This paper addresses the problem of semi-supervised transfer learning with limited cross-modality data in remote sensing. A large amount of multi-modal earth observation images, such as multispectral imagery (MSI) or synthetic aperture…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Danfeng Hong , Naoto Yokoya , Gui-Song Xia , Jocelyn Chanussot , Xiao Xiang Zhu