English
Related papers

Related papers: DeepSense 6G: A Large-Scale Real-World Multi-Modal…

200 papers

Integrating sensing functionality into 6G communication networks requires some changes to existing components as well as new entities processing the radar sensing signals received by the communication antennas. This whitepaper provides a…

Networking and Internet Architecture · Computer Science 2025-12-10 Peter Gersing , Mark Doll , Joerg Huschke , Jan Plachy , Stefan Köpsell

With the advent of the multimodal immersive communication system, people can interact with each other using multiple devices for sensing, communication and/or control either onsite or remotely. As a breakthrough concept, a distributed…

The sixth-generation wireless communications (6G) is often labeled as "connected intelligence". Radio sensing, aligned with machine learning (ML) and artificial intelligence (AI), promises, among other benefits, breakthroughs in the…

6G is the next-generation intelligent and integrated digital information infrastructure, characterized by ubiquitous interconnection, native intelligence, multi-dimensional perception, global coverage, green and low-carbon, native network…

Artificial Intelligence · Computer Science 2023-07-20 Ye Ouyang , Yaqin Zhang , Peng Wang , Yunxin Liu , Wen Qiao , Jun Zhu , Yang Liu , Feng Zhang , Shuling Wang , Xidong Wang

The year 2019 witnessed the rollout of the 5G standard, which promises to offer significant data rate improvement over 4G. While 5G is still in its infancy, there has been an increased shift in the research community for communication…

Networking and Internet Architecture · Computer Science 2021-08-25 Anu Jagannath , Jithin Jagannath , Tommaso Melodia

While fifth-generation (5G) communications are being rolled out worldwide, sixth-generation (6G) communications have attracted much attention from both the industry and the academia. Compared with 5G, 6G will have a wider frequency band,…

Signal Processing · Electrical Eng. & Systems 2021-02-17 Yang Zhao , Wenchao Zhai , Jun Zhao , Tinghao Zhang , Sumei Sun , Dusit Niyato , Kwok-Yan Lam

Although humans have five basic senses, sight, hearing, touch, smell, and taste, most multimedia systems in current systems only capture two of them, namely, sight and hearing. With the development of the metaverse and related technologies,…

Multimedia · Computer Science 2023-11-30 Ian F. Akyildiz , Hongzhi Guo , Rui Dai , Wolfgang Gerstacker

Mobile sensing applications usually require time-series inputs from sensors. Some applications, such as tracking, can use sensed acceleration and rate of rotation to calculate displacement based on physical system models. Other…

Machine Learning · Computer Science 2017-07-04 Shuochao Yao , Shaohan Hu , Yiran Zhao , Aston Zhang , Tarek Abdelzaher

Leveraging perception from radar data can assist multiple communication tasks, especially in highly-mobile and large-scale MIMO systems. One particular challenge, however, is how to distinguish the communication user (object) from the other…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Umut Demirhan , Ahmed Alkhateeb

The introduction of new types of frequency spectrum in 6G technology facilitates the convergence of conventional mobile communications and radar functions. Thus, the mobile network itself becomes a versatile sensor system. This enables…

Networking and Internet Architecture · Computer Science 2023-07-24 Christof A. O. Rauber , Lukas Brechtel , Hans D. Schotten

In the context of deep learning, this article presents an original deep network, namely CentralNet, for the fusion of information coming from different sensors. This approach is designed to efficiently and automatically balance the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie

The convergence of 5G architecture and deep learning has gained a lot of research interests in both the fields of wireless communication and artificial intelligence. This is because deep learning technologies have been identified to be the…

Machine Learning · Computer Science 2022-08-17 Olusola T. Odeyomi , Olubiyi O. Akintade , Temitayo O. Olowu , Gergely Zaruba

This white paper explores future localization and sensing opportunities for beyond 5G wireless communication systems by identifying key technology enablers and discussing their underlying challenges, implementation issues, and identifying…

The IMT-2030 framework provides the vision and conceptual foundation for the next-generation of mobile broadband systems, colloquially known as Sixth-Generation (6G) cellular networks. Academic circles, industry players, and Standard…

Networking and Internet Architecture · Computer Science 2025-08-05 Ekram Hossain , Angelo Vera-Rivera

The confluence of 5G and AI is transforming wireless networks to deliver diverse services at the Edge, driving towards a vision of pervasive distributed intelligence. Future 6G networks will need to deliver quality of experience through…

Information Theory · Computer Science 2021-10-22 Shilpa Talwar , Nageen Himayat , Hosein Nikopour , Feng Xue , Geng Wu , Vida Ilderem

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Sensing using cellular infrastructure may be one of the defining feature of sixth generation (6G) wireless systems. Wideband 6G communication channels operating at higher frequency bands (upper mmWave bands) are better modeled using…

Information Theory · Computer Science 2024-11-12 Vijaya Yajnanarayana , Henk Wymeersch

While the 5G cellular system is being deployed worldwide, researchers have started the investigation of the 6G mobile communication networks. Although the essential requirements and key usage scenarios of 6G are yet to be defined, it is…

Signal Processing · Electrical Eng. & Systems 2020-06-03 Zhiqiang Xiao , Yong Zeng

Hand gesture understanding is essential for several applications in human-computer interaction, including automatic clinical assessment of hand dexterity. While deep learning has advanced static gesture recognition, dynamic gesture…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Gianluca Amprimo , Alberto Ancilotto , Alessandro Savino , Fabio Quazzolo , Claudia Ferraris , Gabriella Olmo , Elisabetta Farella , Stefano Di Carlo