English
Related papers

Related papers: Multimodal-Wireless: A Large-Scale Dataset for Sen…

200 papers

Multimodal sentiment analysis is a trending area of research, and the multimodal fusion is one of its most active topic. Acknowledging humans communicate through a variety of channels (i.e visual, acoustic, linguistic), multimodal systems…

Machine Learning · Computer Science 2021-09-10 Pierre Colombo , Emile Chapuis , Matthieu Labeau , Chloe Clavel

Multimodal large language models (MLLMs) are rapidly evolving, presenting increasingly complex safety challenges. However, current dataset construction methods, which are risk-oriented, fail to cover the growing complexity of real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Jingen Qu , Lijun Li , Bo Zhang , Yichen Yan , Jing Shao

Vehicular communication systems operating in the millimeter wave (mmWave) band are highly susceptible to signal blockage from dynamic obstacles such as vehicles, pedestrians, and infrastructure. To address this challenge, we propose a…

Machine Learning · Computer Science 2025-07-22 Ahmad M. Nazar , Abdulkadir Celik , Mohamed Y. Selim , Asmaa Abdallah , Daji Qiao , Ahmed M. Eltawil

4D human sensing and modeling are fundamental tasks in vision and graphics with numerous applications. With the advances of new sensors and algorithms, there is an increasing demand for more versatile datasets. In this work, we contribute…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Zhongang Cai , Daxuan Ren , Ailing Zeng , Zhengyu Lin , Tao Yu , Wenjia Wang , Xiangyu Fan , Yang Gao , Yifan Yu , Liang Pan , Fangzhou Hong , Mingyuan Zhang , Chen Change Loy , Lei Yang , Ziwei Liu

Road surface classification (RSC) is a key enabler for environment-aware predictive maintenance systems. However, existing RSC techniques often fail to generalize beyond narrow operational conditions due to limited sensing modalities and…

As the field of remote sensing is evolving, we witness the accumulation of information from several modalities, such as multispectral (MS), hyperspectral (HSI), LiDAR etc. Each of these modalities possess its own distinct characteristics…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Rupak Bose , Shivam Pande , Biplab Banerjee

World models significantly enhance hierarchical understanding, improving data integration and learning efficiency. To explore the potential of the world model in the remote sensing (RS) field, this paper proposes a label-efficient remote…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jinping Wang , Weiwei Song , Hao Chen , Jinchang Ren , Huimin Zhao

Multimodal object recognition is still an emerging field. Thus, publicly available datasets are still rare and of small size. This dataset was developed to help fill this void and presents multimodal data for 63 objects with some visual and…

Robust and unobtrusive in-vehicle physiological monitoring is crucial for ensuring driving safety and user experience. While remote physiological measurement (RPM) offers a promising non-invasive solution, its translation to real-world…

Artificial Intelligence · Computer Science 2025-07-28 Jiyao Wang , Xiao Yang , Qingyong Hu , Jiankai Tang , Can Liu , Dengbo He , Yuntao Wang , Yingcong Chen , Kaishun Wu

Multimodality and multichannel monitoring have become increasingly popular and accessible in engineering, Internet of Things, wearable devices, and biomedical applications. In these contexts, given the diverse and complex nature of data…

Information Theory · Computer Science 2023-12-29 Reza Sameni

This paper presents a simulation workflow for generating synthetic LiDAR datasets to support autonomous vehicle perception, robotics research, and sensor security analysis. Leveraging the CoppeliaSim simulation environment and its Python…

Robotics · Computer Science 2025-06-24 Abhishek Phadke , Shakib Mahmud Dipto , Pratip Rana

Wi-Fi sensing has emerged as a significant technology in wireless sensing and Integrated Sensing and Communication (ISAC), offering benefits such as low cost, high penetration, and enhanced privacy. Currently, it is widely utilized in…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Zijian Zhao

The rapid advancement of autonomous systems, including self-driving vehicles and drones, has intensified the need to forge true Spatial Intelligence from multi-modal onboard sensor data. While foundation models excel in single-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Song Wang , Lingdong Kong , Xiaolu Liu , Hao Shi , Wentong Li , Jianke Zhu , Steven C. H. Hoi

Multi-view images are acquired by a lensless compressive imaging architecture, which consists of an aperture assembly and multiple sensors. The aperture assembly consists of a two dimensional array of aperture elements whose transmittance…

Information Theory · Computer Science 2013-09-13 Hong Jiang , Gang Huang , Paul Wilford

The design and technology development of 6G-enabled networked intelligent systems needs an accurate real-time channel model as the cornerstone. However, with the new requirements of 6G-enabled networked intelligent systems, the conventional…

Signal Processing · Electrical Eng. & Systems 2025-09-10 Lu Bai , Zengrui Han , Xuesong Cai , Xiang Cheng

Predicting multiple real-world tasks in a single model often requires a particularly diverse feature space. Multimodal (MM) models aim to extract the synergistic predictive potential of multiple data types to create a shared feature space…

Machine Learning · Computer Science 2023-11-07 Vinitra Swamy , Malika Satayeva , Jibril Frej , Thierry Bossy , Thijs Vogels , Martin Jaggi , Tanja Käser , Mary-Anne Hartley

In the last years, several machine learning-based techniques have been proposed to monitor human movements from Wi-Fi channel readings. However, the development of domain-adaptive algorithms that robustly work across different environments…

Signal Processing · Electrical Eng. & Systems 2024-08-27 Francesca Meneghello , Nicolò Dal Fabbro , Domenico Garlisi , Ilenia Tinnirello , Michele Rossi

Large-scale multi-session LiDAR mapping is essential for a wide range of applications, including surveying, autonomous driving, crowdsourced mapping, and multi-agent navigation. However, existing approaches often struggle with data…

Robotics · Computer Science 2024-08-08 Xiangcheng Hu , Jin Wu , Jianhao Jiao , Binqian Jiang , Wei Zhang , Wenshuo Wang , Ping Tan

The development of computer vision algorithms for Unmanned Aerial Vehicles (UAVs) imagery heavily relies on the availability of annotated high-resolution aerial data. However, the scarcity of large-scale real datasets with pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Giulia Rizzoli , Francesco Barbato , Matteo Caligiuri , Pietro Zanuttigh

We present SpeakingFaces as a publicly-available large-scale multimodal dataset developed to support machine learning research in contexts that utilize a combination of thermal, visual, and audio data streams; examples include…

Human-Computer Interaction · Computer Science 2021-05-04 Madina Abdrakhmanova , Askat Kuzdeuov , Sheikh Jarju , Yerbolat Khassanov , Michael Lewis , Huseyin Atakan Varol