中文
相关论文

相关论文: Self-Supervised Multimodal Fusion Transformer for …

200 篇论文

3D vehicle detection based on multi-modal fusion is an important task of many applications such as autonomous driving. Although significant progress has been made, we still observe two aspects that need to be further improvement: First, the…

计算机视觉与模式识别 · 计算机科学 2020-09-24 Zehan Zhang , Ming Zhang , Zhidong Liang , Xian Zhao , Ming Yang , Wenming Tan , ShiLiang Pu

Ambient computing is gaining popularity as a major technological advancement for the future. The modern era has witnessed a surge in the advancement in healthcare systems, with viable radio frequency solutions proposed for remote and…

Wi-Fi sensing has emerged as a versatile tool for tasks such as localization, gesture recognition, and vital-sign monitoring, enabling applications from smart environments to personalized healthcare. However, sensing accuracy often…

信号处理 · 电气工程与系统科学 2026-05-27 Fabian Portner , Francesco Gringoli , Matthias Hollick , Arash Asadi

We propose WiFlexFormer, a highly efficient Transformer-based architecture designed for WiFi Channel State Information (CSI)-based person-centric sensing. We benchmark WiFlexFormer against state-of-the-art vision and specialized…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Julian Strohmayer , Matthias Wödlinger , Martin Kampel

Unsupervised user adaptation aligns the feature distributions of the data from training users and the new user, so a well-trained wearable human activity recognition (WHAR) model can be well adapted to the new user. With the development of…

信号处理 · 电气工程与系统科学 2022-04-28 Ling Chen , Yi Zhang , Shenghuan Miao , Sirou Zhu , Rong Hu , Liangying Peng , Mingqi Lv

The passive body-area electrostatic field has recently been aspiringly explored for wearable motion sensing, harnessing its two thrilling characteristics: full-body motion sensitivity and environmental sensitivity, which potentially…

系统与控制 · 电气工程与系统科学 2025-01-14 Sizhen Bian , Vitor Fortes Rey , Siyu Yuan , Paul Lukowicz

Having been studied for more than a decade, Wi-Fi human sensing still faces a major challenge in the presence of multiple persons, simply because the limited bandwidth of Wi-Fi fails to provide a sufficient range resolution to physically…

网络与互联网体系结构 · 计算机科学 2023-08-22 Jingzhi Hu , Tianyue Zheng , Zhe Chen , Hongbo Wang , Jun Luo

Multimodal Sentiment Analysis (MSA) leverages multiple data modals to analyze human sentiment. Existing MSA models generally employ cutting-edge multimodal fusion and representation learning-based methods to promote MSA capability. However,…

计算与语言 · 计算机科学 2024-12-04 Yijie Jin

Sensor-based human activity recognition is a key technology for many human-centered intelligent applications. However, this research is still in its infancy and faces many unresolved challenges. To address these, we propose a comprehensive…

信号处理 · 电气工程与系统科学 2025-04-08 Hanyu Liu , Ying Yu , Hang Xiao , Siyao Li , Xuze Li , Jiarui Li , Haotian Tang

Multimodal federated learning (FL) aims to enrich model training in FL settings where devices are collecting measurements across multiple modalities (e.g., sensors measuring pressure, motion, and other types of data). However, key…

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

计算与语言 · 计算机科学 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Human activity recognition (HAR) based on multimodal sensors has become a rapidly growing branch of biometric recognition and artificial intelligence. However, how to fully mine multimodal time series data and effectively learn accurate…

计算机视觉与模式识别 · 计算机科学 2022-05-25 Jialiang Wang , Haotian Wei , Yi Wang , Shu Yang , Chi Li

Multi-modal fusion is a basic task of autonomous driving system perception, which has attracted many scholars' interest in recent years. The current multi-modal fusion methods mainly focus on camera data and LiDAR data, but pay little…

机器人学 · 计算机科学 2022-11-14 Yan Gong , Jianli Lu , Jiayi Wu , Wenzhuo Liu

Given the wide adoption of multimodal sensors (e.g., camera, lidar, radar) by autonomous vehicles (AVs), deep analytics to fuse their outputs for a robust perception become imperative. However, existing fusion methods often make two…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Pengfei Hu , Yuhang Qian , Tianyue Zheng , Ang Li , Zhe Chen , Yue Gao , Xiuzhen Cheng , Jun Luo

Wi-Fi sensing leveraging plain-text beamforming feedback information (BFI) in multiple-input-multiple-output (MIMO) systems attracts increasing attention. However, due to the implicit relationship between BFI and the channel state…

信号处理 · 电气工程与系统科学 2024-06-11 Xin Li , Jingzhi Hu , Jun Luo

Developing effective multimodal data fusion strategies has become increasingly essential for improving the predictive power of statistical machine learning methods across a wide range of applications, from autonomous driving to medical…

机器学习 · 计算机科学 2025-07-29 Ziyi Liang , Annie Qu , Babak Shahbaba

Wireless Technology Recognition (WTR) and localization are essential in modern communication systems, enabling efficient spectrum management, seamless coexistence of diverse technologies, and accurate positioning in dynamic environments. In…

信号处理 · 电气工程与系统科学 2025-09-22 Mohammad Cheraghinia , Eli De Poorter , Jaron Fontaine , Merouane Debbah , Adnan Shahid

Remote sensing image super-resolution (RSISR) plays a vital role in enhancing spatial detials and improving the quality of satellite imagery. Recently, Transformer-based models have shown competitive performance in RSISR. To mitigate the…

计算机视觉与模式识别 · 计算机科学 2023-07-07 Yuting Lu , Lingtong Min , Binglu Wang , Le Zheng , Xiaoxu Wang , Yongqiang Zhao , Teng Long

Activity recognition is an important component of many pervasive computing applications. Radio-based activity recognition has the advantage that it does not have the privacy concern and the subjects do not have to carry a device on them.…

网络与互联网体系结构 · 计算机科学 2018-04-26 Bo Wei , Wen Hu , Mingrui Yang , Chun Tung Chou

How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aditya Prakash , Kashyap Chitta , Andreas Geiger