English
Related papers

Related papers: RoboMNIST: A Multimodal Dataset for Multi-Robot Ac…

200 papers

Anatomical movements of the human body can change the channel state information (CSI) of wireless signals in an indoor environment. These changes in the CSI signals can be used for human activity recognition (HAR), which is a predominant…

Human-Computer Interaction · Computer Science 2022-05-04 Hojjat Salehinejad , Shahrokh Valaee

We address the challenge of WiFi-based temporal activity detection and propose an efficient Dual Pyramid Network that integrates Temporal Signal Semantic Encoders and Local Sensitive Response Encoders. The Temporal Signal Semantic Encoder…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Zhendong Liu , Le Zhang , Bing Li , Yingjie Zhou , Zhenghua Chen , Ce Zhu

Human Activity Recognition (HAR) research has gained significant momentum due to recent technological advancements, artificial intelligence algorithms, the need for smart cities, and socioeconomic transformation. However, existing computer…

Machine Learning · Computer Science 2023-05-10 Md. Mohi Uddin Khan , Abdullah Bin Shams , Md. Mohsin Sarker Raihan

Human Activity Recognition (HAR) is a challenging problem that needs advanced solutions than using handcrafted features to achieve a desirable performance. Deep learning has been proposed as a solution to obtain more accurate HAR systems…

Machine Learning · Computer Science 2020-07-08 Hamed Damirchi , Rooholla Khorrambakht , Hamid Taghirad

Current learning-based wireless methods struggle with generalization due to the fragmented processing of communication and sensing data. WiFo-MiSAC addresses this as a task-agnostic foundation model that tokenizes heterogeneous signals into…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Xuanyu Liu , Shijian Gao , Boxun Liu , Xiang Cheng , Liuqing Yang

The number of wireless devices is drastically increasing, resulting in many devices contending for radio resources. In this work, we present an algorithm to detect active devices for unsourced random access, i.e., the devices are…

Information Theory · Computer Science 2023-01-13 Gilles Callebaut , François Rottenberg , Liesbet Van der Perre , Erik G. Larsson

Recognizing speaking in humans is a central task towards understanding social interactions. Ideally, speaking would be detected from individual voice recordings, as done previously for meeting scenarios. However, individual voice recordings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jose Vargas Quiros , Chirag Raman , Stephanie Tan , Ekin Gedik , Laura Cabrera-Quiros , Hayley Hung

The application of activity recognition in the ``AI + Education" field is gaining increasing attention. However, current work mainly focuses on the recognition of activities in manually captured videos and a limited number of activity…

Multimodal emotion recognition (MER) in practical scenarios is significantly challenged by the presence of missing or incomplete data across different modalities. To overcome these challenges, researchers have aimed to simulate incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Qi Fan , Haolin Zuo , Rui Liu , Zheng Lian , Guanglai Gao

Activity recognition is very useful in scenarios where robots interact with, monitor or assist humans. In the past years many types of activities -- single actions, two persons interactions or ego-centric activities, to name a few -- have…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Ilaria Gori , J. K. Aggarwal , Larry Matthies , Michael S. Ryoo

We present a synchronized multisensory dataset for accurate and robust indoor localization: the Lund University Vision, Radio, and Audio (LuViRA) Dataset. The dataset includes color images, corresponding depth maps, inertial measurement…

Automatic emotion recognition has become increasingly important with the rise of AI, especially in fields like healthcare, education, and automotive systems. However, there is a lack of multimodal datasets, particularly involving body…

Artificial Intelligence · Computer Science 2025-09-09 Seyed Muhammad Hossein Mousavi , Atiye Ilanloo

Human Activity Recognition (HAR) from wearable sensor data identifies movements or activities in unconstrained environments. HAR is a challenging problem as it presents great variability across subjects. Obtaining large amounts of labelled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Arttu Lämsä , Jaakko Tervonen , Jussi Liikka , Constantino Álvarez Casado , Miguel Bordallo López

WiFi channel state information (CSI) has emerged as a plausible modality for sensing different human vital signs, i.e. respiration and body motion, as a function of modulated wireless signals that travel between WiFi devices. Although a…

Signal Processing · Electrical Eng. & Systems 2020-03-23 Kamran Ali , Mohammed Alloulah , Fahim Kawsar , Alex X. Liu

Recent advances in Multimodal Large Language Models (MLLMs) have driven rapid progress in Vision-Language-Action (VLA) models for robotic manipulation. Although effective in many scenarios, current approaches largely rely on explicit…

Recent advances in foundation models have shown promising results in developing generalist robotics that can perform diverse tasks in open-ended scenarios given multimodal inputs. However, current work has been mainly focused on indoor,…

Artificial Intelligence · Computer Science 2026-01-27 Yan Zhuang , Jiawei Ren , Xiaokang Ye , Jianzhi Shen , Ruixuan Zhang , Tianai Yue , Muhammad Faayez , Xuhong He , Ziqiao Ma , Lianhui Qin , Zhiting Hu , Tianmin Shu

Interactions with electronic devices are changing in our daily lives. The day-to-day development brings curiosity to recent technology and challenges its use. The gadgets are becoming cumbersome, and their usage frustrates a segment of…

Human-Computer Interaction · Computer Science 2024-04-25 Tauheed Khan Mohd , Ahmad Y Javaid

With the widespread adoption of millimeter-wave (mmWave) massive multi-input-multi-output (MIMO) in vehicular networks, accurate beam prediction and alignment have become critical for high-speed data transmission and reliable access. While…

Information Theory · Computer Science 2026-03-27 Chenyiming Wen , Binpu Shi , Min Li , Ming-Min Zhao , Min-Jian Zhao , Jiangzhou Wang

Motivated by the growing interest in integrated sensing and communication for 6th generation (6G) networks, this paper presents a cognitive Multiple-Input Multiple-Output (MIMO) radar system enhanced by reinforcement learning (RL) for…

Signal Processing · Electrical Eng. & Systems 2025-02-10 Adam Umra , Aya Mostafa Ahmed , Aydin Sezgin

In this paper we develop the analytical framework for a novel Wireless signal-based Sensing capability for Robotics (WSR) by leveraging robots' mobility. It allows robots to primarily measure relative direction, or Angle-of-Arrival (AOA),…

Robotics · Computer Science 2023-09-06 Ninad Jadhav , Weiying Wang , Diana Zhang , Oussama Khatib , Swarun Kumar , Stephanie Gil