English
Related papers

Related papers: MMTSA: Multimodal Temporal Segment Attention Netwo…

200 papers

Ambient sensor-based human activity recognition (HAR) in smart homes remains challenging due to the need for real-time inference, spatially grounded reasoning, and context-aware temporal modeling. Existing approaches often rely on…

Machine Learning · Computer Science 2025-11-11 Zishuai Liu , Weihang You , Jin Lu , Fei Dou

The precise detection of mild cognitive impairment (MCI) is of significant importance in preventing the deterioration of patients in a timely manner. Although hypergraphs have enhanced performance by learning and analyzing brain networks,…

Machine Learning · Computer Science 2025-01-14 Manman Yuan , Weiming Jia , Xiong Luo , Jiazhen Ye , Peican Zhu , Junlin Li

Real-time recognition and prediction of surgical activities are fundamental to advancing safety and autonomy in robot-assisted surgery. This paper presents a multimodal transformer architecture for real-time recognition and prediction of…

Robotics · Computer Science 2024-10-27 Keshara Weerasinghe , Seyed Hamid Reza Roodabeh , Kay Hutchinson , Homa Alemzadeh

In a human-centered intelligent manufacturing system, sensing and understanding of the worker's activity are the primary tasks. In this paper, we propose a novel multi-modal approach for worker activity recognition by leveraging information…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Wenjin Tao , Ming C. Leu , Zhaozheng Yin

Human activity recognition (HAR) is essential in healthcare, elder care, security, and human-computer interaction. The use of precise sensor data to identify activities passively and continuously makes HAR accessible and ubiquitous.…

Human-Computer Interaction · Computer Science 2024-08-01 Argha Sen , Anirban Das , Swadhin Pradhan , Sandip Chakraborty

Human activity recognition (HAR) holds significant importance in smart homes, security, and healthcare. Existing systems face limitations because of the insufficient spatial diversity provided by a limited number of antennas. Furthermore,…

Systems and Control · Electrical Eng. & Systems 2024-10-04 Junshuo Liu , Yunlong Huang , Wei Yang , Zhe Li , Rujing Xiong , Tiebin Mi , Xin Shi , Robert C. Qiu

Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shu-Chuan Chu , Zhi-Chao Dou , Jeng-Shyang Pan , Shaowei Weng , Junbao Li

In the realm of smart sensing with the Internet of Things, earable devices are empowered with the capability of multi-modality sensing and intelligence of context-aware computing, leading to its wide usage in Human Activity Recognition…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Shengzhe Lyu , Yongliang Chen , Di Duan , Renqi Jia , Weitao Xu

The field of Human Activity Recognition (HAR) focuses on obtaining and analysing data captured from monitoring devices (e.g. sensors). There is a wide range of applications within the field; for instance, assisted living, security…

Machine Learning · Computer Science 2020-05-18 Flávia Alves , Martin Gairing , Frans A. Oliehoek , Thanh-Toan Do

Intelligent Reflecting Surfaces (IRSs) are a promising technology for enhancing the spectral and energy efficiency of millimeter-wave (mmWave) multiple-input multiple-output (MIMO) systems. In these systems, accurate channel estimation…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Mehrdad Momen-Tayefeh , Mehrshad Momen-Tayefeh , Maryam Sabbaghian

Multispectral pedestrian detection has gained significant attention in recent years, particularly in autonomous driving applications. To address the challenges posed by adversarial illumination conditions, the combination of thermal and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Arunkumar Rathinam , Leo Pauly , Abd El Rahman Shabayek , Wassim Rharbaoui , Anis Kacem , Vincent Gaudillière , Djamila Aouada

In the last decade, Human Activity Recognition (HAR) has become a vibrant research area, especially due to the spread of electronic devices such as smartphones, smartwatches and video cameras present in our daily lives. In addition, the…

Signal Processing · Electrical Eng. & Systems 2020-11-20 Florenc Demrozi , Graziano Pravadelli , Azra Bihorac , Parisa Rashidi

Multi-point tracking is a challenging task that involves detecting points in the scene and tracking them across a sequence of frames. Computing detection-based measures like the F-measure on a frame-by-frame basis is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Lalith Sharan , Halvar Kelm , Gabriele Romano , Matthias Karck , Raffaele De Simone , Sandy Engelhardt

Automated food intake gesture detection plays a vital role in dietary monitoring, enabling objective and continuous tracking of eating behaviors to support better health outcomes. Wrist-worn inertial measurement units (IMUs) have been…

Machine Learning · Computer Science 2025-07-11 Chunzhuo Wang , Hans Hallez , Bart Vanrumste

The combination of increased life expectancy and falling birth rates is resulting in an aging population. Wearable Sensor-based Human Activity Recognition (WSHAR) emerges as a promising assistive technology to support the daily lives of…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Jianyuan Ni , Hao Tang , Syed Tousiful Haque , Yan Yan , Anne H. H. Ngu

Due to the severe lack of labeled data, existing methods of medical visual question answering usually rely on transfer learning to obtain effective image feature representation and use cross-modal fusion of visual and linguistic features to…

Multimedia · Computer Science 2021-05-04 Haifan Gong , Guanqi Chen , Sishuo Liu , Yizhou Yu , Guanbin Li

Remote sensing images often suffer from substantial data loss due to factors such as thick cloud cover and sensor limitations. Existing methods for imputing missing values in remote sensing images fail to fully exploit spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Zaiyan Zhang , Jining Yan , Yuanqi Liang , Jiaxin Feng , Haixu He , Li Cao

In an aging population, elderly patient safety is a primary concern at hospitals and nursing homes, which demands for increased nurse care. By performing nurse activity recognition, we can not only make sure that all patients get an equal…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Momal Ijaz , Renato Diaz , Chen Chen

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

The prompt and accurate recognition of Continuous Human Activity (CHAR) is critical in identifying and responding to health events, particularly fall risk assessment. In this paper, we examine a multi-antenna radar system that can process…

Image and Video Processing · Electrical Eng. & Systems 2023-04-14 John Kobak , Bennett J. Richman , LaJuan Washington , Syed A. Hamza