English
Related papers

Related papers: MESEN: Exploit Multimodal Data to Design Unimodal …

200 papers

Skeleton-based temporal action segmentation is a fundamental yet challenging task, playing a crucial role in enabling intelligent systems to perceive and respond to human activities. While fully-supervised methods achieve satisfactory…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hongsong Wang , Yiqin Shen , Pengbo Yan , Jie Gui

We address the problem of cross-modal information retrieval in the domain of remote sensing. In particular, we are interested in two application scenarios: i) cross-modal retrieval between panchromatic (PAN) and multi-spectral imagery, and…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Ushasi Chaudhuri , Biplab Banerjee , Avik Bhattacharya , Mihai Datcu

Human Activity Recognition (HAR) is a crucial technology for many applications such as smart homes, surveillance, human assistance and health care. This technology utilises pattern recognition and can contribute to the development of…

Human-Computer Interaction · Computer Science 2022-06-10 Farhad Nazari , Darius Nahavandi , Navid Mohajer , Abbas Khosravi

Human Activity Recognition (HAR) is a powerful tool for understanding human behaviour. Applying HAR to wearable sensors can provide new insights by enriching the feature set in health studies, and enhance the personalisation and…

In the many years since the inception of wearable sensor-based Human Activity Recognition (HAR), a wide variety of methods have been introduced and evaluated for their ability to recognize activities. Substantial gains have been made since…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Harish Haresamudram , Chi Ian Tang , Sungho Suh , Paul Lukowicz , Thomas Ploetz

Human activity recognition (HAR) holds immense potential for transforming health and fitness monitoring, yet challenges persist in achieving personalized outcomes and sustainability for on-device continuous inferences. This work introduces…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Bidyut Saha , Riya Samanta , Soumya K Ghosh , Ram Babu Roy

Multimodal Emotion Recognition (MER) aims to accurately identify human emotional states by integrating heterogeneous modalities such as visual, auditory, and textual data. Existing approaches predominantly rely on unified emotion labels to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Wen Yin , Siyu Zhan , Cencen Liu , Xin Hu , Guiduo Duan , Xiurui Xie , Yuan-Fang Li , Tao He

We describe a novel metric-based learning approach that introduces a multimodal framework and uses deep audio and geophone encoders in siamese configuration to design an adaptable and lightweight supervised model. This framework eliminates…

Sound · Computer Science 2021-11-16 Muhammad Shakeel , Katsutoshi Itoyama , Kenji Nishida , Kazuhiro Nakadai

Prior works in cross-lingual named entity recognition (NER) with no/little labeled data fall into two primary categories: model transfer based and data transfer based methods. In this paper we find that both method types can complement each…

Computation and Language · Computer Science 2020-07-16 Qianhui Wu , Zijia Lin , Börje F. Karlsson , Biqing Huang , Jian-Guang Lou

Human activity recognition has grown in popularity with its increase of applications within daily lifestyles and medical environments. The goal of having efficient and reliable human activity recognition brings benefits such as accessible…

Machine Learning · Computer Science 2022-01-24 Rushit Dave , Naeem Seliya , Mounika Vanamala , Wei Tee

Multimodal sensors provide complementary information to develop accurate machine-learning methods for human activity recognition (HAR), but introduce significantly higher computational load, which reduces efficiency. This paper proposes an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Ziqi Gao , Yuntao Wang , Jianguo Chen , Junliang Xing , Shwetak Patel , Xin Liu , Yuanchun Shi

Multimodal Sentiment Analysis (MSA) aims to recognize human emotions by exploiting textual, acoustic, and visual modalities, and thus how to make full use of the interactions between different modalities is a central challenge of MSA.…

Computation and Language · Computer Science 2025-02-17 Yubo Gao , Haotian Wu , Lei Zhang

Learning and understanding the typical patterns in the daily activities and routines of people from low-level sensory data is an important problem in many application domains such as building smart environments, or providing intelligent…

Machine Learning · Computer Science 2014-08-14 Truyen Tran , Hung Bui , Svetha Venkatesh

With the widespread adoption of millimeter-wave (mmWave) massive multi-input-multi-output (MIMO) in vehicular networks, accurate beam prediction and alignment have become critical for high-speed data transmission and reliable access. While…

Information Theory · Computer Science 2026-03-27 Chenyiming Wen , Binpu Shi , Min Li , Ming-Min Zhao , Min-Jian Zhao , Jiangzhou Wang

In this work, we tackle the problem of performing multi-label classification in the case of extremely heterogeneous data and with decentralized Machine Learning. Solving this issue is very important in IoT scenarios, where data coming from…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Rastko Gajanin , Anastasiya Danilenka , Andrea Morichetta , Stefan Nastic

A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is an expensive task, unsupervised and semi-supervised learning…

Machine Learning · Computer Science 2022-02-03 Yash Jain , Chi Ian Tang , Chulhong Min , Fahim Kawsar , Akhil Mathur

In smart healthcare, Human Activity Recognition (HAR) is considered to be an efficient model in pervasive computation from sensor readings. The Ambient Assisted Living (AAL) in the home or community helps the people in providing independent…

Machine Learning · Computer Science 2021-11-22 Pankaj Khatiwada , Ayan Chatterjee , Matrika Subedi

Processing sequential multi-sensor data becomes important in many tasks due to the dramatic increase in the availability of sensors that can acquire sequential data over time. Human Activity Recognition (HAR) is one of the fields which are…

Machine Learning · Computer Science 2020-11-24 Zeyd Boukhers , Danniene Wete , Steffen Staab

Incomplete multi-modal emotion recognition (IMER) aims at understanding human intentions and sentiments by comprehensively exploring the partially observed multi-source data. Although the multi-modal data is expected to provide more…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Wen-Jue He , Xiaofeng Zhu , Zheng Zhang

Batteryless or so called passive wearables are providing new and innovative methods for human activity recognition (HAR), especially in healthcare applications for older people. Passive sensors are low cost, lightweight, unobtrusive and…

Machine Learning · Computer Science 2019-06-07 Alireza Abedin , S. Hamid Rezatofighi , Qinfeng Shi , Damith C. Ranasinghe