English
Related papers

Related papers: MESEN: Exploit Multimodal Data to Design Unimodal …

200 papers

The embedded sensors in widely used smartphones and other wearable devices make the data of human activities more accessible. However, recognizing different human activities from the wearable sensor data remains a challenging research…

Machine Learning · Computer Science 2023-07-25 Taoran Sheng , Manfred Huber

Multimodal sentiment analysis aims to effectively integrate information from various sources to infer sentiment, where in many cases there are no annotations for unimodal labels. Therefore, most works rely on multimodal labels for training.…

Machine Learning · Computer Science 2024-09-16 Sijie Mai , Yu Zhao , Ying Zeng , Jianhua Yao , Haifeng Hu

The field of Human Activity Recognition (HAR) focuses on obtaining and analysing data captured from monitoring devices (e.g. sensors). There is a wide range of applications within the field; for instance, assisted living, security…

Machine Learning · Computer Science 2020-05-18 Flávia Alves , Martin Gairing , Frans A. Oliehoek , Thanh-Toan Do

Training multimodal models requires a large amount of labeled data. Active learning (AL) aim to reduce labeling costs. Most AL methods employ warm-start approaches, which rely on sufficient labeled data to train a well-calibrated model that…

Multimedia · Computer Science 2024-12-13 Meng Shen , Yake Wei , Jianxiong Yin , Deepu Rajan , Di Hu , Simon See

With the development of deep learning techniques, supervised learning has achieved performances surpassing those of humans. Researchers have designed numerous corresponding models for different data modalities, achieving excellent results…

Artificial Intelligence · Computer Science 2023-08-29 Qiang Li , Qiuyang Ma , Weizhi Nie , Anan Liu

Despite living in a multi-sensory world, most AI models are limited to textual and visual understanding of human motion and behavior. In fact, full situational awareness of human motion could best be understood through a combination of…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Abhi Kamboj , Minh Do

Human activity recognition (HAR) is a very active research field. Recently, deep learning techniques are being exploited to recognize human activities from inertial signals. However, to compute accurate and reliable deep learning models, a…

Computers and Society · Computer Science 2019-05-30 Anna Ferrari , Daniela Micucci , Marco Mobilio , Paolo Napoletano

Human activity recognition (HAR) based on mobile sensors plays an important role in ubiquitous computing. However, the rise of data regulatory constraints precludes collecting private and labeled signal data from personal devices at scale.…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Chenglin Li , Di Niu , Bei Jiang , Xiao Zuo , Jianming Yang

Sensor-based human activity recognition (HAR) is now a research hotspot in multiple application areas. With the rise of smart wearable devices equipped with inertial measurement units (IMUs), researchers begin to utilize IMU data for HAR.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Fanyi Xiao , Ling Pei , Lei Chu , Danping Zou , Wenxian Yu , Yifan Zhu , Tao Li

Deep learning methods are successfully used in applications pertaining to ubiquitous computing, health, and well-being. Specifically, the area of human activity recognition (HAR) is primarily transformed by the convolutional and recurrent…

Machine Learning · Computer Science 2019-07-30 Aaqib Saeed , Tanir Ozcelebi , Johan Lukkien

Multimodal emotion recognition (MER) aims to detect the emotional status of a given expression by combining the speech and text information. Intuitively, label information should be capable of helping the model locate the salient…

Computation and Language · Computer Science 2023-09-06 Peiying Wang , Sunlu Zeng , Junqing Chen , Lu Fan , Meng Chen , Youzheng Wu , Xiaodong He

While the widely available embedded sensors in smartphones and other wearable devices make it easier to obtain data of human activities, recognizing different types of human activities from sensor-based data remains a difficult research…

Signal Processing · Electrical Eng. & Systems 2024-08-15 Taoran Sheng , Manfred Huber

To properly assist humans in their needs, human activity recognition (HAR) systems need the ability to fuse information from multiple modalities. Our hypothesis is that multimodal sensors, visual and non-visual tend to provide complementary…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Hyeongju Choi , Apoorva Beedu , Harish Haresamudram , Irfan Essa

Human Activity Recognition (HAR) from wearable sensor data identifies movements or activities in unconstrained environments. HAR is a challenging problem as it presents great variability across subjects. Obtaining large amounts of labelled…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Arttu Lämsä , Jaakko Tervonen , Jussi Liikka , Constantino Álvarez Casado , Miguel Bordallo López

The proliferation of IoT and mobile devices equipped with heterogeneous sensors has enabled new applications that rely on the fusion of time-series data generated by multiple sensors with different modalities. While there are promising deep…

Machine Learning · Computer Science 2023-03-09 Sanju Xaviar , Xin Yang , Omid Ardakanian

Human activity recognition (HAR) is an essential research field that has been used in different applications including home and workplace automation, security and surveillance as well as healthcare. Starting from conventional machine…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Rebeen Ali Hamad , Wai Lok Woo , Bo Wei , Longzhi Yang

Human activity recognition (HAR) is a long-standing problem in artificial intelligence with applications in a broad range of areas, including healthcare, sports and fitness, security, and more. The performance of HAR in real-world settings…

Human Activity Recognition (HAR) has been studied for decades, from data collection, learning models, to post-processing and result interpretations. However, the inherent hierarchy in the activities remains relatively under-explored,…

Signal Processing · Electrical Eng. & Systems 2024-03-12 Jingwei Zuo , Hakim Hacid

There has been much recent research on human activity re\-cog\-ni\-tion (HAR), due to the proliferation of wearable sensors in watches and phones, and the advances of deep learning methods, which avoid the need to manually extract features…

Machine Learning · Computer Science 2022-09-20 Louis Mahon , Thomas Lukasiewicz

Sensor-based Human Activity Recognition (HAR) is crucial in ubiquitous computing, analysing behaviours through multi-dimensional observations. Despite research progress, HAR confronts challenges, particularly in data distribution…

Signal Processing · Electrical Eng. & Systems 2025-03-05 Xiaozhou Ye , Kouichi Sakurai , Nirmal Nair , Kevin I-Kai Wang