English
Related papers

Related papers: A Large-Scale Multimodal Dataset and Benchmarks fo…

200 papers

The main streams of human activity recognition (HAR) algorithms are developed based on RGB cameras which are suffered from illumination, fast motion, privacy-preserving, and large energy consumption. Meanwhile, the biologically inspired…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Xiao Wang , Zongzhen Wu , Bo Jiang , Zhimin Bao , Lin Zhu , Guoqi Li , Yaowei Wang , Yonghong Tian

In this paper, we propose an LLM-Guided Exemplar Selection framework to address a key limitation in state-of-the-art Human Activity Recognition (HAR) methods: their reliance on large labeled datasets and purely geometric exemplar selection,…

Computation and Language · Computer Science 2026-01-05 Elsen Ronando , Sozo Inoue

Human Activity Recognition (HAR) is considered a valuable research topic in the last few decades. Different types of machine learning models are used for this purpose, and this is a part of analyzing human behavior through machines. It is…

Machine Learning · Computer Science 2021-03-31 Jakaria Rabbi , Md. Tahmid Hasan Fuad , Md. Abdul Awal

Human-scene vision-language tasks are increasingly prevalent in diverse social applications, yet recent advancements predominantly rely on models specifically tailored to individual tasks. Emerging research indicates that large…

Artificial Intelligence · Computer Science 2024-11-06 Dawei Dai , Xu Long , Li Yutang , Zhang Yuanhui , Shuyin Xia

Human activity recognition (HAR) using inertial measurement units (IMUs) increasingly leverages large language models (LLMs), yet existing approaches focus on coarse activities like walking or running. Our preliminary study indicates that…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Lilin Xu , Kaiyuan Hou , Xiaofan Jiang

MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal dataset, implemented to benchmark Human Activity Recognition(HAR) and Multi-modal Fusion algorithms. Collection of this dataset was inspired by the need for recognising and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Anjana Wijekoon , Nirmalie Wiratunga , Kay Cooper

Human activity recognition (HAR) is a long-standing problem in artificial intelligence with applications in a broad range of areas, including healthcare, sports and fitness, security, and more. The performance of HAR in real-world settings…

Multimodal Large Language Models (MLLMs) have demonstrated significant advances in visual understanding tasks. However, their capacity to comprehend human-centric scenes has rarely been explored, primarily due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Yuansen Liu , Haiming Tang , Jinlong Peng , Jiangning Zhang , Xiaozhong Ji , Qingdong He , Wenbin Wu , Donghao Luo , Zhenye Gan , Junwei Zhu , Yunhang Shen , Chaoyou Fu , Chengjie Wang , Xiaobin Hu , Shuicheng Yan

Recognizing human activities from multi-channel time series data collected from wearable sensors is ever more practical. However, in real-world conditions, coherent activities and body movements could happen at the same time, like moving…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Liming Zhang

We consider human activity recognition (HAR) from wearable sensor data in manual-work processes, like warehouse order-picking. Such structured domains can often be partitioned into distinct process steps, e.g., packaging or transporting.…

Signal Processing · Electrical Eng. & Systems 2021-11-09 Stefan Lüdtke , Fernando Moya Rueda , Waqas Ahmed , Gernot A. Fink , Thomas Kirste

Human activity recognition (HAR) is essential for effective Human-Robot Collaboration (HRC), enabling robots to interpret and respond to human actions. This study evaluates the ability of a vision-based tactile sensor to classify 15…

Recent Multi-modal Large Language Models (MLLMs) have made great progress in video understanding. However, their performance on videos involving human actions is still limited by the lack of high-quality data. To address this, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xiao Wang , Jingyun Hua , Weihong Lin , Yuanxing Zhang , Fuzheng Zhang , Jianlong Wu , Di Zhang , Liqiang Nie

Despite the fact that many 3D human activity benchmarks being proposed, most existing action datasets focus on the action recognition tasks for the segmented videos. There is a lack of standard large-scale benchmarks, especially for current…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Chunhui Liu , Yueyu Hu , Yanghao Li , Sijie Song , Jiaying Liu

Recent multimodal large language models (MLLMs) show strong capabilities in visual-language reasoning, yet their performance on ultra-high-resolution imagery remains largely unexplored. Existing visual question answering (VQA) benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Siqi Li , Xinyu Cai , Jianbiao Mei , Nianchen Deng , Pinlong Cai , Licheng Wen , Yufan Shen , Xuemeng Yang , Botian Shi , Yong Liu

Human Activity Recognition (HAR) describes the machines ability to recognize human actions. Nowadays, most people on earth are health conscious, so people are more interested in tracking their daily activities using Smartphones or Smart…

Machine Learning · Computer Science 2022-05-23 Sanku Satya Uday , Satti Thanuja Pavani , T. Jaya Lakshmi , Rohit Chivukula

Human activity recognition (HAR) in ubiquitous computing has been beginning to incorporate attention into the context of deep neural networks (DNNs), in which the rich sensing data from multimodal sensors such as accelerometer and gyroscope…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Wenbin Gao , Lei Zhang , Qi Teng , Jun He , Hao Wu

Large Language Models (LLMs) have emerged as foundation models for IoT applications such as human activity recognition (HAR). However, directly applying high-frequency and multi-dimensional sensor data, such as eye-tracking data, leads to…

Human-Computer Interaction · Computer Science 2026-04-14 Jae Young Choi , Seon Gyeom Kim , Hyungjun Yoon , Taeckyung Lee , Donggun Lee , Jaeryung Chung , Jihyung Kil , Ryan Rossi , Sung-Ju Lee , Tak Yeon Lee

As generative AI continues to evolve, Vision Language Models (VLMs) have emerged as promising tools in various healthcare applications. One area that remains relatively underexplored is their use in human activity recognition (HAR) for…

Computation and Language · Computer Science 2025-11-18 Abderrazek Abid , Thanh-Cong Ho , Fakhri Karray

Reinforcement learning in large reasoning models enables learning from feedback on their outputs, making it particularly valuable in scenarios where fine-tuning data is limited. However, its application in multi-modal human activity…

Robotics · Computer Science 2025-08-15 Wenqi Zheng , Yutaka Arakawa

Multimodal large language models (MLLMs) demonstrate strong perception and reasoning performance on existing remote sensing (RS) benchmarks. However, most prior benchmarks rely on low-resolution imagery, and some high-resolution benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yunkai Dang , Meiyi Zhu , Donghao Wang , Yizhuo Zhang , Jiacheng Yang , Qi Fan , Yuekun Yang , Wenbin Li , Feng Miao , Yang Gao