English
Related papers

Related papers: A Large-Scale Multimodal Dataset and Benchmarks fo…

200 papers

Sensor-based human activity recognition (HAR), i.e., the ability to discover human daily activity patterns from wearable or embedded sensors, is a key enabler for many real-world applications in smart homes, personal healthcare, and urban…

Signal Processing · Electrical Eng. & Systems 2021-04-20 Saurav Jha , Martin Schiemer , Franco Zambonelli , Juan Ye

Real-world image classification tasks tend to be complex, where expert labellers are sometimes unsure about the classes present in the images, leading to the issue of learning with noisy labels (LNL). The ill-posedness of the LNL task…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Zheng Zhang , Cuong Nguyen , Kevin Wells , Thanh-Toan Do , Gustavo Carneiro

Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across various tasks, existing benchmarks lack comprehensive evaluation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Fengji Zhang , Linquan Wu , Huiyu Bai , Guancheng Lin , Xiao Li , Xiao Yu , Yue Wang , Bei Chen , Jacky Keung

Human Activity Recognition (HAR) is a core task in pervasive computing systems, where models must operate under strict computational constraints while remaining robust to heterogeneous and evolving deployment conditions. Recent advances…

Machine Learning · Computer Science 2026-05-13 Aleksandr Bredikhin , Philippe Lalanda , German Vega

Multimodal Large Language Models (MLLMs) are reshaping how modern agentic systems reason over sequential user-behavior data. However, whether textual or image representations of user behavior data are more effective for maximizing MLLM…

Artificial Intelligence · Computer Science 2025-11-07 Tianning Dong , Luyi Ma , Varun Vasudevan , Jason Cho , Sushant Kumar , Kannan Achan

Human Activity Recognition (HAR), based on machine and deep learning algorithms is considered one of the most promising technologies to monitor professional and daily life activities for different categories of people (e.g., athletes,…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Florenc Demrozi , Cristian Turetta , Graziano Pravadelli

Human activity recognition (HAR) is often limited by the scarcity of labeled datasets due to the high cost and complexity of real-world data collection. To mitigate this, recent work has explored generating virtual inertial measurement unit…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zikang Leng , Archith Iyer , Thomas Plötz

While Multimodal Large Language Models (MLLMs) exhibit strong performance on standard video tasks, their ability to faithfully summarize and reason over complex narratives remains poorly evaluated. Existing summarization benchmarks fragment…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Mengqi Shi , Haopeng Zhang

Anticipating human activities and their durations is essential in applications such as smart-home automation, simulation-based architectural and urban design, activity-based transportation system simulation, and human-robot collaboration,…

Computation and Language · Computer Science 2026-02-13 Maral Doctorarastoo , Katherine A. Flanigan , Mario Bergés , Christopher McComb

Context-aware Human Activity Recognition (HAR) is a hot research area in mobile computing, and the most effective solutions in the literature are based on supervised deep learning models. However, the actual deployment of these systems is…

Machine Learning · Computer Science 2025-03-24 Luca Arrotta , Claudio Bettini , Gabriele Civitarese , Michele Fiori

Deploying human activity recognition (HAR) at home is still rare because sensor signals vary wildly across houses, people, and time, essentially requiring in-situ data collection and training. Prior approaches use cameras to generate…

Human Activity Recognition has gained significant attention due to its diverse applications, including ambient assisted living and remote sensing. Wearable sensor-based solutions often suffer from user discomfort and reliability issues,…

Human Activity Recognition (HAR) plays a critical role in numerous applications, including healthcare monitoring, fitness tracking, and smart environments. Traditional deep learning (DL) approaches, while effective, often require extensive…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Mohammad Alikhani

Human Activity Recognition (HAR) is a powerful tool for understanding human behaviour. Applying HAR to wearable sensors can provide new insights by enriching the feature set in health studies, and enhance the personalisation and…

Understanding human behavior traits is central to applications in human-computer interaction, computational social science, and personalized AI systems. Such understanding often requires integrating multiple modalities to capture nuanced…

Machine Learning · Computer Science 2026-02-11 Loka Li , Wong Yu Kang , Minghao Fu , Guangyi Chen , Zhenhao Chen , Gongxu Luo , Yuewen Sun , Salman Khan , Peter Spirtes , Kun Zhang

Multimodal Large Language Models (MLLMs) have garnered significant attention for their strong visual-semantic understanding. Most existing chart benchmarks evaluate MLLMs' ability to parse information from charts to answer questions.…

Computation and Language · Computer Science 2025-03-10 Xiangnan Chen , Yuancheng Fang , Qian Xiao , Juncheng Li , Jun Lin , Siliang Tang , Yi Yang , Yueting Zhuang

Understanding human-to-human interactions, especially in contexts like public security surveillance, is critical for monitoring and maintaining safety. Traditional activity recognition systems are limited by fixed vocabularies, predefined…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Lala Shakti Swarup Ray , Bo Zhou , Sungho Suh , Paul Lukowicz

Visual Language Models (VLMs) are powerful generative tools but often produce factually inaccurate outputs due to a lack of robust reasoning capabilities. While extensive research has been conducted on integrating external knowledge for…

Artificial Intelligence · Computer Science 2025-11-26 Shamima Hossain

Current Large Multimodal Models (LMMs) struggle with high-resolution visual inputs during the reasoning process, as the number of image tokens increases quadratically with resolution, introducing substantial redundancy and irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiacheng Yang , Anqi Chen , Yunkai Dang , Qi Fan , Cong Wang , Wenbin Li , Feng Miao , Yang Gao

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada