中文
相关论文

相关论文: A Large-Scale Multimodal Dataset and Benchmarks fo…

200 篇论文

Sensor-based human activity recognition (HAR), i.e., the ability to discover human daily activity patterns from wearable or embedded sensors, is a key enabler for many real-world applications in smart homes, personal healthcare, and urban…

信号处理 · 电气工程与系统科学 2021-04-20 Saurav Jha , Martin Schiemer , Franco Zambonelli , Juan Ye

Real-world image classification tasks tend to be complex, where expert labellers are sometimes unsure about the classes present in the images, leading to the issue of learning with noisy labels (LNL). The ill-posedness of the LNL task…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Zheng Zhang , Cuong Nguyen , Kevin Wells , Thanh-Toan Do , Gustavo Carneiro

Understanding and reasoning over diagrams is a fundamental aspect of human intelligence. While Large Multimodal Models (LMMs) have demonstrated impressive capabilities across various tasks, existing benchmarks lack comprehensive evaluation…

计算机视觉与模式识别 · 计算机科学 2025-02-19 Fengji Zhang , Linquan Wu , Huiyu Bai , Guancheng Lin , Xiao Li , Xiao Yu , Yue Wang , Bei Chen , Jacky Keung

Human Activity Recognition (HAR) is a core task in pervasive computing systems, where models must operate under strict computational constraints while remaining robust to heterogeneous and evolving deployment conditions. Recent advances…

机器学习 · 计算机科学 2026-05-13 Aleksandr Bredikhin , Philippe Lalanda , German Vega

Multimodal Large Language Models (MLLMs) are reshaping how modern agentic systems reason over sequential user-behavior data. However, whether textual or image representations of user behavior data are more effective for maximizing MLLM…

人工智能 · 计算机科学 2025-11-07 Tianning Dong , Luyi Ma , Varun Vasudevan , Jason Cho , Sushant Kumar , Kannan Achan

Human Activity Recognition (HAR), based on machine and deep learning algorithms is considered one of the most promising technologies to monitor professional and daily life activities for different categories of people (e.g., athletes,…

信号处理 · 电气工程与系统科学 2024-11-19 Florenc Demrozi , Cristian Turetta , Graziano Pravadelli

Human activity recognition (HAR) is often limited by the scarcity of labeled datasets due to the high cost and complexity of real-world data collection. To mitigate this, recent work has explored generating virtual inertial measurement unit…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Zikang Leng , Archith Iyer , Thomas Plötz

While Multimodal Large Language Models (MLLMs) exhibit strong performance on standard video tasks, their ability to faithfully summarize and reason over complex narratives remains poorly evaluated. Existing summarization benchmarks fragment…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Mengqi Shi , Haopeng Zhang

Anticipating human activities and their durations is essential in applications such as smart-home automation, simulation-based architectural and urban design, activity-based transportation system simulation, and human-robot collaboration,…

计算与语言 · 计算机科学 2026-02-13 Maral Doctorarastoo , Katherine A. Flanigan , Mario Bergés , Christopher McComb

Context-aware Human Activity Recognition (HAR) is a hot research area in mobile computing, and the most effective solutions in the literature are based on supervised deep learning models. However, the actual deployment of these systems is…

机器学习 · 计算机科学 2025-03-24 Luca Arrotta , Claudio Bettini , Gabriele Civitarese , Michele Fiori

Deploying human activity recognition (HAR) at home is still rare because sensor signals vary wildly across houses, people, and time, essentially requiring in-situ data collection and training. Prior approaches use cameras to generate…

Human Activity Recognition has gained significant attention due to its diverse applications, including ambient assisted living and remote sensing. Wearable sensor-based solutions often suffer from user discomfort and reliability issues,…

Human Activity Recognition (HAR) plays a critical role in numerous applications, including healthcare monitoring, fitness tracking, and smart environments. Traditional deep learning (DL) approaches, while effective, often require extensive…

信号处理 · 电气工程与系统科学 2025-11-04 Mohammad Alikhani

Human Activity Recognition (HAR) is a powerful tool for understanding human behaviour. Applying HAR to wearable sensors can provide new insights by enriching the feature set in health studies, and enhance the personalisation and…

Understanding human behavior traits is central to applications in human-computer interaction, computational social science, and personalized AI systems. Such understanding often requires integrating multiple modalities to capture nuanced…

机器学习 · 计算机科学 2026-02-11 Loka Li , Wong Yu Kang , Minghao Fu , Guangyi Chen , Zhenhao Chen , Gongxu Luo , Yuewen Sun , Salman Khan , Peter Spirtes , Kun Zhang

Multimodal Large Language Models (MLLMs) have garnered significant attention for their strong visual-semantic understanding. Most existing chart benchmarks evaluate MLLMs' ability to parse information from charts to answer questions.…

计算与语言 · 计算机科学 2025-03-10 Xiangnan Chen , Yuancheng Fang , Qian Xiao , Juncheng Li , Jun Lin , Siliang Tang , Yi Yang , Yueting Zhuang

Understanding human-to-human interactions, especially in contexts like public security surveillance, is critical for monitoring and maintaining safety. Traditional activity recognition systems are limited by fixed vocabularies, predefined…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Lala Shakti Swarup Ray , Bo Zhou , Sungho Suh , Paul Lukowicz

Visual Language Models (VLMs) are powerful generative tools but often produce factually inaccurate outputs due to a lack of robust reasoning capabilities. While extensive research has been conducted on integrating external knowledge for…

人工智能 · 计算机科学 2025-11-26 Shamima Hossain

Current Large Multimodal Models (LMMs) struggle with high-resolution visual inputs during the reasoning process, as the number of image tokens increases quadratically with resolution, introducing substantial redundancy and irrelevant…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Jiacheng Yang , Anqi Chen , Yunkai Dang , Qi Fan , Cong Wang , Wenbin Li , Feng Miao , Yang Gao

This paper introduces a multi-label visual emotion analysis benchmark dataset for comprehensively evaluating the ability of multimodal large language models (MLLMs) to predict the emotions evoked by images. Recent user studies report an…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Tianwei Chen , Takuya Furusawa , Yuki Hirakawa , Ryotaro Shimizu , Mo Fan , Takashi Wada