English
Related papers

Related papers: On-device Large Multi-modal Agent for Human Activi…

200 papers

With the rapid development of the internet of things (IoT) and artificial intelligence (AI) technologies, human activity recognition (HAR) has been applied in a variety of domains such as security and surveillance, human-robot interaction,…

Human-Computer Interaction · Computer Science 2023-01-19 Rex Liu , Albara Ah Ramli , Huanle Zhang , Erik Henricson , Xin Liu

This work leverages Large Language Models (LLMs) to simulate human mobility, addressing challenges like high costs and privacy concerns in traditional models. Our hierarchical framework integrates persona generation, activity selection, and…

Artificial Intelligence · Computer Science 2025-02-27 Chenlu Ju , Jiaxin Liu , Shobhit Sinha , Hao Xue , Flora Salim

Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for…

Artificial Intelligence · Computer Science 2024-04-23 Zeyu Zhang , Xiaohe Bo , Chen Ma , Rui Li , Xu Chen , Quanyu Dai , Jieming Zhu , Zhenhua Dong , Ji-Rong Wen

Recently, the astonishing performance of large language models (LLMs) in natural language comprehension and generation tasks triggered lots of exploration of using them as central controllers to build agent systems. Multiple studies focus…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Chenyu Wang , Weixin Luo , Sixun Dong , Xiaohua Xuan , Zhengxin Li , Lin Ma , Shenghua Gao

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

The emergence of Large Language Models (LLMs) has reshaped agent systems. Unlike traditional rule-based agents with limited task scope, LLM-powered agents offer greater flexibility, cross-domain reasoning, and natural language interaction.…

Artificial Intelligence · Computer Science 2026-05-05 Guannan Liang , Qianqian Tong

Human Activity Recognition (HAR) has recently witnessed advancements with Transformer-based models. Especially, ActionFormer shows us a new perspectives for HAR in the sense that this approach gives us additional outputs which detect the…

Machine Learning · Computer Science 2025-05-28 Kunpeng Zhao , Asahi Miyazaki , Tsuyoshi Okita

Human Activity Recognition using time-series data from wearable sensors poses unique challenges due to complex temporal dependencies, sensor noise, placement variability, and diverse human behaviors. These factors, combined with the…

Human-Computer Interaction · Computer Science 2024-12-12 Daniel Geissler , Bo Zhou , Paul Lukowicz

Intelligent agents stand out as a potential path toward artificial general intelligence (AGI). Thus, researchers have dedicated significant effort to diverse implementations for them. Benefiting from recent progress in large language models…

Artificial Intelligence · Computer Science 2024-01-09 Yuheng Cheng , Ceyao Zhang , Zhengwen Zhang , Xiangrui Meng , Sirui Hong , Wenhao Li , Zihao Wang , Zekai Wang , Feng Yin , Junhua Zhao , Xiuqiang He

Human Activity Recognition (HAR) has been a popular research field due to the widespread of devices with sensors and computational power (e.g., smartphones and smartwatches). Applications for HAR systems have been extensively researched in…

Human-Computer Interaction · Computer Science 2023-08-28 Paulo J. S. Ferreira , João Mendes Moreira , João M. P. Cardoso

While server-side Large Language Models (LLMs) demonstrate proficiency in function calling and complex reasoning, deploying Small Language Models (SLMs) directly on devices brings opportunities to improve latency and privacy but also…

Computation and Language · Computer Science 2024-10-15 Yicheng Fu , Raviteja Anantha , Jianpeng Cheng

This article explores the dynamic influence of computational entities based on multi-agent systems theory (SMA) combined with large language models (LLM), which are characterized by their ability to simulate complex human interactions, as a…

Artificial Intelligence · Computer Science 2024-03-18 Carlos Jose Xavier Cruz

The recent breakthroughs in the research on Large Language Models (LLMs) have triggered a transformation across several research domains. Notably, the integration of LLMs has greatly enhanced performance in robot Task And Motion Planning…

Robotics · Computer Science 2024-06-12 Yuchen Liu , Luigi Palmieri , Sebastian Koch , Ilche Georgievski , Marco Aiello

Our research investigates the capability of modern multimodal reasoning models, powered by Large Language Models (LLMs), to facilitate vision-powered assistants for multi-step daily activities. Such assistants must be able to 1) encode…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Mrinal Verghese , Brian Chen , Hamid Eghbalzadeh , Tushar Nagarajan , Ruta Desai

Despite advances in practical and multimodal fine-grained Human Activity Recognition (HAR), a system that runs entirely on smartwatches in unconstrained environments remains elusive. We present WatchHAR, an audio and inertial-based HAR…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Taeyoung Yeon , Vasco Xu , Henry Hoffmann , Karan Ahuja

Unobtrusive and smart recognition of human activities using smartphones inertial sensors is an interesting topic in the field of artificial intelligence acquired tremendous popularity among researchers, especially in recent years. A…

Machine Learning · Computer Science 2021-09-21 Meysam Vakili , Masoumeh Rezaei

Enhancing fuel efficiency in public transportation requires the integration of complex multimodal data into interpretable, decision-relevant insights. However, traditional analytics and visualization methods often yield fragmented outputs…

Artificial Intelligence · Computer Science 2025-11-18 Zhipeng Ma , Ali Rida Bahja , Andreas Burgdorf , André Pomp , Tobias Meisen , Bo Nørregaard Jørgensen , Zheng Grace Ma

The remarkable progress in Large Language Models (LLMs) opens up new avenues for addressing planning and decision-making problems in Multi-Agent Systems (MAS). However, as the number of agents increases, the issues of hallucination in LLMs…

Artificial Intelligence · Computer Science 2024-01-24 Bin Zhang , Hangyu Mao , Jingqing Ruan , Ying Wen , Yang Li , Shao Zhang , Zhiwei Xu , Dapeng Li , Ziyue Li , Rui Zhao , Lijuan Li , Guoliang Fan

Recently, deep learning (DL) methods have been introduced very successfully into human activity recognition (HAR) scenarios in ubiquitous and wearable computing. Especially the prospect of overcoming the need for manual feature design…

Machine Learning · Computer Science 2018-09-03 Yu Guan , Thomas Ploetz

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

Robotics · Computer Science 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes