English
Related papers

Related papers: On-device Large Multi-modal Agent for Human Activi…

200 papers

Recent advancements in Multi-Agent Systems (MAS) powered by Large Language Models (LLMs) have demonstrated tremendous potential in diverse task scenarios. Nonetheless, existing agentic systems typically rely on predefined agent-role design…

Multiagent Systems · Computer Science 2025-05-21 Zhipeng Hou , Junyi Tang , Yipeng Wang

This paper introduces a novel approach using Large Language Models (LLMs) integrated into an agent framework for flexible and effective personal mobility generation. LLMs overcome the limitations of previous models by effectively processing…

Artificial Intelligence · Computer Science 2024-10-29 Jiawei Wang , Renhe Jiang , Chuang Yang , Zengqing Wu , Makoto Onizuka , Ryosuke Shibasaki , Noboru Koshizuka , Chuan Xiao

Large Action Models (LAMs) for AI Agents offer incredible potential but face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to…

Multimodal human action recognition (HAR) leverages complementary sensors for activity classification. Beyond recognition, recent advances in large language models (LLMs) enable detailed descriptions and causal reasoning, motivating new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siyang Jiang , Mu Yuan , Xiang Ji , Bufang Yang , Zeyu Liu , Lilin Xu , Yang Li , Yuting He , Liran Dong , Wenrui Lu , Zhenyu Yan , Xiaofan Jiang , Wei Gao , Hongkai Chen , Guoliang Xing

Human Activity Recognition (HAR) is a key building block of many emerging applications such as intelligent mobility, sports analytics, ambient-assisted living and human-robot interaction. With robust HAR, systems will become more…

Computer Vision and Pattern Recognition · Computer Science 2019-01-10 Mirco Moencks , Varuna De Silva , Jamie Roche , Ahmet Kondoz

Human Action Recognition (HAR), one of the most important tasks in computer vision, has developed rapidly in the past decade and has a wide range of applications in health monitoring, intelligent surveillance, virtual reality, human…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Zhou Shuchang

Human Activity Recognition (HAR) plays a vital role in applications such as fitness tracking, smart homes, and healthcare monitoring. Traditional HAR systems often rely on single modalities, such as motion sensors or cameras, limiting…

Machine Learning · Computer Science 2025-08-05 Asmit Bandyopadhyay , Rohit Basu , Tanmay Sen , Swagatam Das

We consider human activity recognition (HAR) from wearable sensor data in manual-work processes, like warehouse order-picking. Such structured domains can often be partitioned into distinct process steps, e.g., packaging or transporting.…

Signal Processing · Electrical Eng. & Systems 2021-11-09 Stefan Lüdtke , Fernando Moya Rueda , Waqas Ahmed , Gernot A. Fink , Thomas Kirste

Human activity recognition (HAR) is fundamental in human-robot collaboration (HRC), enabling robots to respond to and dynamically adapt to human intentions. This paper introduces a HAR system combining a modular data glove equipped with…

In recent developments within the research community, the integration of Large Language Models (LLMs) in creating fully autonomous agents has garnered significant interest. Despite this, LLM-based agents frequently demonstrate notable…

Computation and Language · Computer Science 2024-02-21 Xueyang Feng , Zhi-Yuan Chen , Yujia Qin , Yankai Lin , Xu Chen , Zhiyuan Liu , Ji-Rong Wen

Recent advancements in medical Large Language Models (LLMs) have showcased their powerful reasoning and diagnostic capabilities. Despite their success, current unified multimodal medical LLMs face limitations in knowledge update costs,…

Computation and Language · Computer Science 2025-06-25 Yucheng Zhou , Lingran Song , Jianbing Shen

Human Activity Recognition~(HAR) is the classification of human movement, captured using one or more sensors either as wearables or embedded in the environment~(e.g. depth cameras, pressure mats). State-of-the-art methods of HAR rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Anjana Wijekoon , Nirmalie Wiratunga

This work presents a novel architecture for context-aware interactions within smart environments, leveraging Large Language Models (LLMs) to enhance user experiences. Our system integrates user location data obtained through UWB tags and…

Computation and Language · Computer Science 2025-02-21 Aurora Polo-Rodríguez , Laura Fiorini , Erika Rovini , Filippo Cavallo , Javier Medina-Quero

Multimodal large language models (MLLMs) have shown remarkable capabilities in cross-modal understanding and reasoning, offering new opportunities for intelligent assistive systems, yet existing systems still struggle with risk-aware…

Robotics · Computer Science 2026-04-08 Renjun Gao

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting past experiences in…

Despite the widespread integration of ambient light sensors (ALS) in smart devices commonly used for screen brightness adaptation, their application in human activity recognition (HAR), primarily through body-worn ALS, is largely…

Artificial Intelligence · Computer Science 2024-08-23 Lala Shakti Swarup Ray , Daniel Geißler , Mengxi Liu , Bo Zhou , Sungho Suh , Paul Lukowicz

Predicting human behavior in shared environments is crucial for safe and efficient human-robot interaction. Traditional data-driven methods to that end are pre-trained on domain-specific datasets, activity types, and prediction horizons. In…

Robotics · Computer Science 2025-06-24 Yuchen Liu , Lino Lerch , Luigi Palmieri , Andrey Rudenko , Sebastian Koch , Timo Ropinski , Marco Aiello

Human Activity Recognition (HAR) simply refers to the capacity of a machine to perceive human actions. HAR is a prominent application of advanced Machine Learning and Artificial Intelligence techniques that utilize computer vision to…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Niloy Sikder , Md. Sanaullah Chowdhury , Abu Shamim Mohammad Arif , Abdullah-Al Nahid

Effort estimation is a crucial activity in agile software development, where teams collaboratively review, discuss, and estimate the effort required to complete user stories in a product backlog. Current practices in agile effort estimation…

Software Engineering · Computer Science 2025-09-19 Thanh-Long Bui , Hoa Khanh Dam , Rashina Hoda

The long-standing vision of intelligent cities is to create efficient, livable, and sustainable urban environments using big data and artificial intelligence technologies. Recently, the advent of Large Language Models (LLMs) has opened new…

Multiagent Systems · Computer Science 2025-07-02 Jindong Han , Yansong Ning , Zirui Yuan , Hang Ni , Fan Liu , Tengfei Lyu , Hao Liu