English
Related papers

Related papers: SensorLLM: Aligning Large Language Models with Mot…

200 papers

Human Activity Recognition (HAR) is one of the core research areas in mobile and wearable computing. With the application of deep learning (DL) techniques such as CNN, recognizing periodic or static activities (e.g, walking, lying, cycling,…

Signal Processing · Electrical Eng. & Systems 2022-12-29 Shuai Shao , Yu Guan , Xin Guan , Paolo Missier , Thomas Ploetz

Active learning (AL) accelerates scientific discovery by prioritizing the most informative experiments, but traditional machine learning (ML) models used in AL suffer from cold-start limitations and domain-specific feature engineering,…

Machine Learning · Computer Science 2025-12-05 Hongchen Wang , Rafael Espinosa Castañeda , Jay R. Werber , Yao Fehlis , Edward Kim , Jason Hattrick-Simpers

Human action understanding is crucial for the advancement of multimodal systems. While recent developments, driven by powerful large language models (LLMs), aim to be general enough to cover a wide range of categories, they often overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yongle Huang , Haodong Chen , Zhenbang Xu , Zihan Jia , Haozhou Sun , Dian Shao

This paper explores the use of Large Language Models (LLMs) for sequential recommendation, which predicts users' future interactions based on their past behavior. We introduce a new concept, "Integrating Recommendation Systems as a New…

Information Retrieval · Computer Science 2024-12-24 Kai Zheng , Qingfeng Sun , Can Xu , Peng Yu , Qingwei Guo

Recent advances in robotics and large language models (LLMs) have sparked growing interest in human-robot collaboration and embodied intelligence. To enable the broader deployment of robots in human-populated environments, socially-aware…

Robotics · Computer Science 2025-03-14 Weizheng Wang , Ike Obi , Byung-Cheol Min

Speech Large Language Models (Speech LLMs) have emerged as a crucial paradigm in recent years, extending the capabilities of traditional LLMs to speech tasks such as automatic speech recognition (ASR) and spoken dialogue modeling. However,…

Computation and Language · Computer Science 2025-07-08 Phurich Saengthong , Boonnithi Jiaramaneepinit , Sheng Li , Manabu Okumura , Takahiro Shinozaki

Currently, large language models (LLMs) predominantly focus on the text modality. To enable more natural human-AI interaction, speech LLMs are emerging, but building effective end-to-end speech LLMs remains challenging due to limited data…

Computation and Language · Computer Science 2026-04-14 Yan Zhou , Qingkai Fang , Yun Hong , Yang Feng

Sensor-based human activity recognition (HAR) has been an active research area, owing to its applications in smart environments, assisted living, fitness, healthcare, etc. Recently, deep learning based end-to-end training has resulted in…

Machine Learning · Computer Science 2024-01-19 Sourish Gunesh Dhekane , Thomas Ploetz

Large Language Models (LLMs) have recently demonstrated impressive capabilities in natural language processing due to their strong generalization and sequence modeling capabilities. However, their direct application to time series…

Computation and Language · Computer Science 2025-08-12 Yanru Sun , Emadeldeen Eldele , Zongxia Xie , Yucheng Wang , Wenzhe Niu , Qinghua Hu , Chee Keong Kwoh , Min Wu

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment…

Computation and Language · Computer Science 2026-04-20 Xintao Wang , Jian Yang , Weiyuan Li , Rui Xie , Jen-tse Huang , Jun Gao , Shuai Huang , Yueping Kang , Yuanli Gou , Hongwei Feng , Yanghua Xiao

Large language models (LLMs) are effective at capturing complex, valuable conceptual representations from textual data for a wide range of real-world applications. However, in fields like Intelligent Fault Diagnosis (IFD), incorporating…

Artificial Intelligence · Computer Science 2024-12-03 Hamzah A. A. M. Qaid , Bo Zhang , Dan Li , See-Kiong Ng , Wei Li

Unsupervised human motion segmentation (HMS) can be effectively achieved using subspace clustering techniques. However, traditional methods overlook the role of temporal semantic exploration in HMS. This paper explores the use of temporal…

Machine Learning · Computer Science 2025-12-30 Zheng Xing , Weibing Zhao

Smart-home sensor data holds significant potential for several applications, including healthcare monitoring and assistive technologies. Existing approaches, however, face critical limitations. Supervised models require impractical amounts…

Artificial Intelligence · Computer Science 2026-02-03 Michele Fiori , Gabriele Civitarese , Flora D. Salim , Claudio Bettini

Understanding human mobility patterns has long been a challenging task in transportation modeling. Due to the difficulties in obtaining high-quality training datasets across diverse locations, conventional activity-based models and…

Artificial Intelligence · Computer Science 2025-07-03 Yifan Liu , Xishun Liao , Haoxuan Ma , Brian Yueshuai He , Chris Stanford , Jiaqi Ma

Large Language Models (LLMs) have made significant strides in various intelligent tasks but still struggle with complex action reasoning tasks that require systematic search. To address this limitation, we propose a method that bridges the…

Computation and Language · Computer Science 2025-02-05 Adam Ishay , Joohyung Lee

Large Language Models (LLMs) have demonstrated impressive capabilities in language generation and general task performance. However, their application to spoken language understanding (SLU) remains challenging, particularly for token-level…

Computation and Language · Computer Science 2025-10-09 Shangjian Yin , Peijie Huang , Jiatian Chen , Haojing Huang , Yuhong Xu

The recent development of Large Language Models (LLMs) enables the rise of App agents that interpret user intent and operate smartphone Apps through actions such as clicking and scrolling. While prompt-based solutions with proprietary LLM…

Artificial Intelligence · Computer Science 2026-04-08 Bohan Tang , Dezhao Luo , Jianheng Liu , Jingxuan Chen , Shaogang Gong , Jianye Hao , Jun Wang , Kun Shao

Motion sensor time-series are central to Human Activity Recognition (HAR), yet conventional approaches are constrained to fixed activity sets and typically require costly parameter retraining to adapt to new behaviors. While Large Language…

Computation and Language · Computer Science 2026-04-14 Zechen Li , Baiyu Chen , Hao Xue , Flora D. Salim

The advancements in the Large Language Model (LLM) have helped in solving several problems related to language processing. Most of the researches have focused on the English language only, because of its popularity and abundance on the…

Computation and Language · Computer Science 2024-12-31 Sanjay Chouhan , Shubha Brata Nath , Aparajita Dutta

This paper proposes MotionVerse, a unified framework that harnesses the capabilities of Large Language Models (LLMs) to comprehend, generate, and edit human motion in both single-person and multi-person scenarios. To efficiently represent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ruibing Hou , Mingshuang Luo , Hongyu Pan , Hong Chang , Shiguang Shan