English
Related papers

Related papers: Saga: Capturing Multi-granularity Semantics from M…

200 papers

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo

Mobile Graphical User Interface (GUI) agents powered by multimodal large language models have demonstrated promising capabilities in automating complex smartphone tasks. However, existing approaches face two critical limitations: the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yiping Xie , Song Chen , Jingxuan Xing , Wei Jiang , Zekun Zhu , Yingyao Wang , Pi Bu , Jun Song , Yuning Jiang , Bo Zheng

Objective: Multimodal hand gesture recognition (HGR) systems can achieve higher recognition accuracy compared to unimodal HGR systems. However, acquiring multimodal gesture recognition data typically requires users to wear additional…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Wentao Wei , Linyan Ren

In recent years, as the population ages, falls have increasingly posed a significant threat to the health of the elderly. We propose a real-time fall detection system that integrates the inertial measurement unit (IMU) of a smartphone with…

Machine Learning · Computer Science 2025-03-05 Lingyun Wang , Deqi Su , Aohua Zhang , Yujun Zhu , Weiwei Jiang , Xin He , Panlong Yang

With increasing applications of semantic segmentation, numerous datasets have been proposed in the past few years. Yet labeling remains expensive, thus, it is desirable to jointly train models across aggregations of datasets to enhance data…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Dongwan Kim , Yi-Hsuan Tsai , Yumin Suh , Masoud Faraki , Sparsh Garg , Manmohan Chandraker , Bohyung Han

Synchronisation of wireless inertial measurement units in human movement analysis is often achieved using event-based synchronisation techniques. However, these techniques lack precise event generation and accuracy. An inaccurate…

Systems and Control · Electrical Eng. & Systems 2025-06-02 Andreas Spilz , Michael Munz

Object extraction and segmentation from remote sensing (RS) images is a critical yet challenging task in urban environment monitoring. Urban morphology is inherently complex, with irregular objects of diverse shapes and varying scales.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Chenyu Li , Danfeng Hong , Bing Zhang , Yuxuan Li , Gustau Camps-Valls , Xiao Xiang Zhu , Jocelyn Chanussot

Agents are rapidly advancing in automating digital work, but enterprises face a harder challenge: moving beyond prototypes to deployed systems that deliver measurable business value. This path is complicated by fragmented frameworks, slow…

Task decomposition is critical for understanding and learning complex long-horizon manipulation tasks. Especially for tasks involving rich physical interactions, relying solely on visual observations and robot proprioceptive information…

IMU-based gesture interfaces are being increasingly adopted as efficient, accessible, and intuitive alternatives to traditional input methods, such as touchscreens and voice. However, current gesture recognition algorithms are tailored to…

Human-Computer Interaction · Computer Science 2026-03-13 Prerna Khanna , Tanmay Srivastava , Shubham Jain , Aruna Balasubramanian

We introduce an assessment procedure for interactive segmentation models. Based on concepts from Bayesian Experimental Design, the procedure measures a model's understanding of point prompts and their correspondence with the desired…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Kuan-I Chung , Daniel Moyer

An approach for computing unique gait signature using measurements collected from body-worn inertial measurement units (IMUs) is proposed. The gait signature represents one full cycle of the human gait, and is suitable for off-line or…

Signal Processing · Electrical Eng. & Systems 2019-07-08 Parinaz Kasebzadeh , Gustaf Hendeby , Fredrik Gustafsson

Recovery after stroke is often incomplete, but rehabilitation training may potentiate recovery by engaging endogenous neuroplasticity. In preclinical models of stroke, high doses of rehabilitation training are required to restore functional…

Signal Processing · Electrical Eng. & Systems 2020-06-22 Aakash Kaku , Avinash Parnandi , Anita Venkatesan , Natasha Pandit , Heidi Schambra , Carlos Fernandez-Granda

Most audio tagging models are trained with one-hot labels as supervised information. However, one-hot labels treat all sound events equally, ignoring the semantic hierarchy and proximity relationships between sound events. In contrast, the…

Sound · Computer Science 2024-01-17 Wuyang Liu , Yanzhen Ren

Human Activity Recognition (HAR) with wearable sensors is essential for applications in healthcare, fitness, and human-computer interaction. Bio-impedance sensing offers unique advantages for fine-grained motion capture but remains…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Lala Shakti Swarup Ray , Mengxi Liu , Deepika Gurung , Bo Zhou , Sungho Suh , Paul Lukowicz

Fatigue is one of the key factors in the loss of work efficiency and health-related quality of life, and most fatigue assessment methods were based on self-reporting, which may suffer from many factors such as recall bias. To address this…

Machine Learning · Computer Science 2020-08-19 Yang Bai , Yu Guan , Wan-Fai Ng

One of the primary challenges in the field of human activity recognition (HAR) is the lack of large labeled datasets. This hinders the development of robust and generalizable models. Recently, cross modality transfer approaches have been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zikang Leng , Amitrajit Bhattacharjee , Hrudhai Rajasekhar , Lizhe Zhang , Elizabeth Bruda , Hyeokhyen Kwon , Thomas Plötz

Detecting and interpreting operator actions, engagement, and object interactions in dynamic industrial workflows remains a significant challenge in human-robot collaboration research, especially within complex, real-world environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Naval Kishore Mehta , Arvind , Himanshu Kumar , Abeer Banerjee , Sumeet Saurav , Sanjay Singh

There is a growing research interest towards the use of wireless IMU sensors to assess disability, monitor progress and provide feedback to patients on range of motion and movement performance during upper body rehabilitation. The quality…

Signal Processing · Electrical Eng. & Systems 2020-11-02 Miloš Ajčević , Manuela Deodato , Luigi Murena , Aleksandar Miladinović , Susanna Mezzarobba , Agostino Accardo

Multitask learning is a widely used paradigm for training models on diverse tasks, with applications ranging from graph neural networks to language model fine-tuning. Since tasks may interfere with each other, a key notion for modeling…

Machine Learning · Computer Science 2024-11-22 Dongyue Li , Aneesh Sharma , Hongyang R. Zhang