English
Related papers

Related papers: CROMOSim: A Deep Learning-based Cross-modality Ine…

200 papers

We tackle the problem of developing humanoid loco-manipulation skills with deep imitation learning. The difficulty of collecting task demonstrations and training policies for humanoids with a high degree of freedom presents substantial…

Robotics · Computer Science 2023-11-21 Mingyo Seo , Steve Han , Kyutae Sim , Seung Hyeon Bang , Carlos Gonzalez , Luis Sentis , Yuke Zhu

In a human-centered intelligent manufacturing system, sensing and understanding of the worker's activity are the primary tasks. In this paper, we propose a novel multi-modal approach for worker activity recognition by leveraging information…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Wenjin Tao , Ming C. Leu , Zhaozheng Yin

We propose Ground Reaction Inertial Poser (GRIP), a method that reconstructs physically plausible human motion using four wearable devices. Unlike conventional IMU-only approaches, GRIP combines IMU signals with foot pressure data to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ryosuke Hori , Jyun-Ting Song , Zhengyi Luo , Jinkun Cao , Soyong Shin , Hideo Saito , Kris Kitani

Human Activity Recognition (HAR) using wearable sensor data has become a central task in mobile computing, healthcare, and human-computer interaction. Despite the success of traditional deep learning models such as CNNs and RNNs, they often…

Machine Learning · Computer Science 2025-05-27 Yunbo Liu , Xukui Qin , Yifan Gao , Xiang Li , Chengwei Feng

A wide range of user perception applications leverage inertial measurement unit (IMU) data for online prediction. However, restricted by the non-i.i.d. nature of IMU data collected from mobile devices, most systems work well only in a…

Artificial Intelligence · Computer Science 2025-12-02 Yunzhe Li , Facheng Hu , Hongzi Zhu , Quan Liu , Xiaoke Zhao , Jiangang Shen , Shan Chang , Minyi Guo

Magnetic particle imaging reconstructs tracer distributions using a system matrix obtained through time-consuming, noise-prone calibration measurements. Methods for addressing imperfections in measured system matrices increasingly rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-03-20 Artyom Tsanda , Sarah Reiss , Konrad Scheffler , Marija Boberg , Tobias Knopp

Many applications involve humans in the loop, where continuous and accurate human motion monitoring provides valuable information for safe and intuitive human-machine interaction. Portable devices such as inertial measurement units (IMUs)…

Systems and Control · Electrical Eng. & Systems 2023-04-12 Xiaobing Dai , Huanzhuo Wu , Siyi Wang , Junjie Jiao , Giang T. Nguyen , Frank H. P. Fitzek , Sandra Hirche

Involuntary subject motion is the main source of artifacts in weight-bearing cone-beam CT of the knee. To achieve image quality for clinical diagnosis, the motion needs to be compensated. We propose to use inertial measurement units (IMUs)…

Image and Video Processing · Electrical Eng. & Systems 2021-02-25 Jennifer Maier , Marlies Nitschke , Jang-Hwan Choi , Garry Gold , Rebecca Fahrig , Bjoern M. Eskofier , Andreas Maier

Human motion analysis is used in many different fields and applications. Currently, existing systems either focus on one single limb or one single class of movements. Many proposed systems are designed to be used in an indoor controlled…

A trend towards energy-efficiency, security and privacy has led to a recent focus on deploying DNNs on microcontrollers. However, limits on compute and memory resources restrict the size and the complexity of the ML models deployable in…

Machine Learning · Computer Science 2020-10-19 Fernando García-Redondo , Shidhartha Das , Glen Rosendale

In order to unlock the potential of diverse sensors, we investigate a method to transfer knowledge between time-series modalities using a multimodal \textit{temporal} representation space for Human Activity Recognition (HAR). Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Abhi Kamboj , Anh Duy Nguyen , Minh N. Do

The proliferation of deep learning has significantly advanced various fields, yet Human Activity Recognition (HAR) has not fully capitalized on these developments, primarily due to the scarcity of labeled datasets. Despite the integration…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Parham Zolfaghari , Vitor Fortes Rey , Lala Ray , Hyun Kim , Sungho Suh , Paul Lukowicz

Modern architecture research relies on simulators to evaluate system security, yet analyzing emerging hardware vulnerabilities like RowHammer requires full-system visibility. As RowHammer vulnerabilities worsen with continuous technology…

Cryptography and Security · Computer Science 2026-05-28 Kaustav Goswami , Ayaz Akram , Hari Venugopalan , Jason Lowe-Power

Employing an inertial measurement unit (IMU) as an additional sensor can dramatically improve both reliability and accuracy of visual/Lidar odometry (VO/LO). Different IMU integration models are introduced using different assumptions on the…

Robotics · Computer Science 2019-12-03 John Henawy , Zhengguo Li , Wei Yun Yau , Gerald Seet , Kong Wah Wan

Recognizing human activities from multi-channel time series data collected from wearable sensors is ever more practical. However, in real-world conditions, coherent activities and body movements could happen at the same time, like moving…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Liming Zhang

Involuntary motion during weight-bearing cone-beam computed tomography (CT) scans of the knee causes artifacts in the reconstructed volumes making them unusable for clinical diagnosis. Currently, image-based or marker-based methods are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Jennifer Maier , Marlies Nitschke , Jang-Hwan Choi , Garry Gold , Rebecca Fahrig , Bjoern M. Eskofier , Andreas Maier

Human activity recognition (HAR) is a very active research field. Recently, deep learning techniques are being exploited to recognize human activities from inertial signals. However, to compute accurate and reliable deep learning models, a…

Computers and Society · Computer Science 2019-05-30 Anna Ferrari , Daniela Micucci , Marco Mobilio , Paolo Napoletano

Human Activity Recognition (HAR) on mobile devices has been demonstrated to be possible using neural models trained on data collected from the device's inertial measurement units. These models have used Convolutional Neural Networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Sannara EK , François Portet , Philippe Lalanda

Deep learning-based human activity recognition (HAR) methods have shown great promise in the applications of smart healthcare systems and wireless body sensor network (BSN). Despite their demonstrated performance in laboratory settings, the…

Human-Computer Interaction · Computer Science 2023-03-28 Baichun Wei , Chunzhi Yi , Qi Zhang , Haiqi Zhu , Jianfei Zhu , Feng Jiang

A monocular visual-inertial system (VINS), consisting of a camera and a low-cost inertial measurement unit (IMU), forms the minimum sensor suite for metric six degrees-of-freedom (DOF) state estimation. However, the lack of direct distance…

Robotics · Computer Science 2019-03-12 Tong Qin , Peiliang Li , Shaojie Shen