English
Related papers

Related papers: Motion Capture from Inertial and Vision Sensors

200 papers

Inertial motion analysis is having a growing interest during the last decades due to its advantages over classical optical systems. The technological solution based on inertial measurement units allows the measurement of movements in daily…

Systems and Control · Electrical Eng. & Systems 2024-01-24 Sara García-de-Villa , David Casillas-Pérez , Ana Jiménez-Martín , Juan Jesús García-Domínguez

What if our clothes could capture our body motion accurately? This paper introduces Flexible Inertial Poser (FIP), a novel motion-capturing system using daily garments with two elbow-attached flex sensors and four Inertial Measurement Units…

Human-Computer Interaction · Computer Science 2025-02-24 Jiawei Fang , Ruonan Zheng , Yuanyao , Xiaoxia Gao , Chengxu Zuo , Shihui Guo , Yiyue Luo

An inertial navigation system (INS) utilizes three orthogonal accelerometers and gyroscopes to determine platform position, velocity, and orientation. There are countless applications for INS, including robotics, autonomous platforms, and…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Zeev Yampolsky , Yair Stolero , Nitzan Pri-Hadash , Dan Solodar , Shira Massas , Itai Savin , Itzik Klein

Together with the rapid development of the Internet of Things (IoT), human activity recognition (HAR) using wearable Inertial Measurement Units (IMUs) becomes a promising technology for many research areas. Recently, deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Ling Pei , Songpengcheng Xia , Lei Chu , Fanyi Xiao , Qi Wu , Wenxian Yu , Robert Qiu

Human action recognition is used in many applications such as video surveillance, human computer interaction, assistive living, and gaming. Many papers have appeared in the literature showing that the fusion of vision and inertial sensing…

Human-Computer Interaction · Computer Science 2020-08-04 Sharmin Majumder , Nasser Kehtarnavaz

Real-time human motion reconstruction from a sparse set of (e.g. six) wearable IMUs provides a non-intrusive and economic approach to motion capture. Without the ability to acquire position information directly from IMUs, recent works took…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Yifeng Jiang , Yuting Ye , Deepak Gopinath , Jungdam Won , Alexander W. Winkler , C. Karen Liu

The recognition of behaviors in videos usually requires a combinatorial analysis of the spatial information about objects and their dynamic action information in the temporal dimension. Specifically, behavior recognition may even rely more…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Lizong Zhang , Yiming Wang , Bei Hui , Xiujian Zhang , Sijuan Liu , Shuxin Feng

Motion capture systems are a widespread tool in research to record ground-truth poses of objects. Commercial systems use reflective markers attached to the object and then triangulate pose of the object from multiple camera views.…

Robotics · Computer Science 2025-02-18 Leonard Bauersfeld , Davide Scaramuzza

This work focuses on tracking and understanding human motion using consumer wearable devices, such as VR/AR headsets, smart glasses, cellphones, and smartwatches. These devices provide diverse, multi-modal sensor inputs, including…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Jian Wang , Rishabh Dabral , Diogo Luvizon , Zhe Cao , Lingjie Liu , Thabo Beeler , Christian Theobalt

We present a new trainable system for physically plausible markerless 3D human motion capture, which achieves state-of-the-art results in a broad range of challenging scenarios. Unlike most neural methods for human motion capture, our…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Soshi Shimada , Vladislav Golyanik , Weipeng Xu , Patrick Pérez , Christian Theobalt

While camera-based capture systems remain the gold standard for recording human motion, learning-based tracking systems based on sparse wearable sensors are gaining popularity. Most commonly, they use inertial sensors, whose propensity for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Rayan Armani , Changlin Qian , Jiaxi Jiang , Christian Holz

Accurate real-time estimation of human movement dynamics, including internal joint moments and muscle forces, is essential for applications in clinical diagnostics and sports performance monitoring. Inertial measurement units (IMUs) provide…

Machine Learning · Computer Science 2026-04-09 Markus Gambietz , Eva Dorschky , Altan Akat , Marcel Schöckel , Jörg Miehling , Anne D. Koelewijn

Advances in micro-electro-mechanical (MEMS) techniques enable inertial measurements units (IMUs) to be small, cheap, energy efficient, and widely used in smartphones, robots, and drones. Exploiting inertial data for accurate and reliable…

Robotics · Computer Science 2018-09-21 Changhao Chen , Peijun Zhao , Chris Xiaoxuan Lu , Wei Wang , Andrew Markham , Niki Trigoni

This paper discusses video motion capture, namely, 3D reconstruction of human motion from multi-camera images. After the Part Confidence Maps are computed from each camera image, the proposed spatiotemporal filter is applied to deliver the…

Robotics · Computer Science 2019-12-11 Takuya Ohashi , Yosuke Ikegami , Kazuki Yamamoto , Wataru Takano , Yoshihiko Nakamura

Involuntary subject motion is the main source of artifacts in weight-bearing cone-beam CT of the knee. To achieve image quality for clinical diagnosis, the motion needs to be compensated. We propose to use inertial measurement units (IMUs)…

Image and Video Processing · Electrical Eng. & Systems 2021-02-25 Jennifer Maier , Marlies Nitschke , Jang-Hwan Choi , Garry Gold , Rebecca Fahrig , Bjoern M. Eskofier , Andreas Maier

This paper proposes a novel method called MagShield, designed to address the issue of magnetic interference in sparse inertial motion capture (MoCap) systems. Existing Inertial Measurement Unit (IMU) systems are prone to orientation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yunzhe Shao , Xinyu Yi , Lu Yin , Shihui Guo , Junhai Yong , Feng Xu

3D human motion capture from monocular RGB images respecting interactions of a subject with complex and possibly deformable environments is a very challenging, ill-posed and under-explored problem. Existing methods address it only weakly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Zhi Li , Soshi Shimada , Bernt Schiele , Christian Theobalt , Vladislav Golyanik

The use of a wide range of computer vision solutions, and more recently high-end Inertial Measurement Units (IMU) have become increasingly popular for assessing human physical activity in clinical and research settings. Nevertheless, to…

This paper presents a control interface to translate the residual body motions of individuals living with severe disabilities, into control commands for body-machine interaction. A custom, wireless, wearable multi-sensor network is used to…

This paper proposes a novel inertial-aided localization approach by fusing information from multiple inertial measurement units (IMUs) and exteroceptive sensors. IMU is a low-cost motion sensor which provides measurements on angular…

Robotics · Computer Science 2020-01-20 Ming Zhang , Yiming Chen , Xiangyu Xu , Mingyang Li