English
Related papers

Related papers: CROMOSim: A Deep Learning-based Cross-modality Ine…

200 papers

Due to reduced manufacturing yields, traditional monolithic chips cannot keep up with the compute, memory, and communication demands of data-intensive applications, such as rapidly growing deep neural network (DNN) models. Chiplet-based…

Hardware Architecture · Computer Science 2025-10-31 Lukas Pfromm , Alish Kanani , Harsh Sharma , Janardhan Rao Doppa , Partha Pratim Pande , Umit Y. Ogras

Inertial Measurement Units (IMUs) are interceptive modalities that provide ego-motion measurements independent of the environmental factors. They are widely adopted in various autonomous systems. Motivated by the limitations in processing…

Machine Learning · Computer Science 2021-01-19 Rooholla Khorrambakht , Chris Xiaoxuan Lu , Hamed Damirchi , Zhenghua Chen , Zhengguo Li

Due to the scarcity of labeled sensor data in HAR, prior research has turned to video data to synthesize Inertial Measurement Units (IMU) data, capitalizing on its rich activity annotations. However, generating IMU data from videos presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vitor Fortes Rey , Lala Shakti Swarup Ray , Xia Qingxin , Kaishun Wu , Paul Lukowicz

Inertial odometry (IO) using strap-down inertial measurement units (IMUs) is critical in many robotic applications where precise orientation and position tracking are essential. Prior kinematic motion model-based IO methods often use a…

Robotics · Computer Science 2024-05-16 Yuheng Qiu , Chen Wang , Can Xu , Yutian Chen , Xunfei Zhou , Youjie Xia , Sebastian Scherer

Modern inertial measurements units (IMUs) are small, cheap, energy efficient, and widely employed in smart devices and mobile robots. Exploiting inertial data for accurate and reliable pedestrian navigation supports is a key component for…

Robotics · Computer Science 2020-01-14 Changhao Chen , Peijun Zhao , Chris Xiaoxuan Lu , Wei Wang , Andrew Markham , Niki Trigoni

Multimodal sensors provide complementary information to develop accurate machine-learning methods for human activity recognition (HAR), but introduce significantly higher computational load, which reduces efficiency. This paper proposes an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Ziqi Gao , Yuntao Wang , Jianguo Chen , Junliang Xing , Shwetak Patel , Xin Liu , Yuanchun Shi

Human Activity Recognition (HAR) based on inertial data is an increasingly diffused task on embedded devices, from smartphones to ultra low-power sensors. Due to the high computational complexity of deep learning models, most embedded HAR…

This work aims to generate realistic anatomical deformations from static patient scans. Specifically, we present a method to generate these deformations/augmentations via deep learning driven respiratory motion simulation that provides the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Donghoon Lee , Ellen Yorke , Masoud Zarepisheh , Saad Nadeem , Yu-Chi Hu

We explore the potential of large-scale noisily labeled data to enhance feature learning by pretraining semantic segmentation models within a multi-modal framework for geospatial applications. We propose a novel Cross-modal Sample Selection…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chenying Liu , Conrad Albrecht , Yi Wang , Xiao Xiang Zhu

Falls represent a significant cause of injury among the elderly population. Extensive research has been devoted to the utilization of wearable IMU sensors in conjunction with machine learning techniques for fall detection. To address the…

Quantitative Methods · Quantitative Biology 2023-10-18 Jie Tang , Bin He , Junkai Xu , Tian Tan , Zhipeng Wang , Yanmin Zhou , Shuo Jiang

Inertial Measurement Unit (IMU)-based Human Activity Recognition (HAR) aims to interpret and classify user behaviors from temporal motion signals. Recently, deep learning frameworks have advanced this task by learning and extracting…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Peng Liao , Shangsong Liang , Lin Chen , Peijia Zheng

Advances in micro-electro-mechanical (MEMS) techniques enable inertial measurements units (IMUs) to be small, cheap, energy efficient, and widely used in smartphones, robots, and drones. Exploiting inertial data for accurate and reliable…

Robotics · Computer Science 2018-09-21 Changhao Chen , Peijun Zhao , Chris Xiaoxuan Lu , Wei Wang , Andrew Markham , Niki Trigoni

Despite living in a multi-sensory world, most AI models are limited to textual and visual understanding of human motion and behavior. In fact, full situational awareness of human motion could best be understood through a combination of…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Abhi Kamboj , Minh Do

Robust multisensor fusion of multi-modal measurements such as IMUs, wheel encoders, cameras, LiDARs, and GPS holds great potential due to its innate ability to improve resilience to sensor failures and measurement outliers, thereby enabling…

Robotics · Computer Science 2023-09-28 Woosik Lee , Patrick Geneva , Chuchu Chen , Guoquan Huang

In this work, we propose a novel method for performing inertial aided navigation, by using deep neural networks (DNNs). To date, most DNN inertial navigation methods focus on the task of inertial odometry, by taking gyroscope and…

Robotics · Computer Science 2021-03-29 Ming Zhang , Mingming Zhang , Yiming Chen , Mingyang Li

Wearable inertial measurement units (IMUs) provide a cost-effective approach to assessing human movement in clinical and everyday environments. However, developing the associated classification models for robust assessment of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Andreas Spilz , Heiko Oppel , Jochen Werner , Kathrin Stucke-Straub , Felix Capanni , Michael Munz

Visual-inertial sensors have a wide range of applications in robotics. However, good performance often requires different sophisticated motion routines to accurately calibrate camera intrinsics and inter-sensor extrinsics. This work…

Robotics · Computer Science 2021-10-01 Yunke Ao , Le Chen , Florian Tschopp , Michel Breyer , Andrei Cramariuc , Roland Siegwart

Ground pressure exerted by the human body is a valuable source of information for human activity recognition (HAR) in unobtrusive pervasive sensing. While data collection from pressure sensors to develop HAR solutions requires significant…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Lala Shakti Swarup Ray , Bo Zhou , Sungho Suh , Paul Lukowicz

Sensor-based Human Activity Recognition (HAR) has attracted increasing attention in medical and healthcare monitoring, particularly with the growth of Internet of Medical Things (IoMT). However, in real-world wearable sensing scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiangtao Fan , Anish Jindal , Amir Atapour-Abarghouei

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal