English
Related papers

Related papers: Inertial Hallucinations -- When Wearable Inertial …

200 papers

Inertial navigation systems (INS) are widely used in almost any operational environment, including aviation, marine, and land vehicles. Inertial measurements from accelerometers and gyroscopes allow the INS to estimate position, velocity,…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Daniel Engelsman , Yair Stolero , Itzik Klein

Frailty and functional decline strongly influence treatment tolerance and outcomes in older patients with cancer, yet assessment is typically limited to infrequent clinic visits. We propose a multimodal wearable framework to estimate…

The fusion of multiple sensor modalities, especially through deep learning architectures, has been an active area of study. However, an under-explored aspect of such work is whether the methods can be robust to degradations across their…

Computer Vision and Pattern Recognition · Computer Science 2020-03-05 Junjiao Tian , Wesley Cheung , Nathan Glaser , Yen-Cheng Liu , Zsolt Kira

This study explores the potential of using wrist-worn inertial sensors to automate the labeling of ARAT (Action Research Arm Test) items. While the ARAT is commonly used to assess upper limb motor function, its limitations include…

Pretrained vision-and-language BERTs aim to learn representations that combine information from both modalities. We propose a diagnostic method based on cross-modal input ablation to assess the extent to which these models actually…

Computation and Language · Computer Science 2021-09-10 Stella Frank , Emanuele Bugliarello , Desmond Elliott

People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI…

Human-Computer Interaction · Computer Science 2024-07-15 Jingyi Xie , Rui Yu , He Zhang , Sooyeon Lee , Syed Masum Billah , John M. Carroll

The field of computer vision is undergoing a paradigm shift toward large-scale foundation model pre-training via self-supervised learning (SSL). Leveraging large volumes of unlabeled brain MRI data, such models can learn anatomical priors…

Image and Video Processing · Electrical Eng. & Systems 2026-01-15 Petros Koutsouvelis , Matej Gazda , Leroy Volmer , Sina Amirrajab , Kamil Barbierik , Branislav Setlak , Jakub Gazda , Peter Drotar

Reliable autonomous driving systems require accurate detection of traffic participants. To this end, multi-modal fusion has emerged as an effective strategy. In particular, 4D radar and LiDAR fusion methods based on multi-frame radar point…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Xiangyuan Peng , Yu Wang , Miao Tang , Bierzynski Kay , Lorenzo Servadei , Robert Wille

Large vision-language models (LVLMs) have demonstrated remarkable multimodal comprehension and reasoning capabilities, but they still suffer from severe object hallucination. Previous studies primarily attribute the flaw to linguistic prior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Haohan Zheng , Zhenguo Zhang

RGB-Infrared person re-identification (RGB-IR Re- ID) is a cross-modality matching problem, where the modality discrepancy is a big challenge. Most existing works use Euclidean metric based constraints to resolve the discrepancy between…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Hanrong Ye , Hong Liu , Fanyang Meng , Xia Li

Many smartphone applications use inertial measurement units (IMUs) to sense movement, but the use of these sensors for pedestrian localization can be challenging due to their noise characteristics. Recent data-driven inertial odometry…

Robotics · Computer Science 2021-02-09 Scott Sun , Dennis Melamed , Kris Kitani

This study investigates the integration of assistive therapeutic robotics, wearable sensors, and spatial sensors within an intelligent environment tailored for dementia care. The feasibility study aims to assess the collective impact of…

Human-Computer Interaction · Computer Science 2026-02-25 Arshia A Khan , Rupak Kumar Das , Anna Martin , Dale Dowling , Rana Imtiaz

Roadside perception datasets are typically constructed via cooperative labeling between synchronized vehicle and roadside frame pairs. However, real deployment often requires annotation of roadside-only data due to hardware and privacy…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Ruiyu Mao , Baoming Zhang , Nicholas Ruozzi , Yunhui Guo

Access to non-verbal cues in social interactions is vital for people with visual impairment. It has been shown that non-verbal cues such as eye contact, number of people, their names and positions are helpful for individuals who are blind.…

Computers and Society · Computer Science 2017-11-30 M. Saquib Sarfraz , Angela Constantinescu , Melanie Zuzej , Rainer Stiefelhagen

Lumbar disc herniation (LDH) is a prevalent orthopedic condition in clinical practice. Inertial measurement unit sensors (IMUs) are an effective tool for monitoring and assessing gait impairment in patients with lumbar disc herniation…

Robotics · Computer Science 2023-12-18 Yongsong Wang , Zhixin Li , Zhaohui Guo , Yin Ding , Zhan Huan , Lin Chen

Interactive reinforcement learning (IRL) extends traditional reinforcement learning (RL) by allowing an agent to interact with parent-like trainers during a task. In this paper, we present an IRL approach using dynamic audio-visual input in…

Artificial Intelligence · Computer Science 2018-07-27 Francisco Cruz , German I. Parisi , Stefan Wermter

Hallucinations remain a major obstacle for large language models (LLMs), especially in safety-critical domains. We present HALT (Hallucination Assessment via Log-probs as Time series), a lightweight hallucination detector that leverages…

Computation and Language · Computer Science 2026-02-04 Ahmad Shapiro , Karan Taneja , Ashok Goel

Mixed Reality (MR) and Artificial Intelligence (AI) are increasingly becoming integral parts of our daily lives. Their applications range in fields from healthcare to education to entertainment. MR has opened a new frontier for such fields…

Human-Computer Interaction · Computer Science 2024-02-14 Ramez Yousri , Zeyad Essam , Yehia Kareem , Youstina Sherief , Sherry Gamil , Soha Safwat

Decades of research indicate that emotion recognition is more effective when drawing information from multiple modalities. But what if some modalities are sometimes missing? To address this problem, we propose a novel Transformer-based…

Machine Learning · Computer Science 2023-11-20 Juan Vazquez-Rodriguez , Grégoire Lefebvre , Julien Cumin , James L. Crowley

In recent years, multiple Light Detection and Ranging (LiDAR) systems have grown in popularity due to their enhanced accuracy and stability from the increased field of view (FOV). However, integrating multiple LiDARs can be challenging,…

Robotics · Computer Science 2023-11-08 Minwoo Jung , Sangwoo Jung , Ayoung Kim