English

Jarvis for Aeroengine Analytics: A Speech Enhanced Virtual Reality Demonstrator Based on Mining Knowledge Databases

Human-Computer Interaction 2021-07-29 v1

Abstract

In this paper, we present a Virtual Reality (VR) based environment where the engineer interacts with incoming data from a fleet of aeroengines. This data takes the form of 3D computer-aided design (CAD) engine models coupled with characteristic plots for the subsystems of each engine. Both the plots and models can be interacted with and manipulated using speech or gestural input. The characteristic data is ported to a knowledge-based system underpinned by a knowledge-graph storing complex domain knowledge. This permits the system to respond to queries about the current state and health of each aeroengine asset. Responses to these questions require some degree of analysis, which is handled by a semantic knowledge representation layer managing information on aeroengine subsystems. This paper represents a significant step forward for aeroengine analysis in a bespoke VR environment and brings us a step closer to a Jarvis-like system for aeroengine analytics.

Keywords

Cite

@article{arxiv.2107.13403,
  title  = {Jarvis for Aeroengine Analytics: A Speech Enhanced Virtual Reality Demonstrator Based on Mining Knowledge Databases},
  author = {Sławomir Konrad Tadeja and Krzysztof Kutt and Yupu Lu and Pranay Seshadri and Grzegorz J. Nalepa and Per Ola Kristensson},
  journal= {arXiv preprint arXiv:2107.13403},
  year   = {2021}
}
R2 v1 2026-06-24T04:35:54.675Z