The assembly instruction is a mandatory component of Lego-like brick sets.The conventional production of assembly instructions requires a considerable amount of manual fine-tuning, which is intractable for casual users and customized brick sets.Moreover, the traditional paper-based instructions lack expressiveness and interactivity.To tackle the two problems above, we present BrickPal, an augmented reality-based system, which visualizes assembly instructions in an augmented reality head-mounted display. It utilizes Natural Language Processing (NLP) techniques to generate plausible assembly sequences, and provide real-time guidance in the AR headset.Our user study demonstrates BrickPal's effectiveness at assisting users in brick assembly compared to traditional assembly methods. Additionally, the NLP algorithm-generated assembly sequences achieve the same usability with manually adapted sequences.
Cite
@article{arxiv.2307.03162,
title = {BrickPal: Augmented Reality-based Assembly Instructions for Brick Models},
author = {Yao Shi and Xiaofeng Zhang and Ran zhang and Zhou Yang and Xiao Tang and Hongni Ye and Yi Wu},
journal= {arXiv preprint arXiv:2307.03162},
year = {2023}
}