ProtoAct: Turning Wet-Lab Protocols into Embodied Robotic Actions
Abstract
Biological wet-lab protocols are written for trained researchers and often leave routine operations, state-dependent conditions, and contextual parameters implicit, making them difficult to translate into robot-executable actions. We present ProtoAct, a structured protocol-grounding framework that converts free-form biological procedures into state-aware, embodiment-ready action sequences. ProtoAct uses ProtoRAG to retrieve manually annotated examples for context-sensitive parsing, employs RefineChecker to detect and revise missing or inconsistent steps, and applies ActSchema to map the refined procedure into constrained JSON function sequences. We further introduce BioP2E, for which we manually annotate 22 cell-culture protocols into 258 monitoring conditions, 910 executable subtasks, and 962 grounded action calls. Evaluation across seven large language models demonstrates that ProtoAct can be effectively instantiated with different backbones. Ablations confirm that retrieval, posterior checking, and schema constraints make complementary contributions. The parsed subtasks further support demonstration collection and VLA model training, enabling successful execution in both simulation and real-robot settings. ProtoAct thus provides a practical interface between biological protocol understanding and embodied robotic execution.
Cite
@article{arxiv.2608.01690,
title = {ProtoAct: Turning Wet-Lab Protocols into Embodied Robotic Actions},
author = {Zhe Liu and Jiaming Gu and Zhaohui Du and Zhe Wang and Huanbo Jin and Quan Lu and Qi Wang and Ting Xiao and Minting Pan and Dongzhan Zhou},
journal= {arXiv preprint arXiv:2608.01690},
year = {2026}
}
Comments
15 pages, 13 figures