BEHAVIOR-1K:一个包含 1000 项日常活动与逼真模拟的、以人为中心的具身 AI 基准
机器人学
2024-03-15 v1 人工智能
摘要
我们提出 BEHAVIOR-1K,一个面向以人为中心机器人技术的综合模拟基准。BEHAVIOR-1K 包含两个组成部分,其指导和动机源自一项广泛的调查——“你希望机器人为你做什么?”。第一部分是 1000 项日常活动的定义,这些活动植根于 50 个场景(住宅、花园、餐厅、办公室等),包含超过 9000 个标注了丰富物理和语义属性的物体。第二部分是 OMNIGIBSON,一个新颖的模拟环境,通过对刚体、可变形体和液体的逼真物理模拟与渲染来支持这些活动。我们的实验表明,BEHAVIOR-1K 中的活动具有长周期特性,并依赖于复杂的操作技能,这两者对即使是最先进的机器人学习解决方案也仍是挑战。为校准 BEHAVIOR-1K 的模拟到现实的差距,我们提供了一项初步研究,将在模拟公寓中使用移动操作器学到的解决方案迁移到其真实世界的对应环境中。我们希望 BEHAVIOR-1K 以人为基础的性质、多样性和逼真度,能使其对具身 AI 和机器人学习研究具有价值。项目网站:https://behavior.stanford.edu。
引用
@article{arxiv.2403.09227,
title = {BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulation},
author = {Chengshu Li and Ruohan Zhang and Josiah Wong and Cem Gokmen and Sanjana Srivastava and Roberto Martín-Martín and Chen Wang and Gabrael Levine and Wensi Ai and Benjamin Martinez and Hang Yin and Michael Lingelbach and Minjune Hwang and Ayano Hiranaka and Sujay Garlanka and Arman Aydin and Sharon Lee and Jiankai Sun and Mona Anvari and Manasi Sharma and Dhruva Bansal and Samuel Hunter and Kyu-Young Kim and Alan Lou and Caleb R Matthews and Ivan Villa-Renteria and Jerry Huayang Tang and Claire Tang and Fei Xia and Yunzhu Li and Silvio Savarese and Hyowon Gweon and C. Karen Liu and Jiajun Wu and Li Fei-Fei},
journal= {arXiv preprint arXiv:2403.09227},
year = {2024}
}
备注
A preliminary version was published at 6th Conference on Robot Learning (CoRL 2022)