English
Related papers

Related papers: CEI: A Unified Interface for Cross-Embodiment Visu…

200 papers

How do we imbue robots with the ability to efficiently manipulate unseen objects and transfer relevant skills based on demonstrations? End-to-end learning methods often fail to generalize to novel objects or unseen configurations. Instead,…

Robotics · Computer Science 2024-05-03 Chuer Pan , Brian Okorn , Harry Zhang , Ben Eisner , David Held

We contend that embodied learning is fundamentally a lifecycle problem rather than a single-stage optimization. Systems that optimize only one link (data collection, simulation, learning, or deployment) rarely sustain improvement or…

Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks. To address the challenge, this paper introduces CEI-3D, an editing-oriented reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yue Shi , Rui Shi , Yuxuan Xiong , Bingbing Ni , Wenjun Zhang

In recent years, the transformer architecture has become the de facto standard for machine learning algorithms applied to natural language processing and computer vision. Despite notable evidence of successful deployment of this…

Robotics · Computer Science 2024-08-13 Carmelo Sferrazza , Dun-Ming Huang , Fangchen Liu , Jongmin Lee , Pieter Abbeel

Due to large intra-subject and inter-subject variabilities of electroencephalogram (EEG) signals, EEG-based brain-computer interfaces (BCIs) usually need subject-specific calibration to tailor the decoding algorithm for each new subject,…

Human-Computer Interaction · Computer Science 2025-07-03 Dongrui Wu

Embodied agents capable of complex physical skills can improve productivity, elevate life quality, and reshape human-machine collaboration. We aim at autonomous training of embodied agents for various tasks involving mainly large foundation…

Robotics · Computer Science 2024-02-14 Sizhe Yang , Qian Luo , Anumpam Pani , Yanchao Yang

Realizing embodied artificial intelligence is challenging due to the huge computation demands of large models (LMs). To support LMs while ensuring real-time inference, embodied edge intelligence (EEI) is a promising paradigm, which…

Robotics · Computer Science 2025-08-18 Guoliang Li , Xibin Jin , Yujie Wan , Chenxuan Liu , Tong Zhang , Shuai Wang , Chengzhong Xu

Embodied AI models often employ off the shelf vision backbones like CLIP to encode their visual observations. Although such general purpose representations encode rich syntactic and semantic information about the scene, much of this…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ainaz Eftekhar , Kuo-Hao Zeng , Jiafei Duan , Ali Farhadi , Ani Kembhavi , Ranjay Krishna

Humanoid robots, as general-purpose physical agents, must integrate both intelligent control and adaptive morphology to operate effectively in diverse real-world environments. While recent research has focused primarily on optimizing…

Robotics · Computer Science 2025-10-06 Guiliang Liu , Bo Yue , Yi Jin Kim , Kui Jia

Learning universal policies from cross-embodied data remains a fundamental challenge in robotics. Although Vision-Language-Action (VLA) models are pre-trained on large and diverse datasets, they typically rely on embodiment-specific…

Robotics · Computer Science 2026-05-26 Boyu Li , Chaoyi Xu , Haoqi Yuan , Xinrun Xu , Börje F. Karlsson , Dongbin Zhao , Haoran Li , Zongqing Lu

Data-driven robotic learning faces an obvious dilemma: robust policies demand large-scale, high-quality demonstration data, yet collecting such data remains a major challenge owing to high operational costs, dependence on specialized…

Robotics · Computer Science 2025-11-13 Yan Huang , Shoujie Li , Xingting Li , Wenbo Ding

Explainability poses a major challenge to artificial intelligence (AI) techniques. Current studies on explainable AI (XAI) lack the efficiency of extracting global knowledge about the learning task, thus suffer deficiencies such as…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Ruitao Xie , Jingbang Chen , Limai Jiang , Rui Xiao , Yi Pan , Yunpeng Cai

Enabling robots to understand language instructions and react accordingly to visual perception has been a long-standing goal in the robotics research community. Achieving this goal requires cutting-edge advances in natural language…

Robotics · Computer Science 2023-09-01 Tianyu Wang , Yifan Li , Haitao Lin , Xiangyang Xue , Yanwei Fu

Optimizing and refining action execution through exploration and interaction is a promising way for robotic manipulation. However, practical approaches to interaction-driven robotic learning are still underexplored, particularly for…

Robotics · Computer Science 2025-09-24 Yibo Peng , Jiahao Yang , Shenhao Yan , Ziyu Huang , Shuang Li , Shuguang Cui , Yiming Zhao , Yatong Han

We propose Embodied AI as the next fundamental step in the pursuit of Artificial General Intelligence, juxtaposing it against current AI advancements, particularly Large Language Models. We traverse the evolution of the embodiment concept…

Artificial Intelligence · Computer Science 2024-09-16 Giuseppe Paolo , Jonas Gonzalez-Billandon , Balázs Kégl

Imitation learning of robot policies from few demonstrations is crucial in open-ended applications. We propose a new method, Interaction Warping, for learning SE(3) robotic manipulation policies from a single demonstration. We infer the 3D…

Embodiment is an important characteristic for all intelligent agents (creatures and robots), while existing scene description tasks mainly focus on analyzing images passively and the semantic understanding of the scenario is separated from…

Robotics · Computer Science 2020-05-08 Sinan Tan , Huaping Liu , Di Guo , Xinyu Zhang , Fuchun Sun

Efficiently training control policies for robots is a major challenge that can greatly benefit from utilizing knowledge gained from training similar systems through cross-embodiment knowledge transfer. In this work, we focus on accelerating…

Robotics · Computer Science 2026-02-18 Welf Rehberg , Mihir Kulkarni , Philipp Weiss , Kostas Alexis

We introduce Being-H0.5, a foundational Vision-Language-Action (VLA) model designed for robust cross-embodiment generalization across diverse robotic platforms. While existing VLAs often struggle with morphological heterogeneity and data…

Recent robot foundation models largely rely on large-scale behavior cloning, which imitates expert actions but discards transferable dynamics knowledge embedded in heterogeneous embodied data. While the Unified World Model (UWM) formulation…