English
Related papers

Related papers: FastUMI: A Scalable and Hardware-Independent Unive…

200 papers

High-fidelity motion tracking serves as the ultimate litmus test for generalizable, human-level motor skills. However, current policies often hit a "generality barrier": as motion libraries scale in diversity, tracking fidelity inevitably…

Humanoid robots capable of autonomous operation in diverse environments have long been a goal for roboticists. However, autonomous manipulation by humanoid robots has largely been restricted to one specific scene, primarily due to the…

Robotics · Computer Science 2025-09-10 Yanjie Ze , Zixuan Chen , Wenhao Wang , Tianyi Chen , Xialin He , Ying Yuan , Xue Bin Peng , Jiajun Wu

Recently, robotics has advanced significantly through the integration of larger models and large-scale datasets. However, challenges remain in applying these models to 3D spatial interactions and managing data collection costs. To address…

Robotics · Computer Science 2025-11-05 Feng Yan , Fanfan Liu , Liming Zheng , Yufeng Zhong , Yiyang Huang , Zechao Guan , Chengjian Feng , Lin Ma

Robotic manipulation requires both rich multimodal perception and effective learning frameworks to handle complex real-world tasks. See-through-skin (STS) sensors, which combine tactile and visual perception, offer promising sensing…

Robotics · Computer Science 2026-02-10 Yuyang Li , Yinghan Chen , Zihang Zhao , Puhao Li , Tengyu Liu , Siyuan Huang , Yixin Zhu

Imitation learning is a powerful paradigm for robot skill acquisition, yet conventional demonstration methods--such as kinesthetic teaching and teleoperation--are cumbersome, hardware-heavy, and disruptive to workflows. Recently, passive…

Robotics · Computer Science 2025-09-30 Rohan Walia , Yusheng Wang , Ralf Römer , Masahiro Nishio , Angela P. Schoellig , Jun Ota

Planning physically feasible dexterous hand manipulation is a central challenge in robotic manipulation and Embodied AI. Prior work typically relies on object-centric cues or precise hand-object interaction sequences, foregoing the rich,…

Robotics · Computer Science 2026-03-03 Zhenhao Zhang , Jiaxin Liu , Ye Shi , Jingya Wang

World models allow autonomous agents to plan and explore by predicting the visual outcomes of different actions. However, for robot manipulation, it is challenging to accurately model the fine-grained robot-object interaction within the…

Robotics · Computer Science 2025-07-30 Fangqi Zhu , Hongtao Wu , Song Guo , Yuxiao Liu , Chilam Cheang , Tao Kong

The inherent difficulty and limited scalability of collecting manipulation data using multi-fingered robot hand hardware platforms have resulted in severe data scarcity, impeding research on data-driven dexterous manipulation policy…

Robotics · Computer Science 2025-11-17 Wenbin Bai , Qiyu Chen , Xiangbo Lin , Jianwen Li , Quancheng Li , Hejiang Pan , Yi Sun

This paper presents a control interface to translate the residual body motions of individuals living with severe disabilities, into control commands for body-machine interaction. A custom, wireless, wearable multi-sensor network is used to…

Dexterous in-hand manipulation is a long-standing challenge in robotics due to complex contact dynamics and partial observability. While humans synergize vision and touch for such tasks, robotic approaches often prioritize one modality,…

Robotics · Computer Science 2025-08-21 Yijin Chen , Wenqiang Xu , Zhenjun Yu , Tutian Tang , Yutong Li , Siqiong Yao , Cewu Lu

Learning a general whole-body controller for humanoid robots remains challenging due to the diversity of motion distributions, the difficulty of fast adaptation, and the need for robust balance in high-dynamic scenarios. Existing approaches…

We tackle the challenges of synthesizing versatile, physically simulated human motions for full-body object manipulation. Unlike prior methods that are focused on detailed motion tracking, trajectory following, or teleoperation, our…

Robotics · Computer Science 2025-12-12 Chen Tessler , Yifeng Jiang , Erwin Coumans , Zhengyi Luo , Gal Chechik , Xue Bin Peng

As technological advancements continue to expand the capabilities of multi unmanned-aerial-vehicle systems (mUAV), human operators face challenges in scalability and efficiency due to the complex cognitive load and operations associated…

Robotics · Computer Science 2024-03-11 Mengsha Hu , Jinzhou Li , Runxiang Jin , Chao Shi , Lei Xu , Rui Liu

Large-scale robot datasets have facilitated the learning of a wide range of robot manipulation skills, but these datasets remain difficult to collect and scale further, owing to the intractable amount of human time, effort, and cost…

Robotics · Computer Science 2026-03-27 Masoud Moghani , Mahdi Azizian , Animesh Garg , Yuke Zhu , Sean Huver , Ajay Mandlekar

We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information…

The acquisition of high-quality, action-aligned demonstration data remains a fundamental bottleneck in scaling foundation models for dexterous robot manipulation. Although robot-free human demonstrations (e.g., the UMI paradigm) offer a…

Imitation learning is a powerful tool for training robot manipulation policies, allowing them to learn from expert demonstrations without manual programming or trial-and-error. However, common methods of data collection, such as human…

Robotics · Computer Science 2023-10-18 Murtaza Dalal , Ajay Mandlekar , Caelan Garrett , Ankur Handa , Ruslan Salakhutdinov , Dieter Fox

We introduce UMI-on-Air, a framework for embodiment-aware deployment of embodiment-agnostic manipulation policies. Our approach leverages diverse, unconstrained human demonstrations collected with a handheld gripper (UMI) to train…

Robotics · Computer Science 2026-03-17 Harsh Gupta , Xiaofeng Guo , Huy Ha , Chuer Pan , Muqing Cao , Dongjae Lee , Sebastian Scherer , Shuran Song , Guanya Shi

The pervasive uncertainty and dynamic nature of real-world environments present significant challenges for the widespread implementation of machine-driven Intelligent Decision-Making (IDM) systems. Consequently, IDM should possess the…

Artificial Intelligence · Computer Science 2023-05-17 Ying Wen , Ziyu Wan , Ming Zhou , Shufang Hou , Zhe Cao , Chenyang Le , Jingxiao Chen , Zheng Tian , Weinan Zhang , Jun Wang

In this paper, we introduce fastHDMI, a Python package designed for efficient variable screening in high-dimensional datasets, particularly neuroimaging data. This work pioneers the application of three mutual information estimation methods…

Machine Learning · Statistics 2024-10-15 Kai Yang , Masoud Asgharian , Nikhil Bhagwat , Jean-Baptiste Poline , Celia M. T. Greenwood