English
Related papers

Related papers: SABER: A Scalable Action-Based Embodied Dataset fo…

200 papers

When legged robots perform agile movements, traditional RGB cameras often produce blurred images, posing a challenge for rapid perception. Event cameras have emerged as a promising solution for capturing rapid perception and coping with…

Robotics · Computer Science 2024-07-16 Shifan Zhu , Zixun Xiong , Donghyun Kim

Robotic manipulation in unstructured environments requires reliable execution under diverse conditions, yet many state-of-the-art systems still struggle with high-dimensional action spaces, sparse rewards, and slow generalization beyond…

Robotics · Computer Science 2026-01-30 Leonidas Askianakis , Aleksandr Artemov

\textbf{BEAVR} is an open-source, bimanual, multi-embodiment Virtual Reality (VR) teleoperation system for robots, designed to unify real-time control, data recording, and policy learning across heterogeneous robotic platforms. BEAVR…

Robotics · Computer Science 2025-08-14 Alejandro Posadas-Nava , Alejandro Carrasco , Richard Linares

A critical gap exists between the general-purpose visual understanding of state-of-the-art physical AI models and the specialized perceptual demands of structured real-world deployment environments. We present PRISM, a 270K-sample…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Amirreza Rouhi , Parikshit Sakurikar , Satya Sai Reddy , Narsimha Menga , Anirudh Govil , Sri Harsha Chittajallu , Rajat Aggarwal , Anoop Namboodiri , Sashi Reddi

Artificial intelligence, imaging, and large language models have the potential to transform surgical practice, training, and automation. Understanding and modeling of basic surgical actions (BSA), the fundamental unit of operation in any…

Vision-Language-Action (VLA) models empower robots to understand and execute tasks described by natural language instructions. However, a key challenge lies in their ability to generalize beyond the specific environments and conditions they…

Understanding human actions is critical for advancing behavior analysis in human-robot interaction. Particularly in tasks that demand quick and proactive feedback, robots must recognize human actions as early as possible from incomplete…

Robotics · Computer Science 2026-05-01 Yongpeng Cao , Masahiro Hirano , Hyuno Kim , Yuji Yamakawa

Simulation engines are widely adopted in robotics. However, they lack either full simulation control, ROS integration, realistic physics, or photorealism. Recently, synthetic data generation and realistic rendering has advanced tasks like…

Robotics · Computer Science 2023-05-29 Elia Bonetto , Chenghao Xu , Aamir Ahmad

The systematic evaluation and understanding of computer vision models under varying conditions require large amounts of data with comprehensive and customized labels, which real-world vision datasets rarely satisfy. While current synthetic…

Accurate Angle-of-arrival (AoA) estimation is essential for next-generation wireless communication systems to enable reliable beamforming, high-precision localization, and integrated sensing. Unfortunately, classical high-resolution…

Signal Processing · Electrical Eng. & Systems 2025-10-31 Shih-Kai Chou , Mengran Zhao , Cheng-Nan Hu , Kuang-Chung Chou , Carolina Fortuna , Jernej Hribar

The generalization of vision-language-action (VLA) models heavily relies on diverse training data. However, acquiring large-scale data for robot manipulation across varied object appearances is costly and labor-intensive. To address this…

Artificial Intelligence · Computer Science 2026-03-17 Zhehao Dong , Xiaofeng Wang , Zheng Zhu , Yirui Wang , Yang Wang , Yukun Zhou , Boyuan Wang , Chaojun Ni , Runqi Ouyang , Wenkang Qin , Xinze Chen , Yun Ye , Guan Huang , Zhen Lu , Yue Yang

We introduce ScanBot, a novel dataset designed for instruction-conditioned, high-precision surface scanning in robotic systems. In contrast to existing robot learning datasets that focus on coarse tasks such as grasping, navigation, or…

Robotics · Computer Science 2025-05-26 Zhiling Chen , Yang Zhang , Fardin Jalil Piran , Qianyu Zhou , Jiong Tang , Farhad Imani

Validating Augmented Reality (AR) tracking and interaction models requires precise, repeatable ground-truth motion. However, human users cannot reliably perform consistent motion due to biomechanical variability. Robotic manipulators are…

Robotics · Computer Science 2026-02-09 Harsh Chhajed , Tian Guo

Prevailing Vision-Language-Action Models (VLAs) for robotic manipulation are built upon vision-language backbones pretrained on large-scale, but disconnected static web data. As a result, despite improved semantic generalization, the policy…

Robotics · Computer Science 2025-12-22 Jonas Pai , Liam Achenbach , Victoriano Montesinos , Benedek Forrai , Oier Mees , Elvis Nava

In recent years, significant progress has been made in the field of robotic reinforcement learning (RL), enabling methods that handle complex image observations, train in the real world, and incorporate auxiliary data, such as…

We introduce Being-H0, a dexterous Vision-Language-Action model (VLA) trained on large-scale human videos. Existing VLAs struggle with complex manipulation tasks requiring high dexterity and generalize poorly to novel scenarios and tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hao Luo , Yicheng Feng , Wanpeng Zhang , Sipeng Zheng , Ye Wang , Haoqi Yuan , Jiazheng Liu , Chaoyi Xu , Qin Jin , Zongqing Lu

Multimodal emotion analysis is shifting from static classification to generative reasoning. Beyond simple label prediction, robust affective reasoning must synthesize fine-grained signals such as facial micro-expressions and prosodic which…

Multimedia · Computer Science 2026-02-05 Zhixian Zhao , Wenjie Tian , Lei Xie

In this paper, we introduce an innovative vector quantization based action tokenizer built upon the largest-scale action trajectory dataset to date, leveraging over 100 times more data than previous approaches. This extensive dataset…

Robotics · Computer Science 2025-07-02 Yating Wang , Haoyi Zhu , Mingyu Liu , Jiange Yang , Hao-Shu Fang , Tong He

Robotic manipulation systems operating in diverse, dynamic environments must exhibit three critical abilities: multitask interaction, generalization to unseen scenarios, and spatial memory. While significant progress has been made in…

Robotics · Computer Science 2025-07-15 Haoquan Fang , Markus Grotz , Wilbert Pumacay , Yi Ru Wang , Dieter Fox , Ranjay Krishna , Jiafei Duan

Recent progress in imitation learning from human demonstrations has shown promising results in teaching robots manipulation skills. To further scale up training datasets, recent works start to use portable data collection devices without…

Robotics · Computer Science 2024-10-14 Sirui Chen , Chen Wang , Kaden Nguyen , Li Fei-Fei , C. Karen Liu