English
Related papers

Related papers: AIRoA MoMa Dataset: A Large-Scale Hierarchical Dat…

200 papers

Mobile machines typically working in a closed site, have a high potential to utilize autonomous driving technology. However, vigorously thriving development and innovation are happening mostly in the area of passenger cars. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Yusheng Xiang , Hongzhe Wang , Tianqing Su , Ruoyu Li , Christine Brach , Samuel S. Mao , Marcus Geimer

We present MiniVLA-Nav v1, a simulation dataset for Language-Conditioned Object Approach (LCOA) navigation: given a short natural-language instruction, an NVIDIA Nova Carter differential-drive robot must navigate to the named object and…

Robotics · Computer Science 2026-05-04 Ali Al-Bustami , Jaerock Kwon

Success in generative modeling across language, image, and video demonstrates that large, well-curated datasets are the key driver for building capable models. 3D Human motion, however, has lagged behind, constrained by an unsatisfying…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Jiahao Zhang , Joseph Liu , Young-Yoon Lee , Seonghyeon Moon , Victor Zordan , Guy Tevet , Karen Liu , Stephen Gould , Oren Jacob , Haomiao Jiang , Mubbasir Kapadia , Yizhak Ben-Shabat

Building an interactive AI assistant that can perceive, reason, and collaborate with humans in the real world has been a long-standing pursuit in the AI community. This work is part of a broader research effort to develop intelligent agents…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Xin Wang , Taein Kwon , Mahdi Rad , Bowen Pan , Ishani Chakraborty , Sean Andrist , Dan Bohus , Ashley Feniello , Bugra Tekin , Felipe Vieira Frujeri , Neel Joshi , Marc Pollefeys

The recent advancement of Vision Language Action (VLA) models has driven a critical demand for large scale egocentric datasets. However, existing datasets are often limited by short episode durations, typically spanning only a few minutes,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Senthil Palanisamy , Abhishek Anand , Satpal Singh Rathor , Pratyush Patnaik , Shubhanshu Khatana , Ekaksh Janweja

Scaling Vision-Language-Action models for embodied manipulation demands large volumes of diverse manipulation data, yet the high cost of commercial mobile manipulators and teleoperation interfaces that are difficult to deploy at scale…

Robotics · Computer Science 2026-05-06 Haiqin Cui , Yifu Yuan , Yan Zheng , Jianye Hao

The Human-Object Interaction (HOI) task explores the dynamic interactions between humans and objects in physical environments, providing essential biomechanical and cognitive-behavioral foundations for fields such as robotics, virtual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Ruiyan Wang , Lin Zuo , Zonghao Lin , Qiang Wang , Zhengxue Cheng , Rong Xie , Jun Ling , Li Song

Long-term Human-Robot Collaboration (HRC) is crucial for enabling flexible manufacturing systems and integrating companion robots into daily human environments over extended periods. This paper identifies several key challenges for such…

Robotics · Computer Science 2025-02-05 Peiqi Yu , Abulikemu Abuduweili , Ruixuan Liu , Changliu Liu

Mobile Manipulation (MoMa) of articulated objects, such as opening doors, drawers, and cupboards, demands simultaneous, whole-body coordination between a robot's base and arms. Classical whole-body controllers (WBCs) can solve such problems…

Robotics · Computer Science 2026-04-15 Snehal Jauhri , Vignesh Prasad , Georgia Chalvatzaki

We introduce Nymeria - a large-scale, diverse, richly annotated human motion dataset collected in the wild with multiple multimodal egocentric devices. The dataset comes with a) full-body ground-truth motion; b) multiple multimodal…

Autonomous driving is a popular research area within the computer vision research community. Since autonomous vehicles are highly safety-critical, ensuring robustness is essential for real-world deployment. While several public multimodal…

Long-horizon navigation in complex urban environments relies heavily on continuous human operation, which leads to fatigue, reduced efficiency, and safety concerns. Shared autonomy, where a Vision-Language AI agent and a human operator…

Robotics · Computer Science 2026-04-03 Yukai Ma , Honglin He , Selina Song , Wayne Wu , Bolei Zhou

Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile…

Robotics · Computer Science 2025-02-25 Daniel Honerkamp , Harsh Mahesheka , Jan Ole von Hartz , Tim Welschehold , Abhinav Valada

Modeling human behaviors in contextual environments has a wide range of applications in character animation, embodied AI, VR/AR, and robotics. In real-world scenarios, humans frequently interact with the environment and manipulate various…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Jiaman Li , Jiajun Wu , C. Karen Liu

Robotic manipulation and navigation are fundamental capabilities of embodied intelligence, enabling effective robot interactions with the physical world. Achieving these capabilities requires a cohesive understanding of the environment,…

Robotics · Computer Science 2025-11-18 Xiaoshuai Hao , Yingbo Tang , Lingfeng Zhang , Yanbiao Ma , Yunfeng Diao , Ziyu Jia , Wenbo Ding , Hangjun Ye , Long Chen

Human videos contain rich manipulation priors, but using them for robot learning remains difficult because raw observations entangle scene understanding, human motion, and embodiment-specific action. We introduce MoT-HRA, a hierarchical…

Robotics · Computer Science 2026-05-22 Yifan Xie , YuAn Wang , Guangyu Chen , Jinkun Liu , Yu Sun , Wenbo Ding

Existing Vision-Language Models (VLMs) are predominantly trained on web-scraped, noisy image-text data, exhibiting limited exposure to the specialized domain of RS. This deficiency results in poor performance on RS-specific tasks, as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Angelos Zavras , Dimitrios Michail , Xiao Xiang Zhu , Begüm Demir , Ioannis Papoutsis

Social anxiety is a prevalent condition that affects interpersonal interactions and social functioning. Recent advances in artificial intelligence and social robotics offer new opportunities to examine social anxiety in the human-robot…

Robotics · Computer Science 2025-11-18 Vesna Poprcova , Iulia Lefter , Matthias Wieser , Martijn Warnier , Frances Brazier

In recent years, we have seen an emergence of data-driven approaches in robotics. However, most existing efforts and datasets are either in simulation or focus on a single task in isolation such as grasping, pushing or poking. In order to…

Robotics · Computer Science 2018-10-17 Pratyusha Sharma , Lekha Mohan , Lerrel Pinto , Abhinav Gupta

While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Sirui Xu , Dongting Li , Yucheng Zhang , Xiyan Xu , Qi Long , Ziyin Wang , Yunzhi Lu , Shuchang Dong , Hezi Jiang , Akshat Gupta , Yu-Xiong Wang , Liang-Yan Gui