English
Related papers

Related papers: Multi-Domain Motion Embedding: Expressive Real-Tim…

200 papers

Shared dynamics models are important for capturing the complexity and variability inherent in Human-Robot Interaction (HRI). Therefore, learning such shared dynamics models can enhance coordination and adaptability to enable successful…

We propose the Motion Capsule Autoencoder (MCAE), which addresses a key challenge in the unsupervised learning of motion representations: transformation invariance. MCAE models motion in a two-level hierarchy. In the lower level, a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Ziwei Xu , Xudong Shen , Yongkang Wong , Mohan S Kankanhalli

To represent motions from a mechanical point of view, this paper explores motion embedding using the motion taxonomy. With this taxonomy, manipulations can be described and represented as binary strings called motion codes. Motion codes…

Robotics · Computer Science 2020-07-15 David Paulius , Nicholas Eales , Yu Sun

Various adaptive abilities are required for robots interacting with humans in daily life. It is difficult to design adaptive algorithms manually; however, by using end-to-end machine learning, labor can be saved during the design process.…

Robotics · Computer Science 2019-09-20 Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

Data-driven character animation techniques rely on the existence of a properly established model of motion, capable of describing its rich context. However, commonly used motion representations often fail to accurately encode the full…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Nefeli Andreou , Andreas Aristidou , Yiorgos Chrysanthou

Task-oriented object grasping and rearrangement are critical skills for robots to accomplish different real-world manipulation tasks. However, they remain challenging due to partial observations of the objects and shape variations in…

Robotics · Computer Science 2026-03-06 Yichen Cai , Jianfeng Gao , Christoph Pohl , Tamim Asfour

Electromyogram (EMG)-based motion classification using machine learning has been widely employed in applications such as prosthesis control. While previous studies have explored generating synthetic patterns of combined motions to reduce…

Signal Processing · Electrical Eng. & Systems 2025-11-13 Itsuki Yazawa , Akira Furui

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

This paper presents two types of extended diffeomorphism designs to compensate for spatial placement differences between robot workspaces. Teleoperation of multiple robots is attracting attention to expand the utilization of the robot…

Robotics · Computer Science 2025-09-03 Masaki Saito , Shunki Itadera , Toshiyuki Murakami

Retargeting human motion to heterogeneous robots is a fundamental challenge in robotics, primarily due to the severe kinematic and dynamic discrepancies between varying embodiments. Existing solutions typically resort to training…

Robotics · Computer Science 2026-05-27 Haoyu Zhang , Shibo Jin , Lusong Li , Jun Li , Liang Lin , Xiaodong He , Zecui Zeng

Multi-robot systems of increasing size and complexity are used to solve large-scale problems, such as area exploration and search and rescue. A key decision in human-robot teaming is dividing a multi-robot system into teams to address…

Robotics · Computer Science 2020-04-09 Brian Reily , Christopher Reardon , Hao Zhang

We propose a structured prediction approach for robot imitation learning from demonstrations. Among various tools for robot imitation learning, supervised learning has been observed to have a prominent role. Structured prediction is a form…

Imagine sitting at your desk, looking at objects on it. You do not know their exact distances from your eye in meters, but you can immediately reach out and touch them. Instead of an externally defined unit, your sense of distance is tied…

Robotics · Computer Science 2025-09-16 Levi Burner , Cornelia Fermüller , Yiannis Aloimonos

Embedding techniques have become essential components of large databases in the deep learning era. By encoding discrete entities, such as words, items, or graph nodes, into continuous vector spaces, embeddings facilitate more efficient…

Information Retrieval · Computer Science 2024-10-18 Shiwei Li , Zhuoqi Hu , Xing Tang , Haozhao Wang , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

This paper introduces a novel approach for modeling the dynamics of soft robots, utilizing a differentiable filter architecture. The proposed approach enables end-to-end training to learn system dynamics, noise characteristics, and temporal…

Robotics · Computer Science 2023-08-22 Xiao Liu , Shuhei Ikemoto , Yuhei Yoshimitsu , Heni Ben Amor

Subject motion in whole-body dynamic PET introduces inter-frame mismatch and seriously impacts parametric imaging. Traditional non-rigid registration methods are generally computationally intense and time-consuming. Deep learning approaches…

Image and Video Processing · Electrical Eng. & Systems 2022-06-29 Xueqi Guo , Bo Zhou , David Pigg , Bruce Spottiswoode , Michael E. Casey , Chi Liu , Nicha C. Dvornek

Efficient motion intent communication is necessary for safe and collaborative work environments with collocated humans and robots. Humans efficiently communicate their motion intent to other humans through gestures, gaze, and social cues.…

Heterogeneous information networks(HINs) become popular in recent years for its strong capability of modelling objects with abundant information using explicit network structure. Network embedding has been proved as an effective method to…

Machine Learning · Computer Science 2021-04-12 Xinyi Zhang , Lihui Chen

Finding an efficient way to adapt robot trajectory is a priority to improve overall performance of robots. One approach for trajectory planning is through transferring human-like skills to robots by Learning from Demonstrations (LfD). The…

Robotics · Computer Science 2023-04-13 Jayden Hong , Zengjie Zhang , Amir M. Soufi Enayati , Homayoun Najjaran

Partial Differential Equations (PDEs) are fundamental for modeling physical systems, yet solving them in a generic and efficient manner using machine learning-based approaches remains challenging due to limited multi-input and multi-scale…

Machine Learning · Computer Science 2025-08-12 Yichen Luo , Jia Wang , Dapeng Lan , Yu Liu , Zhibo Pang