English
Related papers

Related papers: Knowledge-Driven Robot Program Synthesis from Huma…

200 papers

To facilitate the wider adoption of robotics, accessible programming tools are required for non-experts. Observational learning enables intuitive human skills transfer through hands-on demonstrations, but relying solely on visual input can…

Robotics · Computer Science 2025-07-29 Elena Merlo , Marta Lagomarsino , Arash Ajoudani

In this study, we investigate how a robot can generate novel and creative actions from its own experience of learning basic actions. Inspired by a machine learning approach to computational creativity, we propose a dynamic neural network…

Robotics · Computer Science 2018-05-16 Jungsik Hwang , Jun Tani

Virtual Reality (VR) has emerged as a powerful tool for workforce training, offering immersive, interactive, and risk-free environments that enhance skill acquisition, decision-making, and confidence. Despite its advantages, developing VR…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Subin Raj Peter

Recent advancements in robotics have increased the possibilities for integrating robotic systems into human-involved workplaces, highlighting the need to examine and optimize human-robot coordination in collaborative settings. This study…

Robotics · Computer Science 2025-11-26 Róisín Keenan , Joost C. Dessing

The emergence of vision catalysed a pivotal evolutionary advancement, enabling organisms not only to perceive but also to interact intelligently with their environment. This transformation is mirrored by the evolution of robotic systems,…

Robotics · Computer Science 2025-03-06 Yuhang Hu , Jiong Lin , Hod Lipson

Learning from human demonstrations is an emerging trend for designing intelligent robotic systems. However, previous methods typically regard videos as instructions, simply dividing them into action sequences for robotic repetition, which…

Robotics · Computer Science 2025-07-18 Te Cui , Tianxing Zhou , Zicai Peng , Mengxiao Hu , Haoyang Lu , Haizhou Li , Guangyan Chen , Meiling Wang , Yufeng Yue

Precise robotic manipulation skills are desirable in many industrial settings, reinforcement learning (RL) methods hold the promise of acquiring these skills autonomously. In this paper, we explicitly consider incorporating operational…

Autonomous robots in unstructured and dynamically changing retail environments have to master complex perception, knowledgeprocessing, and manipulation tasks. To enable them to act competently, we propose a framework based on three core…

We describe an algorithm for motion planning based on expert demonstrations of a skill. In order to teach robots to perform complex object manipulation tasks that can generalize robustly to new environments, we must (1) learn a…

Robotics · Computer Science 2016-02-16 Chris Paxton , Marin Kobilarov , Gregory D. Hager

Visual Robot Manipulation (VRM) aims to enable a robot to follow natural language instructions based on robot states and visual observations, and therefore requires costly multi-modal data. To compensate for the deficiency of robot data,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Dejie Yang , Zijing Zhao , Yang Liu

Hybrid systems are a compact and natural mechanism with which to address problems in robotics. This work introduces an approach to learning hybrid systems from demonstrations, with an emphasis on extracting models that are explicitly…

Robotics · Computer Science 2019-09-12 Michael Burke , Svetlin Penkov , Subramanian Ramamoorthy

Understanding manipulation scenarios allows intelligent robots to plan for appropriate actions to complete a manipulation task successfully. It is essential for intelligent robots to semantically interpret manipulation knowledge by…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chen Jiang , Martin Jagersand

The transition to agile manufacturing, Industry 4.0, and high-mix-low-volume tasks require robot programming solutions that are flexible. However, most deployed robot solutions are still statically programmed and use stiff position control,…

Robotics · Computer Science 2023-08-29 Matthias Mayr , Faseeh Ahmad , Alexander Duerr , Volker Krueger

In this paper we present an approach for learning to imitate human behavior on a semantic level by markerless visual observation. We analyze a set of spatial constraints on human pose data extracted using convolutional pose machines and…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Raphael Memmesheimer , Ivanna Mykhalchyshyna , Viktor Seib , Nick Theisen , Dietrich Paulus

Robotic automation is a key driver for the advancement of technology. The skills of human workers, however, are difficult to program and seem currently unmatched by technical systems. In this work we present a data-driven approach to…

Robotics · Computer Science 2020-02-06 Stefan Scherzinger , Arne Roennau , Rüdiger Dillmann

Scientific models hold the key to better understanding and predicting the behavior of complex systems. The most comprehensive manifestation of a scientific model, including crucial assumptions and parameters that underpin its usability, is…

Software Engineering · Computer Science 2022-03-01 Varish Mulwad , Andrew Crapo , Vijay S. Kumar , James Jobin , Alfredo Gabaldon , Nurali Virani , Sharad Dixit , Narendra Joshi

The control architecture of autonomous robots can be developed by programming and integrating multiple software components that individually control separate behaviors. This approach requires additional mechanisms to coordinate their…

Robotics · Computer Science 2021-03-12 Martin Molina , Pablo Santamaria , Abraham Carrera

Many real-world tasks are intuitive for a human to perform, but difficult to encode algorithmically when utilizing a robot to perform the tasks. In these scenarios, robotic systems can benefit from expert demonstrations to learn how to…

There is a great demand for the robotization of manufacturing processes fea-turing monotonous labor. Some manufacturing tasks requiring specific skills (welding, painting, etc.) suffer from a lack of workers. Robots have been used in these…

Robotics · Computer Science 2022-09-16 Mihail Babcinschi , Francisco Cruz , Nicole Duarte , Silvia Santos , Samuel Alves , Pedro Neto

Manufacturing is facing ever changing market demands, with faster innovation cycles resulting to growing agility and flexibility requirements. Industry 4.0 has been transforming the manufacturing world towards digital automation and the…

Robotics · Computer Science 2024-09-26 Taneli Lohi , Samuli Soutukorva , Tapio Heikkilä