English
Related papers

Related papers: Natural Interaction Modalities for Human-CPS Inter…

200 papers

Hand gesture recognition has been granted as one of the emerging fields in research today providing a natural way of communication between man and a machine. Gestures are some forms of body motions which a person expresses when doing a work…

Image and Video Processing · Electrical Eng. & Systems 2018-12-27 Biswarup Ganguly , Amit Konar

Robotic platforms are highly programmable, scalable and versatile to complete several tasks including Inspection, Maintenance and Repair (IMR). Mobile robotics offer reduced restrictions in operating environments, resulting in greater…

Robotics · Computer Science 2022-03-25 Daniel Mitchell , Jamie Blanche , Sam T. Harper , Theodore Lim , Valentin Robu , Ikuo Yamamoto , David Flynn

We explore natural user interactions using a virtual reality simulation of a robot arm for assembly tasks. Using a Wizard-of-Oz study, participants completed collaborative LEGO and instructive PCB assembly tasks, with the robot responding…

Human-Computer Interaction · Computer Science 2025-08-26 Ryan Ghamandi , Yahya Hmaiti , Mykola Maslych , Ravi Kiran Kattoju , Joseph J. LaViola

Cooperation among humans makes it easy to execute tasks and navigate seamlessly even in unknown scenarios. With our individual knowledge and collective cognition skills, we can reason about and perform well in unforeseen situations and…

Robotics · Computer Science 2021-08-17 Gourav Kumar , Soumyadip Maity , Ruddra dev Roychoudhury , Brojeshwar Bhowmick

In recent years, autonomous agents have surged in real-world environments such as our homes, offices, and public spaces. However, natural human-robot interaction remains a key challenge. In this paper, we introduce an approach that…

Robotics · Computer Science 2024-10-15 Linus Nwankwo , Elmar Rueckert

Fluent human-human teaming is often characterized by tacit interaction without explicit communication. This is because explicit communication, such as language utterances and gestures, are inherently interruptive. On the other hand, tacit…

Robotics · Computer Science 2023-01-25 Andrew Boateng , Wenlong Zhang , Yu Zhang

Analysing and modelling interactive behaviour is an important topic in human-computer interaction (HCI) and a key requirement for the development of intelligent interactive systems. Interactive behaviour has a sequential (actions happen one…

Human-Computer Interaction · Computer Science 2023-05-15 Guanhua Zhang , Matteo Bortoletto , Zhiming Hu , Lei Shi , Mihai Bâce , Andreas Bulling

Human-Computer Interfaces have always played a fundamental role in usability and commands' interpretability of the modern software systems. With the explosion of the Artificial Intelligence concept, such interfaces have begun to fill the…

Human-Computer Interaction · Computer Science 2021-03-09 Marco Grazioso , Alessandro Sebastian Podda , Silvio Barra , Francesco Cutugno

Recently, it has been widely accepted by the research community that interactions between humans and cyber-physical infrastructures have played a significant role in determining the performance of the latter. The existing paradigm for…

In this project, we design a real-time human-computer interaction system based on hand gesture. The whole system consists of three components: hand detection, gesture recognition and human-computer interaction (HCI) based on recognition;…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Pei Xu

Physical human-robot interaction can improve human ergonomics, task efficiency, and the flexibility of automation, but often requires application-specific methods to detect human state and determine robot response. At the same time, many…

Robotics · Computer Science 2026-02-17 Kevin Haninger , Christian Hegeler , Luka Peternel

Cyber-physical systems (CPS) have been broadly deployed in safety-critical domains, such as automotive systems, avionics, medical devices, etc. In recent years, Artificial Intelligence (AI) has been increasingly adopted to control CPS.…

Software Engineering · Computer Science 2022-04-20 Jiayang Song , Deyun Lyu , Zhenya Zhang , Zhijie Wang , Tianyi Zhang , Lei Ma

The transition from CPS-based Industry 4.0 to CPSS-based Industry 5.0 brings new requirements and opportunities to current sensing approaches, especially in light of recent progress in Chatbots and Large Language Models (LLMs). Therefore,…

Artificial Intelligence · Computer Science 2024-02-13 Zhengqiu Zhu , Yong Zhao , Bin Chen , Sihang Qiu , Kai Xu , Quanjun Yin , Jincai Huang , Zhong Liu , Fei-Yue Wang

The current software development tools show the same form of interaction as when they started back, in the mid 70's. However, since the appearance of visual languages and due to their own nature, they can be handled by tools which have…

Human-Computer Interaction · Computer Science 2012-05-04 Carlos Alberto Fernandez-y-Fernandez , Jose Angel Quintanar

We explain the methodology we developed for improving the interactions accomplished by an embedded conversational agent, drawing from Conversation Analytic sequential and multimodal analysis. The use case is a Pepper robot that is expected…

Artificial Intelligence · Computer Science 2023-08-30 Lucien Tisserand , Frédéric Armetta , Heike Baldauf-Quilliatre , Antoine Bouquin , Salima Hassas , Mathieu Lefort

We propose a component-based semantic model for Cyber-Physical Systems (CPSs) wherein the notion of a component abstracts the internal details of both cyber and physical processes, to expose a uniform semantic model of their externally…

Software Engineering · Computer Science 2021-10-06 Benjamin Lion , Farhad Arbab , Carolyn Talcott

We propose a component-based semantic model for Cyber-Physical Systems (CPSs) wherein the notion of a component abstracts the internal details of both cyber and physical processes, to expose a uniform semantic model of their externally…

Systems and Control · Electrical Eng. & Systems 2022-03-28 Benjamin Lion , Farhad Arbab , Carolyn Talcott

Manual assembly workers face increasing complexity in their work. Human-centered assistance systems could help, but object recognition as an enabling technology hinders sophisticated human-centered design of these systems. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Christian Jauch , Timo Leitritz , Marco F. Huber

In recent years, labor shortages due to the declining birthrate and aging population have become significant challenges at construction sites in developed countries, including Japan. To address these challenges, we are developing an open…

Recent advancements in robotics have increased the possibilities for integrating robotic systems into human-involved workplaces, highlighting the need to examine and optimize human-robot coordination in collaborative settings. This study…

Robotics · Computer Science 2025-11-26 Róisín Keenan , Joost C. Dessing