English
Related papers

Related papers: Towards Intuitive HMI for UAV Control

200 papers

In this paper, we propose and evaluate a novel human-machine interface (HMI) for controlling a standing mobility vehicle or person carrier robot, aiming for a hands-free control through upper-body natural postures derived from gaze tracking…

Robotics · Computer Science 2022-12-15 Yang Chen , Diego Paez-Granados , Hideki Kadone , Kenji Suzuki

We present an intuitive human-drone interaction system that utilizes a gesture-based motion controller to enhance the drone operation experience in real and simulated environments. The handheld motion controller enables natural control of…

Robotics · Computer Science 2025-04-15 Daria Trinitatova , Sofia Shevelo , Dzmitry Tsetserukou

Harnessing human movements to command an Unmanned Aerial Vehicle (UAV) holds the potential to revolutionize their deployment, rendering it more intuitive and user-centric. In this research, we introduce a novel methodology adept at…

Robotics · Computer Science 2024-08-20 Akash Chaudhary , Tiago Nascimento , Martin Saska

As technological advancements continue to expand the capabilities of multi unmanned-aerial-vehicle systems (mUAV), human operators face challenges in scalability and efficiency due to the complex cognitive load and operations associated…

Robotics · Computer Science 2024-03-11 Mengsha Hu , Jinzhou Li , Runxiang Jin , Chao Shi , Lei Xu , Rui Liu

Most human-robot interfaces, such as joysticks and keyboards, require training and constant cognitive effort and provide a limited degree of awareness of the robots state and its environment. Embodied interactions, instead of interfaces,…

Robotics · Computer Science 2017-07-07 Alexandre Cherpillod , Stefano Mintchev , Dario Floreano

Unmanned Aerial Vehicles (UAVs) are increasingly deployed in close proximity to humans for applications such as parcel delivery, traffic monitoring, disaster response and infrastructure inspections. Ensuring safe and reliable operation in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hassaan Farooq , Marvin Brenner , Peter Stütz

With the rapid development of Aerial Physical Interaction, the possibility to have aerial robots physically interacting with humans is attracting a growing interest. In one of our previous works, we considered one of the first systems in…

Robotics · Computer Science 2022-03-08 Mike Allenspach , Yash Vyas , Matthias Rubio , Roland Siegwart , Marco Tognon

As the capability and complexity of UAVs continue to increase, the human-robot interface community has a responsibility to design better ways of specifying the complex 3D flight paths necessary for instructing them. Immersive interfaces,…

Human-Computer Interaction · Computer Science 2019-04-19 Jesse Paterson , Jiwoong Han , Tom Cheng , Paxtan Laker , David McPherson , Joseph Menke , Allen Yang

Unmanned Aerial Vehicles (UAVs) became very popular in a vast number of applications in recent years, especially drones with computer vision functions enabled by on-board cameras and embedded systems. Many of them apply object detection…

Signal Processing · Electrical Eng. & Systems 2020-01-15 Diego Dantas , Carnot Braun , Kaio Forte , Flavio Brito , Andrey Silva , Silvia Lins , Neiva Linder , Aldebaro Klautau

While autonomous Uncrewed Aerial Vehicles (UAVs) have grown rapidly, most applications only focus on passive visual tasks. Aerial interaction aims to execute tasks involving physical interactions, which offers a way to assist humans in…

Robotics · Computer Science 2023-10-03 Xiaofeng Guo , Guanqi He , Mohammadreza Mousaei , Junyi Geng , Guanya Shi , Sebastian Scherer

Gesture recognition presents a promising avenue for interfacing with unmanned aerial vehicles (UAVs) due to its intuitive nature and potential for precise interaction. This research conducts a comprehensive comparative analysis of…

Robotics · Computer Science 2025-05-26 Sousannah Abdalla , Sabur Baidya

Current UAV-recorded datasets are mostly limited to action recognition and object tracking, whereas the gesture signals datasets were mostly recorded in indoor spaces. Currently, there is no outdoor recorded public video dataset for UAV…

Machine Learning · Computer Science 2019-01-10 Asanka G Perera , Yee Wei Law , Javaan Chahl

This paper presents a formation control approach for contactless gesture-based Human-Swarm Interaction (HSI) between a team of multi-rotor Unmanned Aerial Vehicles (UAVs) and a human worker. The approach is designed to monitor the safety of…

Controlling Unmanned Aerial Vehicles (UAVs) is a cognitively demanding task, with accidents often arising from insufficient situational awareness, inadequate training, and poor user experiences. Providing more intuitive and immersive visual…

Humans process significantly more information through the sense of touch than through vision. Consequently, haptics for telemanipulation is poised to become essential in the coming years, as it offers operators an additional sensory channel…

Robotics · Computer Science 2025-02-25 Julien Mellet , Fabio Ruggiero , Vincenzo Lippiello

When humans control drones, cars, and robots, we often have some preconceived notion of how our inputs should make the system behave. Existing approaches to teleoperation typically assume a one-size-fits-all approach, where the designers…

Robotics · Computer Science 2020-07-24 Mengxi Li , Dylan P. Losey , Jeannette Bohg , Dorsa Sadigh

While shared autonomy offers significant potential for assistive robotics, key questions remain about how to effectively map 2D control inputs to 6D robot motions. An intuitive framework should allow users to input commands effortlessly,…

Robotics · Computer Science 2025-01-29 Shalutha Rajapakshe , Jean-Marc Odobez , Emmanuel Senft

Considering the widespread integration of aerial robots in inspection, search and rescue, and monitoring tasks, there is a growing demand to design intuitive human-drone interfaces. These aim to streamline and enhance the user interaction…

This paper presents Glove2UAV, a wearable IMU-glove interface for intuitive UAV control through hand and finger gestures, augmented with vibrotactile warnings for exceeding predefined speed thresholds. To promote safer and more predictable…

The control of collective robotic systems, such as drone swarms, is often delegated to autonomous navigation algorithms due to their high dimensionality. However, like other robotic entities, drone swarms can still benefit from being…

Robotics · Computer Science 2021-03-16 Matteo Macchini , Ludovic De Matteïs , Fabrizio Schiano , Dario Floreano
‹ Prev 1 2 3 10 Next ›