English
Related papers

Related papers: Gesture based Human-Swarm Interactions for Formati…

200 papers

We propose a novel human-swarm interaction system, allowing the user to directly control a swarm of drones in a complex environment through trajectory drawing with a hand gesture interface based on the DNN-based gesture recognition. The…

This paper presents a novel human-robot interaction (HRI) framework that enables intuitive gesture-driven control through a capacitance-based woven tactile skin. Unlike conventional interfaces that rely on panels or handheld devices, the…

A brain-computer interface (BCI) is a system that allows a human operator to use only mental commands in controlling end effectors that interact with the world around them. Such a system consists of a measurement device to record the human…

Signal Processing · Electrical Eng. & Systems 2022-05-31 Gregory Canal , Yancy Diaz-Mercado , Magnus Egerstedt , Christopher Rozell

Swarm robotic systems utilize collective behaviour to achieve goals that might be too complex for a lone entity, but become attainable with localized communication and collective decision making. In this paper, a behaviour-based distributed…

Multiagent Systems · Computer Science 2023-09-06 Akshaya C S , Karthik Soma , Visweswaran B , Aditya Ravichander , Venkata Nagarjun PM

Autonomous swarms of robots can bring robustness, scalability and adaptability to safety-critical tasks such as search and rescue but their application is still very limited. Using semi-autonomous swarms with human control can bring robot…

Robotics · Computer Science 2023-03-24 William Hunt , Jack Ryan , Ayodeji O. Abioye , Sarvapali D. Ramchurn , Mohammad D. Soorati

Human-swarm interaction is facilitated by a low-dimensional encoding of the swarm formation, independent of the (possibly large) number of robots. We propose using image moments to encode two-dimensional formations of robots. Each robot…

To facilitate natural and intuitive interactions with diverse user groups in real-world settings, social robots must be capable of addressing the varying requirements and expectations of these groups while adapting their behavior based on…

Swarm systems consist of large numbers of robots that collaborate autonomously. With an appropriate level of human control, swarm systems could be applied in a variety of contexts ranging from search-and-rescue situations to Cyber defence.…

Human-Computer Interaction · Computer Science 2018-03-09 Aya Hussein , Leo Ghignone , Tung Nguyen , Nima Salimi , Hung Nguyen , Min Wang , Hussein A. Abbass

Conversational Swarm Intelligence (CSI) is a new method for enabling large human groups to hold real-time networked conversations using a technique modeled on the dynamics of biological swarms. Through the novel use of conversational agents…

Human-Computer Interaction · Computer Science 2023-09-08 Louis Rosenberg , Gregg Willcox , Hans Schumann , Miles Bader , Ganesh Mani , Kokoro Sagae , Devang Acharya , Yuxin Zheng , Andrew Kim , Jialing Deng

We present a method for the control of robot swarms using two subsets of robots: a larger group of simple, oblivious robots (which we call the workers) that is governed by simple local attraction forces, and a smaller group (the guides)…

Robotics · Computer Science 2023-07-18 Vivek Shankar Varadharajan , Sepand Dyanatkar , Giovanni Beltrame

We propose a set of communicative gestures and develop a gesture recognition system with the aim of facilitating more intuitive Human-Robot Interaction (HRI) through gestures. First, we propose a set of commands commonly used for…

Robotics · Computer Science 2021-09-22 Jia Chuan A. Tan , Wesley P. Chan , Nicole L. Robinson , Elizabeth A. Croft , Dana Kulic

Formation control is essential for swarm robotics, enabling coordinated behavior in complex environments. In this paper, we introduce a novel formation control system for an indoor blimp swarm using a specialized leader-follower approach…

Robotics · Computer Science 2025-05-15 Tianfu Wu , Jiaqi Fu , Wugang Meng , Sungjin Cho , Huanzhe Zhan , Fumin Zhang

In this paper, we present a systematic method of design for human-swarm interaction interfaces, combining theoretical insights with empirical evaluation. We first derived ten design principles from existing literature, applying them to key…

Human-Computer Interaction · Computer Science 2026-01-30 Wasura D. Wattearachchi , Erandi Lakshika , Kathryn Kasmarik , Michael Barlow

We present Whole-Body Mobile Manipulation Interface (HoMMI), a data collection and policy learning framework that learns whole-body mobile manipulation directly from robot-free human demonstrations. We augment UMI interfaces with egocentric…

Human-Scene Interaction (HSI) is a vital component of fields like embodied AI and virtual reality. Despite advancements in motion quality and physical plausibility, two pivotal factors, versatile interaction control and the development of a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Zeqi Xiao , Tai Wang , Jingbo Wang , Jinkun Cao , Wenwei Zhang , Bo Dai , Dahua Lin , Jiangmiao Pang

Mobile manipulators are increasingly deployed in human-centered environments to perform tasks. While completing such tasks, they should also be able to communicate their intent to the people around them using expressive robot behaviors.…

Robotics · Computer Science 2026-04-24 Souren Pashangpour , Haitong Wang , Matthew Lisondra , Goldie Nejat

Swarm behavior emerges from the local interaction of agents and their environment often encoded as simple rules. Extracting the rules by watching a video of the overall swarm behavior could help us study and control swarm behavior in…

Robotics · Computer Science 2022-09-05 Khulud Alharthi , Zahraa S Abdallah , Sabine Hauert

Hand-object interaction (HOI) is fundamental for humans to express intent. Existing HOI generation research is predominantly confined to fixed grasping patterns, where control is tied to physical priors such as force closure or generic…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Guangyi Han , Wei Zhai , Yuhang Yang , Yang Cao , Zheng-Jun Zha

Current approaches for humanoid whole-body manipulation, primarily relying on teleoperation or visual sim-to-real reinforcement learning, are hindered by hardware logistics and complex reward engineering. Consequently, demonstrated…

Human-Machine Interaction (HMI) systems have gained huge interest in recent years, with reference expression comprehension being one of the main challenges. Traditionally human-machine interaction has been mostly limited to speech and…

Human-Computer Interaction · Computer Science 2023-06-21 Aman Jain , Anirudh Reddy Kondapally , Kentaro Yamada , Hitomi Yanaka