English
Related papers

Related papers: Multi-model fusion for Aerial Vision and Dialog Na…

200 papers

Unmanned Aerial Vehicles (UAVs) have emerged as a transformative technology across diverse sectors, offering adaptable solutions to complex challenges in both military and civilian domains. Their expanding capabilities present a platform…

Artificial Intelligence · Computer Science 2024-05-06 Shumaila Javaid , Nasir Saeed , Bin He

Autonomous robots and drones will work collaboratively and cooperatively in tomorrow's industry and agriculture. Before this becomes a reality, some form of standardised communication between man and machine must be established that…

Human-Computer Interaction · Computer Science 2020-05-04 Hans Dermot Doran , Monika Reif , Marco Oehler , Curdin Stoehr , Pierluigi Capone

Recent advances in Large Language Models (LLMs) have significantly improved natural language understanding and generation, enhancing Human-Computer Interaction (HCI). However, LLMs are limited to unimodal text processing and lack the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Chenxi Li

Interaction intention anticipation aims to jointly predict future hand trajectories and interaction hotspots. Existing research often treated trajectory forecasting and interaction hotspots prediction as separate tasks or solely considered…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zichen Zhang , Hongchen Luo , Wei Zhai , Yang Cao , Yu Kang

With the growing demand for efficient logistics, unmanned aerial vehicles (UAVs) are increasingly being paired with automated guided vehicles (AGVs). While UAVs offer the ability to navigate through dense environments and varying altitudes,…

With the recently increasing capabilities of modern vehicles, novel approaches for interaction emerged that go beyond traditional touch-based and voice command approaches. Therefore, hand gestures, head pose, eye gaze, and speech have been…

Human-Computer Interaction · Computer Science 2022-11-08 Amr Gomaa

This article presents a method for learning well-coordinated Human-Robot Interaction (HRI) from Human-Human Interactions (HHI). We devise a hybrid approach using Hidden Markov Models (HMMs) as the latent space priors for a Variational…

Predicting the trajectory of pedestrians in crowd scenarios is indispensable in self-driving or autonomous mobile robot field because estimating the future locations of pedestrians around is beneficial for policy decision to avoid…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Yuehai Chen

Smart autonomous agents are becoming increasingly important in various real-life applications, including robotics and autonomous vehicles. One crucial skill that these agents must possess is the ability to interact with their surrounding…

Robotics · Computer Science 2024-08-09 Niyati Rawal , Roberto Bigazzi , Lorenzo Baraldi , Rita Cucchiara

For intelligent quadcopter UAVs, a robust and reliable autonomous planning system is crucial. Most current trajectory planning methods for UAVs are suitable for static environments but struggle to handle dynamic obstacles, which can pose…

Robotics · Computer Science 2023-12-29 Jiageng Zhong , Ming Li , Yinliang Chen , Zihang Wei , Fan Yang , Haoran Shen

Navigating drones through natural language commands remains challenging due to the dearth of accessible multi-modal datasets and the stringent precision requirements for aligning visual and textual data. To address this pressing need, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Meng Chu , Zhedong Zheng , Wei Ji , Tingyu Wang , Tat-Seng Chua

The importance of ground Mobile Robots (MRs) and Unmanned Aerial Vehicles (UAVs) within the research community, industry, and society is growing fast. Many of these agents are nowadays equipped with communication systems that are, in some…

Robotics · Computer Science 2024-04-04 Daniel Bonilla Licea , Mounir Ghogho , Martin Saska

Trustworthiness is a crucial concept in the context of human-robot interaction. Cooperative robots must be transparent regarding their decision-making process, especially when operating in a human-oriented environment. This paper presents a…

Robotics · Computer Science 2024-05-07 Tuba Girgin , Emre Girgin , Yigit Yildirim , Emre Ugur , Mehmet Haklidir

With the recent advancements in AI, Intelligent Virtual Assistants (IVA) have become a ubiquitous part of every home. Going forward, we are witnessing a confluence of vision, speech and dialog system technologies that are enabling the IVAs…

Computation and Language · Computer Science 2018-12-21 Shachi H Kumar , Eda Okur , Saurav Sahay , Juan Jose Alvarado Leanos , Jonathan Huang , Lama Nachman

Human drone interaction in autonomous navigation incorporates spatial interaction tasks, including reconstructed 3D map from the drone and human desired target position. Augmented Reality (AR) devices can be powerful interactive tools for…

Human-Computer Interaction · Computer Science 2020-08-06 Chuhao Liu , Shaojie Shen

Autonomous tracking of flying aerial objects has important civilian and defense applications, ranging from search and rescue to counter-unmanned aerial systems (counter-UAS). Ground based tracking requires setting up infrastructure, could…

Efficient aerial data collection is important in many remote sensing applications. In large-scale monitoring scenarios, deploying a team of unmanned aerial vehicles (UAVs) offers improved spatial coverage and robustness against individual…

Robotics · Computer Science 2023-03-03 Jonas Westheider , Julius Rückin , Marija Popović

Many underwater tasks, such as cable-and-wreckage inspection and search-and-rescue, can benefit from robust Human-Robot Interaction (HRI) capabilities. With the recent advancements in vision-based underwater HRI methods, Autonomous…

Robotics · Computer Science 2025-03-14 Sadman Sakib Enan , Junaed Sattar

In the evolving landscape of high-speed communication, the shift from traditional pilot-based methods to a Sensing-Oriented Approach (SOA) is anticipated to gain momentum. This paper delves into the development of an innovative Integrated…

Numerical Analysis · Mathematics 2024-12-13 Shengcai Zhou , Halvin Yang , Luping Xiang , Kun Yang

Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction. Compared to ground-based VLN, aerial VLN requires the agent to decide the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Ganlong Zhao , Guanbin Li , Jia Pan , Yizhou Yu