English
Related papers

Related papers: Visual Attention Prediction Improves Performance o…

200 papers

Autonomous tracking of flying aerial objects has important civilian and defense applications, ranging from search and rescue to counter-unmanned aerial systems (counter-UAS). Ground based tracking requires setting up infrastructure, could…

Existing models of human visual attention are generally unable to incorporate direct task guidance and therefore cannot model an intent or goal when exploring a scene. To integrate guidance of any downstream visual task into attention…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Leo Schwinn , Doina Precup , Bjoern Eskofier , Dario Zanca

Predicting driver attention is a critical problem for developing explainable autonomous driving systems and understanding driver behavior in mixed human-autonomous vehicle traffic scenarios. Although significant progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shreedhar Govil , Didier Stricker , Jason Rambach

The potential of multimodal generative artificial intelligence (mAI) to replicate human grounded language understanding, including the pragmatic, context-rich aspects of communication, remains to be clarified. Humans are known to use…

Predicting human motion is critical for assistive robots and AR/VR applications, where the interaction with humans needs to be safe and comfortable. Meanwhile, an accurate prediction depends on understanding both the scene context and human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yang Zheng , Yanchao Yang , Kaichun Mo , Jiaman Li , Tao Yu , Yebin Liu , C. Karen Liu , Leonidas J. Guibas

Visual search is a fundamental natural task for humans and other animals. We investigated the decision processes humans use in covert (single-fixation) search with briefly presented displays having well-separated potential target locations.…

Neurons and Cognition · Quantitative Biology 2025-04-16 Anqi Zhang , Wilson S. Geisler

Gaze and face tracking algorithms have traditionally battled a compromise between computational complexity and accuracy; the most accurate neural net algorithms cannot be implemented in real time, but less complex real-time algorithms…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 George He , Sami Oueida , Tucker Ward

Drone technology is proliferating in many industries, including agriculture, logistics, defense, infrastructure, and environmental monitoring. Vision-based autonomy is one of its key enablers, particularly for real-world applications. This…

To address this gap, we conduct a Virtual Reality experiment in which pedestrians interact with automated shuttles under varying approach angles (45{\deg}, 90{\deg}, 135{\deg}) and continuous-traffic conditions (single shuttle, two shuttles…

Machine Learning · Computer Science 2026-05-25 Danya Li , Yan Feng , Rico Krueger

Autonomous drone racing pushes the boundaries of high-speed motion planning and multi-agent strategic decision-making. Success in this domain requires drones not only to navigate at their limits but also to anticipate and counteract…

Robotics · Computer Science 2026-02-09 Andrei-Carlo Papuc , Lasse Peters , Sihao Sun , Laura Ferranti , Javier Alonso-Mora

Autonomous drone pursuit requires not only detecting drones but also predicting their trajectories in a manner that enables kinematically feasible interception. Existing tracking methods optimize for prediction accuracy but ignore pursuit…

Robotics · Computer Science 2026-02-23 Venkatakrishna Reddy Oruganti

Visual robustness and neural alignment remain critical challenges in developing artificial agents that can match biological vision systems. We present the winning approaches from Team HCMUS_TheFangs for both tracks of the NeurIPS 2025 Mouse…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Phu-Hoa Pham , Chi-Nguyen Tran , Dao Sy Duy Minh , Nguyen Lam Phu Quy , Huynh Trung Kiet

We present a new computational model for gaze prediction in egocentric videos by exploring patterns in temporal shift of gaze fixations (attention transition) that are dependent on egocentric manipulation tasks. Our assumption is that the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Yifei Huang , Minjie Cai , Zhenqiang Li , Yoichi Sato

In recent years, several progressive works promote the development of aerial tracking. One of the representative works is our previous work Fast-tracker which is applicable to various challenging tracking scenarios. However, it suffers from…

Robotics · Computer Science 2021-03-12 Neng Pan , Ruibin Zhang , Tiankai Yang , Chao Xu , Fei Gao

Improving decision-making capabilities in Autonomous Intelligent Vehicles (AIVs) has been a heated topic in recent years. Despite advancements, training machines to capture regions of interest for comprehensive scene understanding, like…

Artificial Intelligence · Computer Science 2025-04-09 Zhuoli Zhuang , Cheng-You Lu , Yu-Cheng Fred Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

End-to-end vision-based imitation learning has demonstrated promising results in autonomous driving by learning control commands directly from expert demonstrations. However, traditional approaches rely on either regressionbased models,…

Robotics · Computer Science 2025-03-04 Elahe Delavari , Aws Khalil , Jaerock Kwon

Top-down attention allows neural networks, both artificial and biological, to focus on the information most relevant for a given task. This is known to enhance performance in visual perception. But it remains unclear how attention brings…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Freddie Bickford Smith , Brett D Roads , Xiaoliang Luo , Bradley C Love

Intention prediction has become a relevant field of research in Human-Machine and Human-Robot Interaction. Indeed, any artificial system (co)-operating with and along humans, designed to assist and coordinate its actions with a human…

Robotics · Computer Science 2025-03-20 Anna Belardinelli

This paper explores the estimation of user attention in the setting of a cooperative handheld robot: a robot designed to behave as a handheld tool but that has levels of task knowledge. We use a tool-mounted gaze tracking system, which,…

Robotics · Computer Science 2018-10-16 Janis Stolzenwald , Walterio W. Mayol-Cuevas

Wildlife monitoring with drones must balance competing demands: approaching close enough to capture behaviorally-relevant video while avoiding stress responses that compromise animal welfare and data validity. Human operators face a…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Jenna Kline , Rugved Katole , Tanya Berger-Wolf , Christopher Stewart