English
Related papers

Related papers: Visual Reaction: Learning to Play Catch with Your …

200 papers

The Earth's surface is continually changing, and identifying changes plays an important role in urban planning and sustainability. Although change detection techniques have been successfully developed for many years, these techniques are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Zhenghang Yuan , Lichao Mou , Zhitong Xiong , Xiaoxiang Zhu

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

Machine Learning · Computer Science 2024-10-22 Nadav Merlis

In order to successfully perform tasks specified by natural language instructions, an artificial agent operating in a visual world needs to map words, concepts, and actions from the instruction to visual elements in its environment. This…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Soumik Dasgupta , Badri N. Patro , Vinay P. Namboodiri

Planning has been very successful for control tasks with known environment dynamics. To leverage planning in unknown environments, the agent needs to learn the dynamics from interactions with the world. However, learning dynamics models…

Machine Learning · Computer Science 2019-06-06 Danijar Hafner , Timothy Lillicrap , Ian Fischer , Ruben Villegas , David Ha , Honglak Lee , James Davidson

Understanding physical phenomena is a key competence that enables humans and animals to act and interact under uncertain perception in previously unseen environments containing novel object and their configurations. Developmental psychology…

Computer Vision and Pattern Recognition · Computer Science 2016-04-04 Wenbin Li , Seyedmajid Azimi , Aleš Leonardis , Mario Fritz

Selective interception of objects in unknown environment autonomously by UAVs is an interesting problem. In this work, vision based interception is carried out. This problem is a part of challenge 1 of Mohammed Bin Zayed International…

Autonomous inspection in hazardous environments requires AI agents that can interpret high-level goals and execute precise control. A key capability for such agents is spatial grounding, for example when a drone must center a detected…

Artificial Intelligence · Computer Science 2025-11-25 Xian Yeow Lee , Lasitha Vidyaratne , Gregory Sin , Ahmed Farahat , Chetan Gupta

Creating lifelike virtual agents capable of interacting with their environments is a longstanding goal in computer graphics. This paper addresses the challenge of generating natural head rotations, a critical aspect of believable agent…

Graphics · Computer Science 2025-02-17 Juyeong Hwang , Seong-Eun Hong , Hyeongyeop Kang

Different from Visual Question Answering task that requires to answer only one question about an image, Visual Dialogue involves multiple questions which cover a broad range of visual content that could be related to any objects,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Xiaoze Jiang , Jing Yu , Zengchang Qin , Yingying Zhuang , Xingxing Zhang , Yue Hu , Qi Wu

This paper addresses the problem of fast learning of radar detectors with a limited amount of training data. In current data-driven approaches for radar detection, re-training is generally required when the operating environment changes,…

Signal Processing · Electrical Eng. & Systems 2021-12-06 Wei Jiang , Alexander M. Haimovich , Mark Govoni , Timothy Garner , Osvaldo Simeone

When working around other agents such as humans, it is important to model their perception capabilities to predict and make sense of their behavior. In this work, we consider agents whose perception capabilities are determined by their…

Robotics · Computer Science 2025-08-12 Maulik Bhatt , HongHao Zhen , Monroe Kennedy , Negar Mehr

Accurately predicting human behaviors is crucial for mobile robots operating in human-populated environments. While prior research primarily focuses on predicting actions in single-human scenarios from an egocentric view, several robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Utsav Panchal , Yuchen Liu , Luigi Palmieri , Ilche Georgievski , Marco Aiello

A commercial robot, trained by its manufacturer to recognize a predefined number and type of objects, might be used in many settings, that will in general differ in their illumination conditions, background, type and degree of clutter, and…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Gabriele Angeletti , Barbara Caputo , Tatiana Tommasi

Video prediction aims to generate realistic future frames by learning dynamic visual patterns. One fundamental challenge is to deal with future uncertainty: How should a model behave when there are multiple correct, equally probable future?…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Yunseok Jang , Gunhee Kim , Yale Song

The drone industry is diversifying and the number of pilots increases rapidly. In this context, flight schools need adapted tools to train pilots, most importantly with regard to their own awareness of their physiological and cognitive…

Human-Computer Interaction · Computer Science 2022-11-01 Alexandre Duval , Anita Paas , Abdalwhab Abdalwhab , David St-Onge

Robotic manipulation can greatly benefit from the data efficiency, robustness, and predictability of model-based methods if robots can quickly generate models of novel objects they encounter. This is especially difficult when effects like…

Robotics · Computer Science 2023-10-19 Bibit Bianchini , Mathew Halm , Michael Posa

Deep reinforcement learning (RL) algorithms can learn complex robotic skills from raw sensory inputs, but have yet to achieve the kind of broad generalization and applicability demonstrated by deep learning methods in supervised domains. We…

Robotics · Computer Science 2018-12-04 Frederik Ebert , Chelsea Finn , Sudeep Dasari , Annie Xie , Alex Lee , Sergey Levine

Robots that physically interact with their surroundings, in order to accomplish some tasks or assist humans in their activities, require to exploit contact forces in a safe and proficient manner. Impedance control is considered as a…

Robotics · Computer Science 2023-09-27 Fares J. Abu-Dakka , Matteo Saveriano

The human ventral temporal cortex (VTC) plays a critical role in object recognition. Although it is well established that visual experience shapes VTC object representations, the impact of semantic and contextual learning is unclear. In…

Neurons and Cognition · Quantitative Biology 2016-04-04 Alex Clarke , Philip J. Pell , Charan Ranganath , Lorraine K. Tyler

Visual question answering is the task of returning the answer to a question about an image. A challenge is that different people often provide different answers to the same visual question. To our knowledge, this is the first work that aims…

Computer Vision and Pattern Recognition · Computer Science 2019-08-16 Nilavra Bhattacharya , Qing Li , Danna Gurari