English
Related papers

Related papers: Seeing My Future: Predicting Situated Interaction …

200 papers

Safe navigation of autonomous agents in human centric environments requires the ability to understand and predict motion of neighboring pedestrians. However, predicting pedestrian intent is a complex problem. Pedestrian motion is governed…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jasmine Sekhon , Cody Fleming

Advanced perception and path planning are at the core for any self-driving vehicle. Autonomous vehicles need to understand the scene and intentions of other road users for safe motion planning. For urban use cases it is very important to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Adithya Ranga , Filippo Giruzzi , Jagdish Bhanushali , Emilie Wirbel , Patrick Pérez , Tuan-Hung Vu , Xavier Perrotton

Egocentric videos can bring a lot of information about how humans perceive the world and interact with the environment, which can be beneficial for the analysis of human behaviour. The research in egocentric video analysis is developing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ivan Rodin , Antonino Furnari , Dimitrios Mavroedis , Giovanni Maria Farinella

Anticipating how a person will interact with objects in an environment is essential for activity understanding, but existing methods are limited to the 2D space of video frames-capturing physically ungrounded predictions of "what" and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kumar Ashutosh , Georgios Pavlakos , Kristen Grauman

This paper presents an approach to forecast future presence and location of human hands and objects. Given an image frame, the goal is to predict what objects will appear in the future frame (e.g., 5 seconds later) and where they will be…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Chenyou Fan , Jangwon Lee , Michael S. Ryoo

The anticipation of human behavior is a crucial capability for robots to interact with humans safely and efficiently. We employ a smart edge sensor network to provide global observations, future predictions, and goal information to…

Robotics · Computer Science 2025-09-16 Simon Bultmann , Raphael Memmesheimer , Jan Nogga , Julian Hau , Sven Behnke

Predicting the next action that a human is most likely to perform is key to human-AI collaboration and has consequently attracted increasing research interests in recent years. An important factor for next action prediction are human…

Human-Computer Interaction · Computer Science 2024-03-26 Lei Shi , Paul-Christian Bürkner , Andreas Bulling

In the rapidly evolving domain of autonomous systems, interaction among agents within a shared environment is both inevitable and essential for enhancing overall system capabilities. A key requirement in such multi-agent systems is the…

Multiagent Systems · Computer Science 2025-07-31 Timothy Jacob Huber , Madhur Tiwari , Camilo A. Riano-Rios

Robotic navigation through crowds or herds requires the ability to both predict the future motion of nearby individuals and understand how these predictions might change in response to a robot's future action. State of the art trajectory…

Artificial Intelligence · Computer Science 2020-01-29 Stuart Eiffert , Salah Sukkarieh

This paper presents a high-quality human motion prediction method that accurately predicts future human poses given observed ones. Our method is based on the observation that a good initial guess of the future poses is very helpful in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tiezheng Ma , Yongwei Nie , Chengjiang Long , Qing Zhang , Guiqing Li

Virtual environments provide a rich and controlled setting for collecting detailed data on human behavior, offering unique opportunities for predicting human trajectories in dynamic scenes. However, most existing approaches have overlooked…

Artificial Intelligence · Computer Science 2024-11-14 Franz Franco Gallo , Hui-Yin Wu , Lucile Sassatelli

Accurate prediction of pedestrian crossing behaviors by autonomous vehicles can significantly improve traffic safety. Existing approaches often model pedestrian behaviors using trajectories or poses but do not offer a deeper semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Yu Yao , Ella Atkins , Matthew Johnson Roberson , Ram Vasudevan , Xiaoxiao Du

Human intention is an internal, mental characterization for acquiring desired information. From interactive interfaces containing either textual or graphical information, intention to perceive desired information is subjective and strongly…

Human-Computer Interaction · Computer Science 2022-07-07 Shahed Anzarus Sabab , Mohammad Ridwan Kabir , Sayed Rizban Hussain , Hasan Mahmud , Md. Kamrul Hasan , Husne Ara Rubaiyeat

Although First Person Vision systems can sense the environment from the user's perspective, they are generally unable to predict his intentions and goals. Since human activities can be decomposed in terms of atomic actions and interactions…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Antonino Furnari , Sebastiano Battiato , Kristen Grauman , Giovanni Maria Farinella

We present a novel approach for the visual prediction of human-object interactions in videos. Rather than forecasting the human and object motion or the future hand-object contact points, we aim at predicting (a)the class of the on-going…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Victoria Manousaki , Konstantinos Papoutsakis , Antonis Argyros

Predicting future human pose is a fundamental application for machine intelligence, which drives robots to plan their behavior and paths ahead of time to seamlessly accomplish human-robot collaboration in real-world 3D scenarios. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhenyu Lou , Qiongjie Cui , Haofan Wang , Xu Tang , Hong Zhou

Pedestrian trajectory prediction is an important technique of autonomous driving, which has become a research hot-spot in recent years. Previous methods mainly rely on the position relationship of pedestrians to model social interaction,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Pei Lv , Wentong Wang , Yunxin Wang , Yuzhen Zhang , Mingliang Xu , Changsheng Xu

Human motion prediction is a challenging task due to the stochasticity and aperiodicity of future poses. Recently, graph convolutional network has been proven to be very effective to learn dynamic relations among pose joints, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Lingwei Dang , Yongwei Nie , Chengjiang Long , Qing Zhang , Guiqing Li

Spatial computing experiences are constrained by the real-world surroundings of the user. In such experiences, augmenting virtual objects to existing scenes require a contextual approach, where geometrical conflicts are avoided, and…

Graphics · Computer Science 2020-10-01 Mohammad Keshavarzi , Aakash Parikh , Xiyu Zhai , Melody Mao , Luisa Caldas , Allen Y. Yang

A core challenge for an agent learning to interact with the world is to predict how its actions affect objects in its environment. Many existing methods for learning the dynamics of physical interactions require labeled object information.…

Machine Learning · Computer Science 2016-10-19 Chelsea Finn , Ian Goodfellow , Sergey Levine