English
Related papers

Related papers: Learning and Anticipating Future Actions During Ex…

200 papers

Human-robot collaboration is on the rise. Robots need to increasingly improve the efficiency and smoothness with which they assist humans by properly anticipating a human's intention. To do so, prediction models need to increase their…

Robotics · Computer Science 2019-01-31 Shuangda Duan , Longxin Chen , Hongmin Wu , Yaxiang Wang , Xuan Zhao , Juan Rojas

The ability to anticipate possible future human actions is essential for a wide range of applications, including autonomous driving and human-robot interaction. Consequently, numerous methods have been introduced for action anticipation in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zeyun Zhong , Manuel Martin , Michael Voit , Juergen Gall , Jürgen Beyerer

We present a novel approach for the visual prediction of human-object interactions in videos. Rather than forecasting the human and object motion or the future hand-object contact points, we aim at predicting (a)the class of the on-going…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Victoria Manousaki , Konstantinos Papoutsakis , Antonis Argyros

One of the fundamental goals of visual perception is to allow agents to meaningfully interact with their environment. In this paper, we take a step towards that long-term goal -- we extract highly localized actionable information related to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Kaichun Mo , Leonidas Guibas , Mustafa Mukadam , Abhinav Gupta , Shubham Tulsiani

Efficient action prediction is of central importance for the fluent workflow between humans and equally so for human-robot interaction. To achieve prediction, actions can be encoded by a series of events, where every event corresponds to a…

Data visualizations are powerful tools for communicating patterns in quantitative data. Yet understanding any data visualization is no small feat -- succeeding requires jointly making sense of visual, numerical, and linguistic inputs…

Human-Computer Interaction · Computer Science 2025-05-26 Arnav Verma , Kushin Mukherjee , Christopher Potts , Elisa Kreiss , Judith E. Fan

A social behavior analysis is used to study how a group of people interacts with another group. The analysis helps to understand how social behavior leads to its consequences such as what business decision is made after a businessmen's…

Social and Information Networks · Computer Science 2016-07-22 Henry Y. T. Ngan , Hideki Kawai , Kazuo Kunieda , Keiji Yamada

The daily activities performed by a disabled or elderly person can be monitored by a smart environment, and the acquired data can be used to learn a predictive model of user behavior. To speed up the learning, several researchers designed…

Machine Learning · Computer Science 2021-01-19 Sharare Zehtabian , Siavash Khodadadeh , Ladislau Bölöni , Damla Turgut

Understanding human actions in visual data is tied to advances in complementary research areas including object recognition, human dynamics, domain adaptation and semantic segmentation. Over the last decade, human action analysis evolved…

Computer Vision and Pattern Recognition · Computer Science 2017-02-02 Samitha Herath , Mehrtash Harandi , Fatih Porikli

A core challenge for an agent learning to interact with the world is to predict how its actions affect objects in its environment. Many existing methods for learning the dynamics of physical interactions require labeled object information.…

Machine Learning · Computer Science 2016-10-19 Chelsea Finn , Ian Goodfellow , Sergey Levine

Visual analytics systems enable highly interactive exploratory data analysis. Across a range of fields, these technologies have been successfully employed to help users learn from complex data. However, these same exploratory visualization…

Human-Computer Interaction · Computer Science 2021-01-25 Zhilan Zhou , Ximing Wen , Yue Wang , David Gotz

To have a robot actively supporting a human during a collaborative task, it is crucial that robots are able to identify the current action in order to predict the next one. Common approaches make use of high-level knowledge, such as object…

Robotics · Computer Science 2017-03-08 Markus Eich , Sareh Shirazi , Gordon Wyeth

The ability to model the underlying dynamics of visual scenes and reason about the future is central to human intelligence. Many attempts have been made to empower intelligent systems with such physical understanding and prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Huilin Xu , Tao Chen , Feng Xu

Virtual and augmented reality systems increasingly demand intelligent adaptation to user behaviors for enhanced interaction experiences. Achieving this requires accurately understanding human intentions and predicting future situated…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yuan Xu , Zimu Zhang , Xiaoxuan Ma , Wentao Zhu , Yu Qiao , Yizhou Wang

One of the most useful techniques to help visual data analysis systems is interactive filtering (brushing). However, visualization techniques often suffer from overlap of graphical items and multiple attributes complexity, making visual…

Graphics · Computer Science 2015-07-07 Jose Rodrigues , Luciana Romani , Agma Traina , Caetano Traina

Anticipating actions and objects before they start or appear is a difficult problem in computer vision with several real-world applications. This task is challenging partly because it requires leveraging extensive knowledge of the world…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Carl Vondrick , Hamed Pirsiavash , Antonio Torralba

Recently, deep learning has been advancing the state of the art in artificial intelligence to a new level, and humans rely on artificial intelligence techniques more than ever. However, even with such unprecedented advancements, the lack of…

Human-Computer Interaction · Computer Science 2018-04-10 Jaegul Choo , Shixia Liu

The understanding of visual analytics process can benefit visualization researchers from multiple aspects, including improving visual designs and developing advanced interaction functions. However, the log files of user behaviors are still…

Human-Computer Interaction · Computer Science 2023-12-05 Zekun Wu , Shahin Doroudian , Aidong Lu

To interact with humans in collaborative environments, machines need to be able to predict (i.e., anticipate) future events, and execute actions in a timely manner. However, the observation of the human limb movements may not be sufficient…

Robotics · Computer Science 2020-06-19 Clebeson Canuto , Plinio Moreno , Jorge Samatelo , Raquel Vassallo , José Santos-Victor

One of the most basic skills a robot should possess is predicting the effect of physical interactions with objects in the environment. This enables optimal action selection to reach a certain goal state. Traditionally, dynamics are…

Robotics · Computer Science 2020-10-13 Alina Kloss , Stefan Schaal , Jeannette Bohg