English
Related papers

Related papers: Learning Representations for Predicting Future Act…

200 papers

Anticipating future actions is a key component of intelligence, specifically when it applies to real-time systems, such as robots or autonomous cars. While recent works have addressed prediction of raw RGB pixel values, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 Fahimeh Rezazadegan , Sareh Shirazi , Mahsa Baktashmotlagh , Larry S. Davis

The ability to simulate the effects of future actions on the world is a crucial ability of intelligent embodied agents, enabling agents to anticipate the effects of their actions and make plans accordingly. While a large body of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Siyuan Zhou , Yilun Du , Yuncong Yang , Lei Han , Peihao Chen , Dit-Yan Yeung , Chuang Gan

Human decision making can be challenging to predict because decisions are affected by a number of complex factors. Adding to this complexity, decision-making processes can differ considerably between individuals, and methods aimed at…

Understanding and mapping a new environment are core abilities of any autonomously navigating agent. While classical robotics usually estimates maps in a stand-alone manner with SLAM variants, which maintain a topological or metric…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Pierre Marza , Laetitia Matignon , Olivier Simonin , Christian Wolf

Intelligent agents can learn to represent the action spaces of other agents simply by observing them act. Such representations help agents quickly learn to predict the effects of their own actions on the environment and to plan complex…

Machine Learning · Computer Science 2019-02-13 Oleh Rybkin , Karl Pertsch , Konstantinos G. Derpanis , Kostas Daniilidis , Andrew Jaegle

The daily activities performed by a disabled or elderly person can be monitored by a smart environment, and the acquired data can be used to learn a predictive model of user behavior. To speed up the learning, several researchers designed…

Machine Learning · Computer Science 2021-01-19 Sharare Zehtabian , Siavash Khodadadeh , Ladislau Bölöni , Damla Turgut

Next activity prediction aims to forecast the future behavior of running process instances. Recent publications in this field predominantly employ deep learning techniques and evaluate their prediction performance using publicly available…

Machine Learning · Computer Science 2023-09-19 Luka Abb , Peter Pfeiffer , Peter Fettke , Jana-Rebecca Rehse

Learning to perform activities through demonstration requires extracting meaningful information about the environment from observations. In this research, we investigate the challenge of planning high-level goal-oriented actions in a…

Machine Learning · Computer Science 2025-07-08 Jing Bi , Chenliang Xu

One of the challenges of full autonomy is to have a robot capable of manipulating its current environment to achieve another environment configuration. This paper is a step towards this challenge, focusing on the visual understanding of the…

Robotics · Computer Science 2020-11-24 Guilherme Maeda , Joni Väätäinen , Hironori Yoshida

Observing that for certain NLP tasks, such as semantic role prediction or thematic fit estimation, random embeddings perform as well as pretrained embeddings, we explore what settings allow for this and examine where most of the learning is…

Computation and Language · Computer Science 2022-10-25 Mughilan Muthupari , Samrat Halder , Asad Sayeed , Yuval Marton

Uncertainty plays a key role in future prediction. The future is uncertain. That means there might be many possible futures. A future prediction method should cover the whole possibilities to be robust. In autonomous driving, covering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Adil Kaan Akan

Predicting an agent's future trajectory is a challenging task given the complicated stimuli (environmental/inertial/social) of motion. Prior works learn individual stimulus from different modules and fuse the representations in an…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Shan Su , Cheng Peng , Jianbo Shi , Chiho Choi

Deep neural networks come in many sizes and architectures. The choice of architecture, in conjunction with the dataset and learning algorithm, is commonly understood to affect the learned neural representations. Yet, recent results have…

Machine Learning · Computer Science 2024-07-08 Loek van Rossem , Andrew M. Saxe

Predicting future observations plays a central role in machine learning, biology, economics, and many other fields. It lies at the heart of organizational principles such as the variational free energy principle and has even been shown --…

Machine Learning · Computer Science 2025-04-09 Lukas J. Fiderer , Paul C. Barth , Isaac D. Smith , Hans J. Briegel

This paper considers neural representation through the lens of active inference, a normative framework for understanding brain function. It delves into how living organisms employ generative models to minimize the discrepancy between…

Neurons and Cognition · Quantitative Biology 2023-10-24 Giovanni Pezzulo , Leo D'Amato , Francesco Mannella , Matteo Priorelli , Toon Van de Maele , Ivilin Peev Stoianov , Karl Friston

Machine Learning algorithms have had a profound impact on the field of computer science over the past few decades. These algorithms performance is greatly influenced by the representations that are derived from the data in the learning…

Neural networks are powerful tools for cognitive modeling due to their flexibility and emergent properties. However, interpreting their learned representations remains challenging due to their sub-symbolic semantics. In this work, we…

Machine Learning · Computer Science 2026-04-07 Andrew Nam , Declan Campbell , Thomas Griffiths , Jonathan Cohen , Sarah-Jane Leslie

A key property of neural networks (both biological and artificial) is how they learn to represent and manipulate input information in order to solve a task. Different types of representations may be suited to different types of tasks,…

Machine Learning · Computer Science 2023-07-18 Ryan Pyle , Sebastian Musslick , Jonathan D. Cohen , Ankit B. Patel

Classical network embeddings create a low dimensional representation of the learned relationships between features across nodes. Such embeddings are important for tasks such as link prediction and node classification. In the current paper,…

Artificial Intelligence · Computer Science 2021-03-15 Chris Connell , Yang Wang

For service robots to become general-purpose in everyday household environments, they need not only a large library of primitive skills, but also the ability to quickly learn novel tasks specified by users. Fine-tuning neural networks on a…

Robotics · Computer Science 2023-01-16 Yuqian Jiang , Qiaozi Gao , Govind Thattai , Gaurav Sukhatme