English
Related papers

Related papers: A Self-Adaptive Proposal Model for Temporal Action…

200 papers

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

Machine Learning · Computer Science 2025-05-16 Jonathan Clifford Balloch

Locating actions in long untrimmed videos has been a challenging problem in video content analysis. The performances of existing action localization approaches remain unsatisfactory in precisely determining the beginning and the end of an…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Haonan Qiu , Yingbin Zheng , Hao Ye , Yao Lu , Feng Wang , Liang He

Advances in reinforcement learning (RL) often rely on massive compute resources and remain notoriously sample inefficient. In contrast, the human brain is able to efficiently learn effective control strategies using limited resources. This…

Machine Learning · Computer Science 2024-01-30 Burcu Küçükoğlu , Walraaf Borkent , Bodo Rueckauer , Nasir Ahmad , Umut Güçlü , Marcel van Gerven

We consider the core reinforcement-learning problem of on-policy value function approximation from a batch of trajectory data, and focus on various issues of Temporal Difference (TD) learning and Monte Carlo (MC) policy evaluation. The two…

The ability to plan into the future while utilizing only raw high-dimensional observations, such as images, can provide autonomous agents with broad capabilities. Visual model-based reinforcement learning (RL) methods that plan future…

Machine Learning · Computer Science 2021-08-10 Oleh Rybkin , Chuning Zhu , Anusha Nagabandi , Kostas Daniilidis , Igor Mordatch , Sergey Levine

Human actions captured in video sequences contain two crucial factors for action recognition, i.e., visual appearance and motion dynamics. To model these two aspects, Convolutional and Recurrent Neural Networks (CNNs and RNNs) are adopted…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Yuan Yuan , Dong Wang , Qi Wang

In recommender systems, reinforcement learning solutions have effectively boosted recommendation performance because of their ability to capture long-term user-system interaction. However, the action space of the recommendation policy is a…

Information Retrieval · Computer Science 2023-02-09 Shuchang Liu , Qingpeng Cai , Bowen Sun , Yuhao Wang , Ji Jiang , Dong Zheng , Kun Gai , Peng Jiang , Xiangyu Zhao , Yongfeng Zhang

Well-established optimization-based methods can guarantee an optimal trajectory for a short optimization horizon, typically no longer than a few seconds. As a result, choosing the optimal trajectory for this short horizon may still result…

Machine Learning · Computer Science 2020-12-08 Branka Mirchevska , Maria Hügle , Gabriel Kalweit , Moritz Werling , Joschka Boedecker

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

We present a self-supervised approach for learning video representations using temporal video alignment as a pretext task, while exploiting both frame-level and video-level information. We leverage a novel combination of temporal alignment…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sanjay Haresh , Sateesh Kumar , Huseyin Coskun , Shahram Najam Syed , Andrey Konin , Muhammad Zeeshan Zia , Quoc-Huy Tran

Temporal action proposal generation (TAPG) aims to estimate temporal intervals of actions in untrimmed videos, which is a challenging yet plays an important role in many tasks of video analysis and understanding. Despite the great…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Khoa Vo , Kashu Yamazaki , Sang Truong , Minh-Triet Tran , Akihiro Sugimoto , Ngan Le

This thesis focuses on video understanding for human action and interaction recognition. We start by identifying the main challenges related to action recognition from videos and review how they have been addressed by current methods. Based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alexandros Stergiou

The aim of multi-agent reinforcement learning systems is to provide interacting agents with the ability to collaboratively learn and adapt to the behavior of other agents. In many real-world applications, the agents can only acquire a…

Artificial Intelligence · Computer Science 2019-10-10 Mingyang Geng , Kele Xu , Yiying Li , Shuqi Liu , Bo Ding , Huaimin Wang

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

Machine Learning · Computer Science 2026-01-16 Nadav Merlis

We consider an active visual exploration scenario, where an agent must intelligently select its camera motions to efficiently reconstruct the full environment from only a limited set of narrow field-of-view glimpses. While the agent has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Santhosh K. Ramakrishnan , Kristen Grauman

Present bias, the tendency to overvalue immediate rewards while undervaluing future ones, is a well-known barrier to achieving long-term goals. As artificial intelligence and behavioral economics increasingly focus on this phenomenon, the…

Computer Science and Game Theory · Computer Science 2024-09-18 Yasunori Akagi , Hideaki Kim , Takeshi Kurashima

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new…

Machine Learning · Computer Science 2017-07-25 Tuomas Haarnoja , Haoran Tang , Pieter Abbeel , Sergey Levine

To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture…

Machine Learning · Computer Science 2021-05-04 Kevin Xie , Homanga Bharadhwaj , Danijar Hafner , Animesh Garg , Florian Shkurti

Effective exploration in reinforcement learning requires not only tracking where an agent has been, but also understanding how the agent perceives and represents the world. To learn powerful representations, an agent should actively explore…

Machine Learning · Computer Science 2026-04-21 Faisal Mohamed , Catherine Ji , Benjamin Eysenbach , Glen Berseth

Hierarchical Reinforcement Learning algorithms have successfully been applied to temporal credit assignment problems with sparse reward signals. However, state-of-the-art algorithms require manual specification of sub-task structures, a…

Machine Learning · Computer Science 2019-09-24 Robert Tjarko Lange , Aldo Faisal