English
Related papers

Related papers: Dynamic Value Estimation for Single-Task Multi-Sce…

200 papers

We consider problems in sequential decision making with natural multi-level structure, where sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure has remained a…

Machine Learning · Computer Science 2026-03-11 Sichen Yang , Mauro Maggioni

Detecting anomalies in multivariate time series is essential for monitoring complex industrial systems, where high dimensionality, limited labeled data, and subtle dependencies between sensors cause significant challenges. This paper…

Machine Learning · Computer Science 2025-11-18 Bahareh Golchin , Banafsheh Rekabdar

Multi-frame methods improve monocular depth estimation over single-frame approaches by aggregating spatial-temporal information via feature matching. However, the spatial-temporal feature leads to accuracy degradation in dynamic scenes. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiquan Zhong , Xiaolin Huang , Xiao Yu

With increasing demand for efficient image and video analysis, test-time cost of scene parsing becomes critical for many large-scale or time-sensitive vision applications. We propose a dynamic hierarchical model for anytime scene labeling…

Computer Vision and Pattern Recognition · Computer Science 2016-08-12 Buyu Liu , Xuming He

Standard RL algorithms assume fixed environment dynamics and require a significant amount of interaction to adapt to new environments. We introduce Policy-Dynamics Value Functions (PD-VF), a novel approach for rapidly adapting to dynamics…

Machine Learning · Computer Science 2020-07-07 Roberta Raileanu , Max Goldstein , Arthur Szlam , Rob Fergus

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

Machine Learning · Computer Science 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Deep Reinforcement Learning (DRL) has been a promising solution to many complex decision-making problems. Nevertheless, the notorious weakness in generalization among environments prevent widespread application of DRL agents in real-world…

Machine Learning · Computer Science 2022-05-31 Tong Sang , Hongyao Tang , Yi Ma , Jianye Hao , Yan Zheng , Zhaopeng Meng , Boyan Li , Zhen Wang

For real-time semantic video segmentation, most recent works utilised a dynamic framework with a key scheduler to make online key/non-key decisions. Some works used a fixed key scheduling policy, while others proposed adaptive key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Yujiang Wang , Mingzhi Dong , Jie Shen , Yang Wu , Shiyang Cheng , Maja Pantic

Policy gradient methods are appealing in deep reinforcement learning but suffer from high variance of gradient estimate. To reduce the variance, the state value function is applied commonly. However, the effect of the state value function…

Machine Learning · Computer Science 2021-08-06 Jiaming Guo , Rui Zhang , Xishan Zhang , Shaohui Peng , Qi Yi , Zidong Du , Xing Hu , Qi Guo , Yunji Chen

The aim of multi-task reinforcement learning is two-fold: (1) efficiently learn by training against multiple tasks and (2) quickly adapt, using limited samples, to a variety of new tasks. In this work, the tasks correspond to reward…

Machine Learning · Computer Science 2019-11-05 Nicholas C. Landolfi , Garrett Thomas , Tengyu Ma

Recent techniques in dynamical scheduling and resource management have found applications in warehouse environments due to their ability to organize and prioritize tasks in a higher temporal resolution. The rise of deep reinforcement…

Machine Learning · Computer Science 2022-03-08 Stelios Stavroulakis , Biswa Sengupta

This paper investigates the use of prior computation to estimate the value function to improve sample efficiency in on-policy policy gradient methods in reinforcement learning. Our approach is to estimate the value function from prior…

Machine Learning · Computer Science 2023-02-06 Md Masudur Rahman , Yexiang Xue

The development of ethical AI systems is currently geared toward setting objective functions that align with human objectives. However, finding such functions remains a research challenge, while in RL, setting rewards by hand is a fairly…

Artificial Intelligence · Computer Science 2023-10-10 Marcin Korecki , Damian Dailisan , Cesare Carissimo

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Most reinforcement learning algorithms are based on a key assumption that Markov decision processes (MDPs) are stationary. However, non-stationary MDPs with dynamic action space are omnipresent in real-world scenarios. Yet problems of…

Machine Learning · Computer Science 2023-04-04 Jiaqi Ye , Xiaodong Li , Pangjing Wu , Feng Wang

Deep reinforcement learning (DRL) has achieved remarkable success across multiple domains, including competitive games, natural language processing, and robotics. Despite these advancements, policies trained via DRL often struggle to…

Machine Learning · Computer Science 2025-12-30 James Chapman , Kedar Karhadkar , Guido Montufar

Multi-task visual perception has a wide range of applications in scene understanding such as autonomous driving. In this work, we devise an efficient unified framework to solve multiple common perception tasks, including instance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Yuling Xi , Hao Chen , Ning Wang , Peng Wang , Yanning Zhang , Chunhua Shen , Yifan Liu

Optimizing discrete diffusion model (DDM) with rewards remains a challenge: the non-autoregressive paradigm makes importance sampling intractable and rollout complex, puzzling reinforcement learning methods such as Group Relative Policy…

Artificial Intelligence · Computer Science 2025-10-06 Tianren Ma , Mu Zhang , Yibing Wang , Qixiang Ye

Credit assignment is a core challenge in multi-agent reinforcement learning (MARL), especially in large-scale systems with structured, local interactions. Graph-based Markov decision processes (GMDPs) capture such settings via an influence…

Machine Learning · Computer Science 2026-01-19 Ahmed Rashwan , Keith Briggs , Chris Budd , Lisa Kreusser

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi