English
Related papers

Related papers: Stochastic Actor-Executor-Critic for Image-to-Imag…

200 papers

This paper presents an actor-critic deep reinforcement learning agent with experience replay that is stable, sample efficient, and performs remarkably well on challenging environments, including the discrete 57-game Atari domain and several…

Machine Learning · Computer Science 2017-07-11 Ziyu Wang , Victor Bapst , Nicolas Heess , Volodymyr Mnih , Remi Munos , Koray Kavukcuoglu , Nando de Freitas

In cooperative stochastic games multiple agents work towards learning joint optimal actions in an unknown environment to achieve a common goal. In many real-world applications, however, constraints are often imposed on the actions that can…

Multiagent Systems · Computer Science 2020-07-14 Raghuram Bharadwaj Diddigi , Sai Koti Reddy Danda , Prabuchandran K. J. , Shalabh Bhatnagar

The actor-critic (AC) framework has achieved strong empirical success in off-policy reinforcement learning but suffers from the "moving target" problem, where the evaluated policy changes continually. Functional critics, or…

Machine Learning · Computer Science 2026-02-10 Qinxun Bai , Yuxuan Han , Wei Xu , Zhengyuan Zhou

Hidden confounders that influence both states and actions can bias policy learning in reinforcement learning (RL), leading to suboptimal or non-generalizable behavior. Most RL algorithms ignore this issue, learning policies from…

Machine Learning · Computer Science 2025-06-09 Thanh Vinh Vo , Young Lee , Haozhe Ma , Chien Lu , Tze-Yun Leong

Large-scale text-to-image diffusion models have become the backbone of modern image editing, yet text prompts alone do not offer adequate control over the editing process. Two properties are especially desirable: disentanglement, where…

Graphics · Computer Science 2025-10-07 Ronen Kamenetsky , Sara Dorfman , Daniel Garibi , Roni Paiss , Or Patashnik , Daniel Cohen-Or

We present research using the latest reinforcement learning algorithm for end-to-end driving without any mediated perception (object recognition, scene understanding). The newly proposed reward and learning strategies lead together to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Maximilian Jaritz , Raoul de Charette , Marin Toromanoff , Etienne Perot , Fawzi Nashashibi

Recent progress on physics-based character animation has shown impressive breakthroughs on human motion synthesis, through imitating motion capture data via deep reinforcement learning. However, results have mostly been demonstrated on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Yu-Wei Chao , Jimei Yang , Weifeng Chen , Jia Deng

We present a methodology to deploy the stochastic policy gradient method, using actor-critic techniques, when the optimal policy is approximated using a parametric optimization problem, allowing one to enforce safety via hard constraints.…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Sebastien Gros , Mario Zanon

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

Machine Learning · Computer Science 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

Learning on synthetic data and transferring the resulting properties to their real counterparts is an important challenge for reducing costs and increasing safety in machine learning. In this work, we focus on autoencoder architectures and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

Visual reinforcement learning is appealing for robotics but expensive -- off-policy methods are sample-efficient yet slow; on-policy methods parallelize well but waste samples. Recent work has shown that off-policy methods can train faster…

Robotics · Computer Science 2026-02-25 Abdulaziz Almuzairee , Henrik I. Christensen

Video generative models can be regarded as world simulators due to their ability to capture dynamic, continuous changes inherent in real-world environments. These models integrate high-dimensional information across visual, temporal,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Hengyuan Cao , Yutong Feng , Biao Gong , Yijing Tian , Yunhong Lu , Chuang Liu , Bin Wang

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

In X-ray Computed Tomography (CT), projections from many angles are acquired and used for 3D reconstruction. To make CT suitable for in-line quality control, reducing the number of angles while maintaining reconstruction quality is…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Tianyuan Wang , Felix Lucka , Tristan van Leeuwen

Packet dropouts in control systems poses a critical challenge, as it can significantly compromise system performance and stability. In these conditions, classical controllers often struggle to deliver effective control, as they rely on…

Systems and Control · Electrical Eng. & Systems 2026-05-29 Kianoush Aqabakee , Kosar Behnia , Amirhossein Heydarian Ardakani , Farzaneh Abdollahi , Elham Shirazi

Customization of text-to-image models enables users to insert new concepts or objects and generate them in unseen settings. Existing methods either rely on comparatively expensive test-time optimization or train encoders on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Nupur Kumari , Xi Yin , Jun-Yan Zhu , Ishan Misra , Samaneh Azadi

The oscillating performance of off-policy learning and persisting errors in the actor-critic (AC) setting call for algorithms that can conservatively learn to suit the stability-critical applications better. In this paper, we propose a…

Machine Learning · Computer Science 2021-10-06 Lingwei Zhu , Toshinori Kitamura , Takamitsu Matsubara

In the trial-and-error mechanism of reinforcement learning (RL), a notorious contradiction arises when we expect to learn a safe policy: how to learn a safe policy without enough data and prior model about the dangerous region? Existing…

Machine Learning · Computer Science 2021-11-29 Haitong Ma , Changliu Liu , Shengbo Eben Li , Sifa Zheng , Wenchao Sun , Jianyu Chen

Optimal control and sequential decision making are widely used in many complex tasks. Optimal control over a sequence of natural images is a first step towards understanding the role of vision in control. Here, we formalize this problem as…

Machine Learning · Computer Science 2026-05-07 Peter N. Loxley

Despite definite success in deep reinforcement learning problems, actor-critic algorithms are still confronted with sample inefficiency in complex environments, particularly in tasks where efficient exploration is a bottleneck. These…

Machine Learning · Computer Science 2021-02-09 Yannis Flet-Berliac , Johan Ferret , Olivier Pietquin , Philippe Preux , Matthieu Geist