English
Related papers

Related papers: RadGrad: Active learning with loss gradients

200 papers

Deep reinforcement learning includes a broad family of algorithms that parameterise an internal representation, such as a value function or policy, by a deep neural network. Each algorithm optimises its parameters with respect to an…

Machine Learning · Computer Science 2020-07-17 Zhongwen Xu , Hado van Hasselt , Matteo Hessel , Junhyuk Oh , Satinder Singh , David Silver

Optimizing dynamic risk with stochastic policies is challenging in both policy updates and value learning. The former typically requires transition perturbation, while the latter may rely on model-based approaches. To address these…

Machine Learning · Computer Science 2026-05-11 Yudong Luo , Erick Delage

Existing on-policy imitation learning algorithms, such as DAgger, assume access to a fixed supervisor. However, there are many settings where the supervisor may evolve during policy learning, such as a human performing a novel task or an…

Machine Learning · Computer Science 2020-05-19 Ashwin Balakrishna , Brijen Thananjeyan , Jonathan Lee , Felix Li , Arsh Zahed , Joseph E. Gonzalez , Ken Goldberg

Imitation learning aims to mimic the behavior of experts without explicit reward signals. Passive imitation learning methods which use static expert datasets typically suffer from compounding error, low sample efficiency, and high…

Machine Learning · Computer Science 2023-03-06 Xu-Hui Liu , Feng Xu , Xinyu Zhang , Tianyuan Liu , Shengyi Jiang , Ruifeng Chen , Zongzhang Zhang , Yang Yu

Model-based methods have significantly contributed to distinguishing task-irrelevant distractors for visual control. However, prior research has primarily focused on heterogeneous distractors like noisy background videos, leaving…

Machine Learning · Computer Science 2024-06-06 Yucen Wang , Shenghua Wan , Le Gan , Shuai Feng , De-Chuan Zhan

Cooperative multi-agent problems often require coordination between agents, which can be achieved through a centralized policy that considers the global state. Multi-agent policy gradient (MAPG) methods are commonly used to learn such…

Robotics · Computer Science 2023-08-03 Xubo Lyu , Amin Banitalebi-Dehkordi , Mo Chen , Yong Zhang

The success of deep learning can be attributed to various factors such as increase in computational power, large datasets, deep convolutional neural networks, optimizers etc. Particularly, the choice of optimizer affects the generalization,…

Machine Learning · Computer Science 2021-09-10 Anirudh Maiya , Inumella Sricharan , Anshuman Pandey , Srinivas K. S

Most deep reinforcement learning (RL) algorithms distill experience into parametric behavior policies or value functions via gradient updates. While effective, this approach has several disadvantages: (1) it is computationally expensive,…

Traditionally, Reinforcement Learning (RL) problems are aimed at optimization of the behavior of an agent. This paper proposes a novel take on RL, which is used to learn the policy of another agent, to allow real-time recognition of that…

Artificial Intelligence · Computer Science 2024-07-24 Matan Shamir , Osher Elhadad , Matthew E. Taylor , Reuth Mirsky

Most reinforcement learning (RL) recommendation systems designed for edge computing must either synchronize during recommendation selection or depend on an unprincipled patchwork collection of algorithms. In this work, we build on…

Machine Learning · Computer Science 2022-08-11 James E. Kostas , Philip S. Thomas , Georgios Theocharous

Solving real-life sequential decision making problems under partial observability involves an exploration-exploitation problem. To be successful, an agent needs to efficiently gather valuable information about the state of the world for…

Machine Learning · Computer Science 2020-11-03 Haiyan Yin , Yingzhen Li , Sinno Jialin Pan , Cheng Zhang , Sebastian Tschiatschek

Convolutional neural networks have outperformed humans in image recognition tasks, but they remain vulnerable to attacks from adversarial examples. Since these data are crafted by adding imperceptible noise to normal images, their existence…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Heng Yin , Hengwei Zhang , Jindong Wang , Ruiyu Dou

We introduce a new method inspired by Adam that enhances convergence speed and achieves better loss function minima. Traditional optimizers, including Adam, apply uniform or globally adjusted learning rates across neural networks without…

Machine Learning · Computer Science 2024-11-01 Remi Genet , Hugo Inzirillo

Machine learning algorithms aim to find patterns from observations, which may include some noise, especially in robotics domain. To perform well even with such noise, we expect them to be able to detect outliers and discard them when…

Machine Learning · Computer Science 2020-03-04 Wendyam Eric Lionel Ilboudo , Taisuke Kobayashi , Kenji Sugimoto

We consider the problem of third-person imitation learning with the additional challenge that the learner must select the perspective from which they observe the expert. In our setting, each perspective provides only limited information…

Machine Learning · Computer Science 2023-12-29 Timo Klein , Susanna Weinberger , Adish Singla , Sebastian Tschiatschek

Multi-agent reinforcement learning typically suffers from the problem of sample inefficiency, where learning suitable policies involves the use of many data samples. Learning from external demonstrators is a possible solution that mitigates…

Machine Learning · Computer Science 2023-03-06 Sriram Ganapathi Subramanian , Matthew E. Taylor , Kate Larson , Mark Crowley

Deep Reinforcement Learning (DRL) suffers from uncertainties and inaccuracies in the observation signal in realworld applications. Adversarial attack is an effective method for evaluating the robustness of DRL agents. However, existing…

Machine Learning · Computer Science 2025-01-09 Tianyang Duan , Zongyuan Zhang , Zheng Lin , Yue Gao , Ling Xiong , Yong Cui , Hongbin Liang , Xianhao Chen , Heming Cui , Dong Huang

This paper focuses on reinforcement learning (RL) with limited prior knowledge. In the domain of swarm robotics for instance, the expert can hardly design a reward function or demonstrate the target behavior, forbidding the use of both…

Machine Learning · Computer Science 2012-08-07 Riad Akrour , Marc Schoenauer , Michèle Sebag

Recent advances in Reinforcement Learning (RL) have surpassed human-level performance in many simulated environments. However, existing reinforcement learning techniques are incapable of explicitly incorporating already known…

Artificial Intelligence · Computer Science 2021-02-17 Rukshan Wijesinghe , Kasun Vithanage , Dumindu Tissera , Alex Xavier , Subha Fernando , Jayathu Samarawickrama

Distributed learning has gained significant attention due to its advantages in scalability, privacy, and fault tolerance.In this paradigm, multiple agents collaboratively train a global model by exchanging parameters only with their…

Machine Learning · Computer Science 2026-03-31 Ziqin Chen , Yongqiang Wang