English
Related papers

Related papers: Measure gradients, not activations! Enhancing neur…

200 papers

Reinforcement learning (RL) tasks are challenging to implement, execute and test due to algorithmic instability, hyper-parameter sensitivity, and heterogeneous distributed communication patterns. We argue for the separation of logical…

Machine Learning · Computer Science 2019-03-04 Michael Schaarschmidt , Sven Mika , Kai Fricke , Eiko Yoneki

Deep neural networks often suffer from poor performance or even training failure due to the ill-conditioned problem, the vanishing/exploding gradient problem, and the saddle point problem. In this paper, a novel method by acting the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Mei Liu , Liangming Chen , Xiaohao Du , Long Jin , Mingsheng Shang

Neural architectures inspired by our own human cognitive system, such as the recently introduced world models, have been shown to outperform traditional deep reinforcement learning (RL) methods in a variety of different domains. Instead of…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Sebastian Risi , Kenneth O. Stanley

We consider the reinforcement learning (RL) problem with general utilities which consists in maximizing a function of the state-action occupancy measure. Beyond the standard cumulative reward RL setting, this problem includes as particular…

Machine Learning · Computer Science 2023-06-06 Anas Barakat , Ilyas Fatkhullin , Niao He

While a powerful and promising approach, deep reinforcement learning (DRL) still suffers from sample inefficiency, which can be notably improved by resorting to more sophisticated techniques to address the exploration-exploitation dilemma.…

Machine Learning · Computer Science 2024-09-10 Jianshu Hu , Paul Weng , Yutong Ban

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

We study the problem of learning a single neuron $\mathbf{x}\mapsto \sigma(\mathbf{w}^T\mathbf{x})$ with gradient descent (GD). All the existing positive results are limited to the case where $\sigma$ is monotonic. However, it is recently…

Machine Learning · Statistics 2022-02-17 Lei Wu

Recently, data augmentation (DA) has emerged as a method for leveraging domain knowledge to inexpensively generate additional data in reinforcement learning (RL) tasks, often yielding substantial improvements in data efficiency. While prior…

Machine Learning · Computer Science 2024-03-19 Nicholas E. Corrado , Josiah P. Hanna

While deep learning and deep reinforcement learning (RL) systems have demonstrated impressive results in domains such as image classification, game playing, and robotic control, data efficiency remains a major challenge. Multi-task learning…

Machine Learning · Computer Science 2020-12-23 Tianhe Yu , Saurabh Kumar , Abhishek Gupta , Sergey Levine , Karol Hausman , Chelsea Finn

Mobile networks are composed of many base stations and for each of them many parameters must be optimized to provide good services. Automatically and dynamically optimizing all these entities is challenging as they are sensitive to…

Machine Learning · Computer Science 2021-10-01 Maxime Bouton , Hasan Farooq , Julien Forgeat , Shruti Bothe , Meral Shirazipour , Per Karlsson

The increase of renewable energy generation towards the zero-emission target is making the problem of controlling power grids more and more challenging. The recent series of competitions Learning To Run a Power Network (L2RPN) have…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Gianvito Losapio , Davide Beretta , Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Graph-based retrieval-augmented generation (RAG) enables large language models (LLMs) to ground responses with structured external knowledge from up-to-date knowledge graphs (KGs) and reduce hallucinations. However, LLMs often rely on a…

Computation and Language · Computer Science 2025-07-01 Deyu Zou , Yongqiang Chen , Mufei Li , Siqi Miao , Chenxi Liu , Bo Han , James Cheng , Pan Li

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Virtual character animation control is a problem for which Reinforcement Learning (RL) is a viable approach. While current work have applied RL effectively to portray physics-based skills, social behaviours are challenging to design reward…

Machine Learning · Computer Science 2021-04-14 Vihanga Gamage , Cathy Ennis , Robert Ross

Deep Neural Networks (or DNNs) must constantly cope with distribution changes in the input data when the task of interest or the data collection protocol changes. Retraining a network from scratch to combat this issue poses a significant…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Pengyu Yuan , Aryan Mobiny , Jahandar Jahanipour , Xiaoyang Li , Pietro Antonio Cicalese , Badrinath Roysam , Vishal Patel , Maric Dragan , Hien Van Nguyen

The ability to estimate temporal relationships is critical for both animals and artificial agents. Cognitive science and neuroscience provide remarkable insights into behavioral and neural aspects of temporal credit assignment. In…

Artificial Intelligence · Computer Science 2024-12-23 Md Rysul Kabir , James Mochizuki-Freeman , Zoran Tiganj

The impressive expressive power of deep neural networks (DNNs) underlies their widespread applicability. However, while the theoretical capacity of deep architectures is high, the practical expressive power achieved through successful…

Machine Learning · Computer Science 2023-12-21 Zezhong Zhang , Feng Bao , Guannan Zhang

Inefficient traffic signal control methods may cause numerous problems, such as traffic congestion and waste of energy. Reinforcement learning (RL) is a trending data-driven approach for adaptive traffic signal control in complex urban…

Signal Processing · Electrical Eng. & Systems 2021-07-14 Zhenning Li , Chengzhong Xu , Guohui Zhang

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

Model-free deep reinforcement learning (RL) agents can learn an effective policy directly from repeated interactions with a black-box environment. However in practice, the algorithms often require large amounts of training experience to…

Machine Learning · Computer Science 2020-05-29 Parth Chadha