English
Related papers

Related papers: A Survey on Transformers in Reinforcement Learning

200 papers

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

Machine Learning · Computer Science 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

Machine Learning · Computer Science 2025-06-05 Raj Ghugare , Benjamin Eysenbach

The rapid advancement of Transformer-based models has reshaped the landscape of uncrewed aerial vehicle (UAV) systems by enhancing perception, decision-making, and autonomy. This review paper systematically categorizes and evaluates recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Hamza Kheddar , Yassine Habchi , Mohamed Chahine Ghanem , Mustapha Hemis , Dusit Niyato

Visual Reinforcement Learning is a popular and powerful framework that takes full advantage of the Deep Learning breakthrough. It is known that variations in input domains (e.g., different panorama colors due to seasonal changes) or task…

Machine Learning · Computer Science 2025-02-19 Antonio Pio Ricciardi , Valentino Maiorca , Luca Moschella , Riccardo Marin , Emanuele Rodolà

Deep reinforcement learning is the combination of reinforcement learning (RL) and deep learning. This field of research has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine.…

Machine Learning · Computer Science 2018-12-04 Vincent Francois-Lavet , Peter Henderson , Riashat Islam , Marc G. Bellemare , Joelle Pineau

In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Zhigang Wang , Hangyu Yang , Ning Wang , Chuanfei Xu , Jie Nie , Zhiqiang Wei , Yu Gu , Ge Yu

Language models trained on diverse datasets unlock generalization by in-context learning. Reinforcement Learning (RL) policies can achieve a similar effect by meta-learning within the memory of a sequence model. However, meta-RL research…

Machine Learning · Computer Science 2024-11-19 Jake Grigsby , Justin Sasek , Samyak Parajuli , Daniel Adebi , Amy Zhang , Yuke Zhu

Understanding how learning algorithms shape the computational strategies that emerge in neural networks remains a fundamental challenge in machine intelligence. While network architectures receive extensive attention, the role of the…

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

Generative models have made significant progress in synthesizing visual content, including images, videos, and 3D/4D structures. However, they are typically trained with surrogate objectives such as likelihood or reconstruction loss, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanzhi Liang , Yijie Fang , Ke Hao , Rui Li , Ziqi Ni , Ruijie Su , Chi Zhang

The Transformer model, initially achieving significant success in the field of natural language processing, has recently shown great potential in the application of tactile perception. This review aims to comprehensively outline the…

Machine Learning · Computer Science 2024-05-22 Jing Gao , Ning Cheng , Bin Fang , Wenjuan Han

Vision Transformers (ViT) have recently demonstrated the significant potential of transformer architectures for computer vision. To what extent can image-based deep reinforcement learning also benefit from ViT architectures, as compared to…

Machine Learning · Computer Science 2022-05-17 Tianxin Tao , Daniele Reda , Michiel van de Panne

Transformers are arguably the main workhorse in recent Natural Language Processing research. By definition a Transformer is invariant with respect to reordering of the input. However, language is inherently sequential and word order is…

Computation and Language · Computer Science 2021-09-10 Philipp Dufter , Martin Schmitt , Hinrich Schütze

Transformers have dominated sequence processing tasks for the past seven years -- most notably language modeling. However, the inherent quadratic complexity of their attention mechanism remains a significant bottleneck as context length…

Computation and Language · Computer Science 2025-10-08 Alexander M. Fichtl , Jeremias Bohn , Josefin Kelber , Edoardo Mosca , Georg Groh

Reinforcement learning (RL) has demonstrated strong potential in training large language models (LLMs) capable of complex reasoning for real-world problem solving. More recently, RL has been leveraged to create sophisticated LLM-based…

Computation and Language · Computer Science 2025-05-22 Bowen Jin , Jinsung Yoon , Priyanka Kargupta , Sercan O. Arik , Jiawei Han

Language models (LMs) are being scaled and becoming powerful. Improving their efficiency is one of the core research topics in neural information processing systems. Tay et al. (2022) provided a comprehensive overview of efficient…

Machine Learning · Computer Science 2023-06-06 Meng Jiang , Hy Dang , Lingbo Tong

The Transformer architecture has become increasingly popular over the past two years, owing to its impressive performance on a number of natural language processing (NLP) tasks. However, all Transformer computations occur at the level of…

Machine Learning · Computer Science 2021-04-05 David Donahue , Vladislav Lialin , Anna Rumshisky

One of the biggest hurdles robotics faces is the facet of sophisticated and hard-to-engineer behaviors. Reinforcement learning offers a set of tools, and a framework to address this problem. In parallel, the misgivings of robotics offer a…

Robotics · Computer Science 2022-10-17 Akash Nagaraj , Mukund Sood , Bhagya M Patil

Reinforcement learning (RL) has proven its worth in a series of artificial domains, and is beginning to show some successes in real-world scenarios. However, much of the research advances in RL are often hard to leverage in real-world…

Machine Learning · Computer Science 2019-05-01 Gabriel Dulac-Arnold , Daniel Mankowitz , Todd Hester