English
Related papers

Related papers: Simplicial Embeddings Improve Sample Efficiency in…

200 papers

Causal representation learning has attracted significant research interest during the past few years, as a means for improving model generalization and robustness. Causal representations of interventional image pairs (also called…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Panagiotis Alimisis , Christos Diou

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

Machine Learning · Computer Science 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

Deep reinforcement learning (DRL) algorithms require substantial samples and computational resources to achieve higher performance, which restricts their practical application and poses challenges for further development. Given the…

Machine Learning · Computer Science 2024-03-13 Yanxiao Zhao , Yangge Qian , Tianyi Wang , Jingyang Shan , Xiaolin Qin

Physical based simulations can be very time and computationally demanding tasks. One way of accelerating these processes is by making use of data-driven surrogate models that learn from existing simulations. Ensembling methods are…

Machine Learning · Computer Science 2023-12-22 Anthony Kalaydjian , Anton Balykov , Alexi Semiz , Adrien Chan-Hon-Tong

Simplicial complexes form an important class of topological spaces that are frequently used in many application areas such as computer-aided design, computer graphics, and simulation. Representation learning on graphs, which are just 1-d…

Machine Learning · Computer Science 2022-02-03 Mustafa Hajij , Ghada Zamzmi , Theodore Papamarkou , Vasileios Maroulas , Xuanting Cai

Massively parallel GPU simulation environments have accelerated reinforcement learning (RL) research by enabling fast data collection for on-policy RL algorithms like Proximal Policy Optimization (PPO). To maximize throughput, it is common…

Machine Learning · Computer Science 2025-11-27 Sid Bharthulwar , Stone Tao , Hao Su

We design a simple reinforcement learning (RL) agent that implements an optimistic version of $Q$-learning and establish through regret analysis that this agent can operate with some level of competence in any environment. While we leverage…

Machine Learning · Computer Science 2021-07-13 Shi Dong , Benjamin Van Roy , Zhengyuan Zhou

Optimizing the injection process in particle accelerators is crucial for enhancing beam quality and operational efficiency. This paper presents a framework for utilizing Reinforcement Learning (RL) to optimize the injection process at…

Accelerator Physics · Physics 2025-03-19 Awal Awal , Jan Hetzel , Ralf Gebel , Jörg Pretz

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

Machine Learning · Computer Science 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or…

Machine Learning · Computer Science 2022-06-08 Vince Jankovics , Michael Garcia Ortiz , Eduardo Alonso

Highly automated assembly lines enable significant productivity gains in the manufacturing industry, particularly in mass production condition. Nonetheless, challenges persist in job scheduling for make-to-job and mass customization,…

Neural and Evolutionary Computing · Computer Science 2023-11-22 Lele Li , Liyong Lin

The low-level sensory and motor signals in deep reinforcement learning, which exist in high-dimensional spaces such as image observations or motor torques, are inherently challenging to understand or utilize directly for downstream tasks.…

Artificial Intelligence · Computer Science 2023-03-07 Pu Hua , Yubei Chen , Huazhe Xu

Multi-agent reinforcement learning has emerged as a powerful framework for enabling agents to learn complex, coordinated behaviors but faces persistent challenges regarding its generalization, scalability and sample efficiency. Recent…

Robotics · Computer Science 2025-04-28 Nikolaos Bousias , Stefanos Pertigkiozoglou , Kostas Daniilidis , George Pappas

While reinforcement learning has achieved considerable successes in recent years, state-of-the-art models are often still limited by the size of state and action spaces. Model-free reinforcement learning approaches use some form of state…

Machine Learning · Computer Science 2021-08-23 Paul J. Pritz , Liang Ma , Kin K. Leung

Deep reinforcement learning (RL) methods have significant potential for dialogue policy optimisation. However, they suffer from a poor performance in the early stages of learning. This is especially problematic for on-line learning with…

Computation and Language · Computer Science 2017-07-06 Pei-Hao Su , Pawel Budzianowski , Stefan Ultes , Milica Gasic , Steve Young

Improving sample efficiency is central to Reinforcement Learning (RL), especially in environments where the rewards are sparse. Some recent approaches have proposed to specify reward functions as manually designed or learned reward…

Machine Learning · Computer Science 2024-01-26 Shuai Han , Mehdi Dastani , Shihan Wang

Averaging predictions over a set of models -- an ensemble -- is widely used to improve predictive performance and uncertainty estimation of deep learning models. At the same time, many machine learning systems, such as search, matching, and…

Machine Learning · Computer Science 2021-07-15 Arsenii Ashukha , Andrei Atanov , Dmitry Vetrov

Data augmentation (DA) is a crucial technique for enhancing the sample efficiency of visual reinforcement learning (RL) algorithms. Notably, employing simple observation transformations alone can yield outstanding performance without extra…

Machine Learning · Computer Science 2023-10-30 Guozheng Ma , Linrui Zhang , Haoyu Wang , Lu Li , Zilin Wang , Zhen Wang , Li Shen , Xueqian Wang , Dacheng Tao

Reinforcement Learning (RL) agents are often unable to generalise well to environment variations in the state space that were not observed during training. This issue is especially problematic for image-based RL, where a change in just one…

Machine Learning · Computer Science 2023-02-28 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

Robotics · Computer Science 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel