English
Related papers

Related papers: The Indoor-Training Effect: unexpected gains from …

200 papers

We introduce a new unsupervised pre-training method for reinforcement learning called APT, which stands for Active Pre-Training. APT learns behaviors and representations by actively searching for novel states in reward-free environments.…

Machine Learning · Computer Science 2021-10-29 Hao Liu , Pieter Abbeel

Recently, the field of hardware neural networks has been actively developing, where neurons and their connections are not simulated on a computer but are implemented at the physical level, transforming the neural network into a tangible…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Ivan Kolesnikov , Nadezhda Semenova

In the industrial interior design process, professional designers plan the size and position of furniture in a room to achieve a satisfactory design for selling. In this paper, we explore the interior scene design task as a Markov decision…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Xinhan Di , Pengqian Yu

In an increasing number of domains it has been demonstrated that deep learning models can be trained using relatively large batch sizes without sacrificing data efficiency. However the limits of this massive data parallelism seem to differ…

Machine Learning · Computer Science 2018-12-18 Sam McCandlish , Jared Kaplan , Dario Amodei , OpenAI Dota Team

We discuss intrinsic noise effects in stochastic multiplicative-noise partial differential equations, which are qualitatively independent of the noise interpretation (Ito vs. Stratonovich), in particular in the context of noise-induced…

Statistical Mechanics · Physics 2009-11-10 O. Carrillo , M. Ibanes , J. Garcia-Ojalvo , J. Casademunt , J. M. Sancho

Demographic noise has profound effects on evolutionary and population dynamics, as well as on chemical reaction systems and models of epidemiology. Such noise is intrinsic and due to the discreteness of the dynamics in finite populations.…

Physics and Society · Physics 2015-05-14 Tobias Galla

It has been shown that injecting noise into the neural network weights during the training process leads to a better generalization of the resulting model. Noise injection in the distributed setup is a straightforward technique and it…

Machine Learning · Computer Science 2018-10-01 Linara Adilova , Nathalie Paul , Peter Schlicht

Deep reinforcement learning (DRL) requires large samples and a long training time to operate optimally. Yet humans rarely require long periods training to perform well on novel tasks, such as computer games, once they are provided with an…

Machine Learning · Computer Science 2021-08-05 Tauseef Gulrez , Warren Mansell

Real world datasets contain incorrectly labeled instances that hamper the performance of the model and, in particular, the ability to generalize out of distribution. Also, each example might have different contribution towards learning.…

Data efficiency is a key challenge for deep reinforcement learning. We address this problem by using unlabeled data to pretrain an encoder which is then finetuned on a small amount of task-specific data. To encourage learning…

Ever since Axelrod's seminal work, tournaments served as the main benchmark for evaluating strategies in the Iterated Prisoner's Dilemma (IPD). In this work, we first introduce a strategy for the IPD which outperforms previous tournament…

Computer Science and Game Theory · Computer Science 2023-03-08 Adrian Hutter

Reinforcement learning has enabled agents to solve challenging tasks in unknown environments. However, manually crafting reward functions can be time consuming, expensive, and error prone to human error. Competing objectives have been…

Machine Learning · Computer Science 2021-02-11 Brendon Matusch , Jimmy Ba , Danijar Hafner

A central task in control theory, artificial intelligence, and formal methods is to synthesize reward-maximizing strategies for agents that operate in partially unknown environments. In environments modeled by gray-box Markov decision…

Machine Learning · Computer Science 2023-04-25 Christel Baier , Clemens Dubslaff , Patrick Wienhöft , Stefan J. Kiebel

In many real-world problems, there is the possibility to configure, to a limited extent, some environmental parameters to improve the performance of a learning agent. In this paper, we propose a novel framework, Configurable Markov Decision…

Artificial Intelligence · Computer Science 2018-06-15 Alberto Maria Metelli , Mirco Mutti , Marcello Restelli

Deploying reinforcement learning policies in the real world requires adapting to time-varying environments. We study this problem in the contextual Markov Decision Process (cMDP) framework, where a family of environments is indexed by a…

Machine Learning · Computer Science 2026-05-04 Param Budhraja , Aditya Gangrade , Alex Olshevsky , Venkatesh Saligrama

Recent studies in the spatial prisoner's dilemma games with reinforcement learning have shown that static agents can learn to cooperate through a diverse sort of mechanisms, including noise injection, different types of learning algorithms…

Artificial Intelligence · Computer Science 2025-07-08 Gustavo C. Mangold , Heitor C. M. Fernandes , Mendeli H. Vainstein

Backdoor attacks mislead machine-learning models to output an attacker-specified class when presented a specific trigger at test time. These attacks require poisoning the training data to compromise the learning algorithm, e.g., by…

Machine Learning · Computer Science 2021-11-03 Kathrin Grosse , Taesung Lee , Battista Biggio , Youngja Park , Michael Backes , Ian Molloy

Adversarial training is a promising strategy for enhancing model robustness against adversarial attacks. However, its impact on generalization under substantial data distribution shifts in audio classification remains largely unexplored. To…

Machine Learning · Computer Science 2025-07-21 René Heinrich , Lukas Rauch , Bernhard Sick , Christoph Scholz

Exploration of indoor environments has recently experienced a significant interest, also thanks to the introduction of deep neural agents built in a hierarchical fashion and trained with Deep Reinforcement Learning (DRL) on simulated…

This paper investigates the threat of backdoors in Deep Reinforcement Learning (DRL) agent policies and proposes a novel method for their detection at runtime. Our study focuses on elusive in-distribution backdoor triggers. Such triggers…

Machine Learning · Computer Science 2024-07-23 Sanyam Vyas , Chris Hicks , Vasilios Mavroudis