中文
相关论文

相关论文: Ensemble and Auxiliary Tasks for Data-Efficient De…

200 篇论文

Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

Recent years have seen the application of deep reinforcement learning techniques to cooperative multi-agent systems, with great empirical success. However, given the lack of theoretical insight, it remains unclear what the employed neural…

多智能体系统 · 计算机科学 2024-12-20 Jacopo Castellini , Frans A. Oliehoek , Rahul Savani , Shimon Whiteson

Deep reinforcement learning (RL) has achieved remarkable success in solving complex tasks through its integration with deep neural networks (DNNs) as function approximators. However, the reliance on DNNs has introduced a new challenge…

机器学习 · 计算机科学 2023-11-01 Woojun Kim , Yongjae Shin , Jongeui Park , Youngchul Sung

As deep reinforcement learning driven by visual perception becomes more widely used there is a growing need to better understand and probe the learned agents. Understanding the decision making process and its relationship to visual inputs…

计算机视觉与模式识别 · 计算机科学 2019-04-03 Christian Rupprecht , Cyril Ibrahim , Christopher J. Pal

The contribution of this work is twofold: (1) We introduce a collection of ensemble methods for time series forecasting to combine predictions from base models. We demonstrate insights on the power of ensemble learning for forecasting,…

机器学习 · 计算机科学 2021-04-26 Julia Gastinger , Sébastien Nicolas , Dušica Stepić , Mischa Schmidt , Anett Schülke

Machine Reading Comprehension (MRC) is an active field in natural language processing with many successful developed models in recent years. Despite their high in-distribution accuracy, these models suffer from two issues: high training…

计算与语言 · 计算机科学 2021-07-16 Razieh Baradaran , Hossein Amirkhani

This work demonstrates the ability to produce readily interpretable statistical metrics for model fit, fixed effects covariance coefficients, and prediction confidence. Importantly, this work compares 4 suitable and commonly applied…

机器学习 · 统计学 2022-11-30 Alex Treacher , Kevin Nguyen , Dylan Owens , Daniel Heitjan , Albert Montillo

Learning on small data is a challenge frequently encountered in many real-world applications. In this work we study how effective quantum ensemble models are when trained on small data problems in healthcare and life sciences. We…

In reinforcement learning, temporal abstraction in the action space, exemplified by action repetition, is a technique to facilitate policy learning through extended actions. However, a primary limitation in previous studies of action…

机器学习 · 计算机科学 2024-02-09 Joongkyu Lee , Seung Joon Park , Yunhao Tang , Min-hwan Oh

One approach to deal with the statistical inefficiency of neural networks is to rely on auxiliary losses that help to build useful representations. However, it is not always trivial to know if an auxiliary task will be helpful for the main…

Neural networks allow Q-learning reinforcement learning agents such as deep Q-networks (DQN) to approximate complex mappings from state spaces to value functions. However, this also brings drawbacks when compared to other function…

机器学习 · 计算机科学 2018-06-21 Jack Shannon , Marek Grzes

Active learning aims to reduce annotation cost by predicting which samples are useful for a human teacher to label. However it has become clear there is no best active learning algorithm. Inspired by various philosophies about what…

机器学习 · 计算机科学 2018-10-19 Kunkun Pang , Mingzhi Dong , Yang Wu , Timothy M. Hospedales

Deep reinforcement learning requires a heavy price in terms of sample efficiency and overparameterization in the neural networks used for function approximation. In this work, we use tensor factorization in order to learn more compact…

机器学习 · 计算机科学 2019-11-27 Pierre H. Richemond , Arinbjörn Kolbeinsson , Yike Guo

Deep ensembles have been empirically shown to be a promising approach for improving accuracy, uncertainty and out-of-distribution robustness of deep learning models. While deep ensembles were theoretically motivated by the bootstrap,…

机器学习 · 统计学 2020-06-26 Stanislav Fort , Huiyi Hu , Balaji Lakshminarayanan

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

机器学习 · 计算机科学 2024-09-02 Talha Bozkus , Urbashi Mitra

Auxiliary tasks have been argued to be useful for representation learning in reinforcement learning. Although many auxiliary tasks have been empirically shown to be effective for accelerating learning on the main task, it is not yet clear…

人工智能 · 计算机科学 2022-04-04 Banafsheh Rafiee , Jun Jin , Jun Luo , Adam White

Experience replay, the reuse of past data to improve sample efficiency, is ubiquitous in reinforcement learning. Though a variety of smart sampling schemes have been introduced to improve performance, uniform sampling by far remains the…

机器学习 · 计算机科学 2024-10-22 Parham Mohammad Panahi , Andrew Patterson , Martha White , Adam White

The Arcade Learning Environment (ALE) is proposed as an evaluation platform for empirically assessing the generality of agents across dozens of Atari 2600 games. ALE offers various challenging problems and has drawn significant attention…

人工智能 · 计算机科学 2023-02-28 Jiajun Fan

This paper presents an actor-critic deep reinforcement learning agent with experience replay that is stable, sample efficient, and performs remarkably well on challenging environments, including the discrete 57-game Atari domain and several…

机器学习 · 计算机科学 2017-07-11 Ziyu Wang , Victor Bapst , Nicolas Heess , Volodymyr Mnih , Remi Munos , Koray Kavukcuoglu , Nando de Freitas

A long-term goal of reinforcement learning agents is to be able to perform tasks in complex real-world scenarios. The use of external information is one way of scaling agents to more complex problems. However, there is a general lack of…

人工智能 · 计算机科学 2021-09-21 Adam Bignold , Francisco Cruz , Matthew E. Taylor , Tim Brys , Richard Dazeley , Peter Vamplew , Cameron Foale