English
Related papers

Related papers: Learning Distinguishable Representations in Deep Q…

200 papers

In reinforcement learning (RL), state representations are key to dealing with large or continuous state spaces. While one of the promises of deep learning algorithms is to automatically construct features well-tuned for the task they try to…

Machine Learning · Computer Science 2023-06-21 Charline Le Lan , Stephen Tu , Mark Rowland , Anna Harutyunyan , Rishabh Agarwal , Marc G. Bellemare , Will Dabney

Reinforcement learning (RL) has drawn increasing interests in recent years due to its tremendous success in various applications. However, standard RL algorithms can only be applied for single reward function, and cannot adapt to an unseen…

Machine Learning · Computer Science 2022-01-04 Ziyang Tang , Yihao Feng , Qiang Liu

Learning generic representations with deep networks requires massive training samples and significant computer resources. To learn a new specific task, an important issue is to transfer the generic teacher's representation to a student…

Machine Learning · Computer Science 2021-03-01 Xuhong Li , Yves Grandvalet , Rémi Flamary , Nicolas Courty , Dejing Dou

Modern Reinforcement Learning (RL) is commonly applied to practical problems with an enormous number of states, where function approximation must be deployed to approximate either the value function or the policy. The introduction of…

Machine Learning · Computer Science 2019-08-09 Chi Jin , Zhuoran Yang , Zhaoran Wang , Michael I. Jordan

The success of deep reinforcement learning (DRL) lies in its ability to learn a representation that is well-suited for the exploration and exploitation task. To understand how the choice of representation can improve the efficiency of…

Machine Learning · Computer Science 2024-02-15 Weitong Zhang , Jiafan He , Dongruo Zhou , Amy Zhang , Quanquan Gu

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

In recent years, significant progress has been made in solving challenging problems across various domains using deep reinforcement learning (RL). Reproducing existing work and accurately judging the improvements offered by novel methods is…

Machine Learning · Computer Science 2019-01-31 Peter Henderson , Riashat Islam , Philip Bachman , Joelle Pineau , Doina Precup , David Meger

Domain adaptation refers to the process of learning prediction models in a target domain by making use of data from a source domain. Many classic methods solve the domain adaptation problem by establishing a common latent space, which may…

Machine Learning · Computer Science 2018-08-21 Pan Xiao , Bo Du , Jia Wu , Lefei Zhang , Ruimin Hu , Xuelong Li

Deep neural networks have shown promising results for various clinical prediction tasks such as diagnosis, mortality prediction, predicting duration of stay in hospital, etc. However, training deep networks -- such as those based on…

Machine Learning · Computer Science 2018-07-06 Priyanka Gupta , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Practitioners often rely on compute-intensive domain randomization to ensure reinforcement learning policies trained in simulation can robustly transfer to the real world. Due to unmodeled nonlinearities in the real system, however, even…

Machine Learning · Computer Science 2020-02-27 Gabriel I. Fernandez , Colin Togashi , Dennis W. Hong , Lin F. Yang

Reinforcement learning (RL) has increasingly become a pivotal technique in the post-training of large language models (LLMs). The effective exploration of the output space is essential for the success of RL. We observe that for complex…

Machine Learning · Computer Science 2025-07-08 Shihan Dou , Muling Wu , Jingwen Xu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Over the past decades, researchers have been pushing the limits of Deep Reinforcement Learning (DRL). Although DRL has attracted substantial interest from practitioners, many are blocked by having to search through a plethora of available…

Mathematical Finance · Quantitative Finance 2023-10-05 Sophia Gu

Agents trained with deep reinforcement learning algorithms are capable of performing highly complex tasks including locomotion in continuous environments. We investigate transferring the learning acquired in one task to a set of previously…

Machine Learning · Computer Science 2024-03-06 Suzan Ece Ada , Emre Ugur , H. Levent Akin

With the emergence of large-scale pre-trained neural networks, methods to adapt such "foundation" models to data-limited downstream tasks have become a necessity. Fine-tuning, preference optimization, and transfer learning have all been…

Machine Learning · Statistics 2025-07-09 Javan Tahir , Surya Ganguli , Grant M. Rotskoff

The Linear Representation Hypothesis (LRH) states that neural networks learn to encode concepts as directions in activation space, and a strong version of the LRH states that models learn only such encodings. In this paper, we present a…

Machine Learning · Computer Science 2024-08-21 Róbert Csordás , Christopher Potts , Christopher D. Manning , Atticus Geiger

Deep learning (DL) applied to a device's radio-frequency fingerprint~(RFF) has attracted significant attention in physical-layer authentication due to its extraordinary classification performance. Conventional DL-RFF techniques are trained…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Renjie Xie , Wei Xu , Jiabao Yu , Aiqun Hu , Derrick Wing Kwan Ng , A. Lee Swindlehurst

Transfer Learning (TL) has shown great potential to accelerate Reinforcement Learning (RL) by leveraging prior knowledge from past learned policies of relevant tasks. Existing transfer approaches either explicitly computes the similarity…

Traditional Reinforcement Learning (RL) has focused on problems involving many states and few actions, such as simple grid worlds. Most real world problems, however, are of the opposite type, Involving Few relevant states and many actions.…

Machine Learning · Computer Science 2012-01-04 Vincent Graziano , Faustino Gomez , Mark Ring , Juergen Schmidhuber