中文
相关论文

相关论文: Distill Knowledge in Multi-task Reinforcement Lear…

200 篇论文

We present a method to probe rare molecular dynamics trajectories directly using reinforcement learning. We consider trajectories that are conditioned to transition between regions of configuration space in finite time, like those relevant…

统计力学 · 物理学 2022-01-07 Avishek Das , Dominic C. Rose , Juan P. Garrahan , David T. Limmer

Recent advances in large language model (LLM) post-training have leveraged two distinct paradigms to enhance reasoning capabilities: reinforcement learning (RL) and knowledge distillation (KD). While RL enables the emergence of complex…

机器学习 · 计算机科学 2025-06-04 Hongling Xu , Qi Zhu , Heyuan Deng , Jinpeng Li , Lu Hou , Yasheng Wang , Lifeng Shang , Ruifeng Xu , Fei Mi

The effectiveness of reinforcement learning (RL) agents in continuous control robotics tasks is mainly dependent on the design of the underlying reward function, which is highly prone to reward hacking. A misalignment between the reward…

Imitation learning (IL) seeks to teach agents specific tasks through expert demonstrations. One of the key approaches to IL is to define a distance between agent and expert and to find an agent policy that minimizes that distance. Optimal…

机器学习 · 计算机科学 2023-07-21 Ilana Sebag , Samuel Cohen , Marc Peter Deisenroth

Diffusion policies have shown promise in learning complex behaviors from demonstrations, particularly for tasks requiring precise control and long-term planning. However, they face challenges in robustness when encountering distribution…

机器学习 · 计算机科学 2025-02-24 Mingyang Sun , Pengxiang Ding , Weinan Zhang , Donglin Wang

This thesis examines self-attention training through the lens of Optimal Transport (OT) and develops an OT-based alternative for tabular classification. The study tracks intermediate projections of the self-attention layer during training…

机器学习 · 统计学 2026-02-19 Alessandro Quadrio , Antonio Candelieri

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the…

机器学习 · 统计学 2021-05-12 Jose Blanchet , Yang Kang , Fan Zhang , Fei He , Zhangyi Hu

Reinforcement learning (RL) in autonomous driving employs a trial-and-error mechanism, enhancing robustness in unpredictable environments. However, crafting effective reward functions remains challenging, as conventional approaches rely…

机器学习 · 计算机科学 2025-06-02 Yongming Chen , Miner Chen , Liewen Liao , Mingyang Jiang , Xiang Zuo , Hengrui Zhang , Yuchen Xi , Songan Zhang

Transfer reinforcement learning (RL) aims at improving the learning efficiency of an agent by exploiting knowledge from other source agents trained on relevant tasks. However, it remains challenging to transfer knowledge between different…

机器学习 · 计算机科学 2020-12-11 Mohammadamin Barekatain , Ryo Yonetani , Masashi Hamaya

Multi-task learning has been observed by many researchers, which supposes that different tasks can share a low-rank common yet latent subspace. It means learning multiple tasks jointly is better than learning them independently. In this…

机器学习 · 计算机科学 2021-12-10 Wei Chang , Feiping Nie , Rong Wang , Xuelong Li

Multi-task learning (MTL) has been widely used in recommender systems, wherein predicting each type of user feedback on items (e.g, click, purchase) are treated as individual tasks and jointly trained with a unified model. Our key…

信息检索 · 计算机科学 2022-03-29 Chenxiao Yang , Junwei Pan , Xiaofeng Gao , Tingyu Jiang , Dapeng Liu , Guihai Chen

Recently, learning-based approaches show promising results in navigation tasks. However, the poor generalization capability and the simulation-reality gap prevent a wide range of applications. We consider the problem of improving the…

机器人学 · 计算机科学 2023-09-26 Wenzhe Cai , Guangran Cheng , Lingyue Kong , Lu Dong , Changyin Sun

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

机器学习 · 计算机科学 2025-07-24 Shicheng Liu , Minghui Zhu

Reward specification is one of the most tricky problems in Reinforcement Learning, which usually requires tedious hand engineering in practice. One promising approach to tackle this challenge is to adopt existing expert video demonstrations…

人工智能 · 计算机科学 2024-11-05 Yuwei Fu , Haichao Zhang , Di Wu , Wei Xu , Benoit Boulet

In this paper, we develop a reinforcement learning (RL) based system to learn an effective policy for carpooling that maximizes transportation efficiency so that fewer cars are required to fulfill the given amount of trip demand. For this…

机器学习 · 计算机科学 2018-11-13 Ishan Jindal , Zhiwei Qin , Xuewen Chen , Matthew Nokleby , Jieping Ye

Cooperative Multi-Agent Reinforcement Learning (MARL) algorithms, trained only to optimize task reward, can lead to a concentration of power where the failure or adversarial intent of a single agent could decimate the reward of every agent…

机器学习 · 计算机科学 2024-06-18 Michelle Li , Michael Dennis

One crucial objective of multi-task learning is to align distributions across tasks so that the information between them can be transferred and shared. However, existing approaches only focused on matching the marginal feature distribution…

机器学习 · 计算机科学 2021-03-04 Fan Zhou , Brahim Chaib-draa , Boyu Wang

The empirical success of distributional reinforcement learning (RL) highly relies on the choice of distribution divergence equipped with an appropriate distribution representation. In this paper, we propose \textit{Sinkhorn distributional…

机器学习 · 计算机科学 2024-10-16 Ke Sun , Yingnan Zhao , Wulong Liu , Bei Jiang , Linglong Kong

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

机器学习 · 计算机科学 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

Multi-agent reinforcement learning (MARL) requires coordinated and stable policy updates among interacting agents. Heterogeneous-Agent Trust Region Policy Optimization (HATRPO) enforces per-agent trust region constraints using…

人工智能 · 计算机科学 2025-08-15 Chak Lam Shek , Guangyao Shi , Pratap Tokekar