中文
相关论文

相关论文: Offline Meta-Reinforcement Learning with Flow-Base…

200 篇论文

Causal inference has become a powerful tool to handle the out-of-distribution (OOD) generalization problem, which aims to extract the invariant features. However, conventional methods apply causal learners from multiple data splits, which…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Yuqing Wang , Xiangxian Li , Zhuang Qi , Jingyu Li , Xuelong Li , Xiangxu Meng , Lei Meng

Meta-learning aims to leverage information across related tasks to improve prediction on unlabeled data for new tasks when only a small number of labeled observations are available ("few-shot" learning). Increased task diversity is often…

Offline reinforcement learning (RL) enables effective learning from previously collected data without exploration, which shows great promise in real-world applications when exploration is expensive or even infeasible. The discount factor,…

机器学习 · 计算机科学 2022-06-16 Hao Hu , Yiqin Yang , Qianchuan Zhao , Chongjie Zhang

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

机器学习 · 计算机科学 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang

Online matching problems arise in many complex systems, from cloud services and online marketplaces to organ exchange networks, where timely, principled decisions are critical for maintaining high system performance. Traditional heuristics…

机器学习 · 统计学 2025-10-09 Chiara Mignacco , Matthieu Jonckheere , Gilles Stoltz

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

机器学习 · 计算机科学 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

机器学习 · 计算机科学 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

Over-the-air federated learning (OTA-FL) provides bandwidth-efficient learning by leveraging the inherent superposition property of wireless channels. Personalized federated learning balances performance for users with diverse datasets,…

信息论 · 计算机科学 2024-01-23 Jiayu Mao , Aylin Yener

Offline reinforcement learning (RL) leverages previously collected data for policy optimization without any further active exploration. Despite the recent interest in this problem, its theoretical results in neural network function…

机器学习 · 统计学 2022-12-15 Thanh Nguyen-Tang , Sunil Gupta , Hung Tran-The , Svetha Venkatesh

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

机器学习 · 计算机科学 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Offline reinforcement learning (RL) has received considerable attention in recent years due to its attractive capability of learning policies from offline datasets without environmental interactions. Despite some success in the single-agent…

机器学习 · 计算机科学 2023-11-08 Xiangsen Wang , Haoran Xu , Yinan Zheng , Xianyuan Zhan

Despite large neural networks demonstrating remarkable abilities to complete different tasks, they require excessive memory usage to store the optimization states for training. To alleviate this, the low-rank adaptation (LoRA) is proposed…

机器学习 · 计算机科学 2024-06-14 Yongchang Hao , Yanshuai Cao , Lili Mou

In deep Reinforcement Learning (RL), value functions are typically approximated using deep neural networks and trained via mean squared error regression objectives to fit the true value functions. Recent research has proposed an alternative…

机器学习 · 计算机科学 2024-11-19 Denis Tarasov , Kirill Brilliantov , Dmitrii Kharlapenko

In federated learning (FL), heterogeneity among the local dataset distributions of clients can result in unsatisfactory performance for some, leading to an unfair model. To address this challenge, we propose an over-the-air fair federated…

机器学习 · 计算机科学 2025-01-08 Shayan Mohajer Hamidi , Ali Bereyhi , Saba Asaad , H. Vincent Poor

Expanding reinforcement learning (RL) to offline domains generates promising prospects, particularly in sectors where data collection poses substantial challenges or risks. Pivotal to the success of transferring RL offline is mitigating…

机器学习 · 统计学 2024-11-19 Alex Beeson , David Ireland , Giovanni Montana

Offline meta-reinforcement learning aims to equip agents with the ability to rapidly adapt to new tasks by training on data from a set of different tasks. Context-based approaches utilize a history of state-action-reward transitions --…

机器学习 · 计算机科学 2025-01-23 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be…

机器学习 · 计算机科学 2022-09-20 Zuyue Fu , Zhengling Qi , Zhaoran Wang , Zhuoran Yang , Yanxun Xu , Michael R. Kosorok

Offline reinforcement learning (RL) enables the agent to effectively learn from logged data, which significantly extends the applicability of RL algorithms in real-world scenarios where exploration can be expensive or unsafe. Previous works…

机器学习 · 计算机科学 2022-12-05 Yiqin Yang , Hao Hu , Wenzhe Li , Siyuan Li , Jun Yang , Qianchuan Zhao , Chongjie Zhang

Although pre-trained Vision-Language-Action (VLA) models exhibit impressive generalization in robotic manipulation, post-training remains crucial to ensure reliable performance during deployment. However, standard offline Supervised…

机器人学 · 计算机科学 2026-03-30 Zhide Zhong , Haodong Yan , Junfeng Li , Junjie He , Tianran Zhang , Haoang Li