中文
相关论文

相关论文: DITTO: Offline Imitation Learning with World Model…

200 篇论文

Imitation learning seeks to circumvent the difficulty in designing proper reward functions for training agents by utilizing expert behavior. With environments modeled as Markov Decision Processes (MDP), most of the existing imitation…

机器学习 · 计算机科学 2021-05-24 Dripta S. Raychaudhuri , Sujoy Paul , Jeroen van Baar , Amit K. Roy-Chowdhury

This paper studies fast adaptive beamforming optimization for the signal-to-interference-plus-noise ratio balancing problem in a multiuser multiple-input single-output downlink system. Existing deep learning based approaches to predict…

信息论 · 计算机科学 2020-11-03 Yi Yuan , Gan Zheng , Kai-Kit Wong , Björn Ottersten , Zhi-Quan Luo

Diffusion policies (DP) have demonstrated significant potential in visual navigation by capturing diverse multi-modal trajectory distributions. However, standard imitation learning (IL), which most DP methods rely on for training, often…

机器人学 · 计算机科学 2026-02-02 Runhua Zhang , Junyi Hou , Changxu Cheng , Qiyi Chen , Tao Wang , Wuyue Zhao

Offline reinforcement learning struggles with distributional shift and constrained performance due to static dataset limitations, while online RL demands prohibitive environment interactions. The recent advent of hybrid offline-to-online…

机器学习 · 计算机科学 2026-05-19 Qisai Liu , Zhanhong Jiang , Joshua Russell Waite , Aditya Balu , Cody Fleming , Soumik Sarkar

Episodic self-imitation learning, a novel self-imitation algorithm with a trajectory selection module and an adaptive loss function, is proposed to speed up reinforcement learning. Compared to the original self-imitation learning algorithm,…

人工智能 · 计算机科学 2020-11-30 Tianhong Dai , Hengyan Liu , Anil Anthony Bharath

Distributed online learning is gaining increased traction due to its unique ability to process large-scale datasets and streaming data. To address the growing public awareness and concern on privacy protection, plenty of algorithms have…

机器学习 · 计算机科学 2024-08-27 Ziqin Chen , Yongqiang Wang

Existing on-policy imitation learning algorithms, such as DAgger, assume access to a fixed supervisor. However, there are many settings where the supervisor may evolve during policy learning, such as a human performing a novel task or an…

Practical Imitation Learning (IL) systems rely on large human demonstration datasets for successful policy learning. However, challenges lie in maintaining the quality of collected data and addressing the suboptimal nature of some…

机器人学 · 计算机科学 2025-05-07 Sachit Kuhar , Shuo Cheng , Shivang Chopra , Matthew Bronars , Danfei Xu

We consider the problem of contextual bandits and imitation learning, where the learner lacks direct knowledge of the executed action's reward. Instead, the learner can actively query an expert at each round to compare two actions and…

机器学习 · 计算机科学 2023-07-25 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu

Since its introduction in 2003, the influence maximization (IM) problem has drawn significant research attention in the literature. The aim of IM is to select a set of k users who can influence the most individuals in the social network.…

社会与信息网络 · 计算机科学 2019-06-19 Hui Li , Mengting Xu , Sourav S Bhowmick , Changsheng Sun , Zhongyuan Jiang , Jiangtao Cui

Many advances that have improved the robustness and efficiency of deep reinforcement learning (RL) algorithms can, in one way or another, be understood as introducing additional objectives or constraints in the policy optimization step.…

In this paper we consider online distributed learning problems. Online distributed learning refers to the process of training learning models on distributed data sources. In our setting a set of agents need to cooperatively train a learning…

机器学习 · 计算机科学 2024-05-07 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Imitation Learning uses the demonstrations of an expert to uncover the optimal policy and it is suitable for real-world robotics tasks as well. In this case, however, the training of the agent is carried out in a simulation environment due…

机器学习 · 计算机科学 2022-06-23 Zoltán Lőrincz , Márton Szemenyei , Róbert Moni

A popular paradigm for training LM agents relies on imitation learning, fine-tuning on expert trajectories. However, we show that the off-policy nature of imitation learning for multi-turn LM agents suffers from the fundamental limitation…

机器学习 · 计算机科学 2025-12-18 Niklas Lauffer , Xiang Deng , Srivatsa Kundurthy , Brad Kenstler , Jeff Da

There has been significant recent progress in the area of unsupervised skill discovery, utilizing various information-theoretic objectives as measures of diversity. Despite these advances, challenges remain: current methods require…

机器学习 · 计算机科学 2024-06-24 Marin Vlastelica , Jin Cheng , Georg Martius , Pavel Kolev

Diffusion Transformers (DiTs) achieve superior image generation quality but suffer from quadratic computational complexity relative to token count. While various token reduction (TR) methods have been proposed to mitigate this cost, they…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Hangyeol Lee , Hyojeong Lee , Joo-Young Kim

An important challenge in metric learning is scalability to both size and dimension of input data. Online metric learning algorithms are proposed to address this challenge. Existing methods are commonly based on (Passive Aggressive) PA…

机器学习 · 计算机科学 2020-10-13 Davood Zabihzadeh , Amar Tuama , Ali Karami-Mollaee

In offline imitation learning (IL), an agent aims to learn an optimal expert behavior policy without additional online environment interactions. However, in many real-world scenarios, such as robotics manipulation, the offline dataset is…

机器学习 · 计算机科学 2024-01-01 Bowei He , Zexu Sun , Jinxin Liu , Shuai Zhang , Xu Chen , Chen Ma

Imitation learning has proven to be a powerful tool for training complex visuomotor policies. However, current methods often require hundreds to thousands of expert demonstrations to handle high-dimensional visual observations. A key reason…

机器人学 · 计算机科学 2024-11-01 Zichen Jeff Cui , Hengkai Pan , Aadhithya Iyer , Siddhant Haldar , Lerrel Pinto

Inverse problems (IPs) involve reconstructing signals from noisy observations. Recently, diffusion models (DMs) have emerged as a powerful framework for solving IPs, achieving remarkable reconstruction performance. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Yang Zheng , Wen Li , Zhaoqiang Liu