English
Related papers

Related papers: Improving Diffusion Planners by Self-Supervised Ac…

200 papers

The majority of machine learning methods and algorithms give high priority to prediction performance which may not always correspond to the priority of the users. In many cases, practitioners and researchers in different fields, going from…

In many real-world settings, agents must learn from an offline dataset gathered by some prior behavior policy. Such a setting naturally leads to distribution shift between the behavior policy and the target policy being trained - requiring…

Machine Learning · Computer Science 2024-04-10 Matthew Thomas Jackson , Michael Tryfan Matthews , Cong Lu , Benjamin Ellis , Shimon Whiteson , Jakob Foerster

In this paper, we propose surrogate agent-environment interface (SAEI) in reinforcement learning. We also state that learning based on probability surrogate agent-environment interface provides optimal policy of task agent-environment…

Machine Learning · Computer Science 2017-11-13 Song Wang , Yu Jing

Diffusion planners have shown promise in handling long-horizon and sparse-reward tasks due to the non-autoregressive plan generation. However, their inherent stochastic risk of generating infeasible trajectories presents significant…

Machine Learning · Computer Science 2024-06-10 Lang Feng , Pengjie Gu , Bo An , Gang Pan

In offline reinforcement learning, deriving an effective policy from a pre-collected set of experiences is challenging due to the distribution mismatch between the target policy and the behavioral policy used to collect the data, as well as…

Machine Learning · Computer Science 2024-12-10 Catalin E. Brita , Stephan Bongers , Frans A. Oliehoek

Existing NAS methods suffer from either an excessive amount of time for repetitive sampling and training of many task-irrelevant architectures. To tackle such limitations of existing NAS methods, we propose a paradigm shift from NAS to a…

Machine Learning · Computer Science 2024-03-26 Sohyun An , Hayeon Lee , Jaehyeong Jo , Seanie Lee , Sung Ju Hwang

We present a method to learn automaton models that are more robust to input modifications. It iteratively aligns sequences to a learned model, modifies the sequences to their aligned versions, and re-learns the model. Automaton learning…

Machine Learning · Computer Science 2022-06-17 Dennis Mouwen , Sicco Verwer , Azqa Nadeem

Since vision-based manipulation policies are typically trained from data gathered from a single viewpoint, their performance drops when the view changes during deployment. Naively aggregating demonstrations from numerous random views is not…

Robotics · Computer Science 2025-10-07 Sreevishakh Vasudevan , Som Sagar , Ransalu Senanayake

We consider the offline imitation learning from observations (LfO) where the expert demonstrations are scarce and the available offline suboptimal data are far from the expert behavior. Many existing distribution-matching approaches…

Machine Learning · Computer Science 2026-02-03 Yongtao Qu , Shangzhe Li , Weitong Zhang

Diffusion models have demonstrated strong performance in time series forecasting, yet often suffer from semantic misalignment between generated trajectories and conditioning covariates, especially under complex or multimodal conditions. To…

Machine Learning · Computer Science 2025-08-05 Rui Ding , Hanyang Meng , Zeyang Zhang , Jielong Yang

Diffusion-based models have recently shown strong performance in trajectory planning, as they are capable of capturing diverse, multimodal distributions of complex behaviors. A key limitation of these models is their slow inference speed,…

Robotics · Computer Science 2026-03-24 Grayson Lee , Minh Bui , Shuzi Zhou , Yankai Li , Mo Chen , Ke Li

Diffusion models have recently shown promise in offline RL. However, these methods often suffer from high training costs and slow convergence, particularly when using transformer-based denoising backbones. While several optimization…

Machine Learning · Computer Science 2025-06-23 Zhiying Qiu , Tao Lin

Offline reinforcement learning aims to utilize datasets of previously gathered environment-action interaction records to learn a policy without access to the real environment. Recent work has shown that offline reinforcement learning can be…

Machine Learning · Computer Science 2023-08-30 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

The rise of microgrid-based architectures is heavily modifying the energy control landscape in distribution systems making distributed control mechanisms necessary to ensure reliable power system operations. In this paper, we propose the…

Systems and Control · Electrical Eng. & Systems 2020-10-14 Sergio Rozada , Dimitra Apostolopoulou , Eduardo Alonso

In real-world applications of reinforcement learning (RL), noise from inherent stochasticity of environments is inevitable. However, current policy evaluation algorithms, which plays a key role in many RL algorithms, are either prone to…

Machine Learning · Computer Science 2019-06-19 Tadashi Kozuno , Dongqi Han , Kenji Doya

In multiagent environments, the capability of learning is important for an agent to behave appropriately in face of unknown opponents and dynamic environment. From the system designer's perspective, it is desirable if the agents can learn…

Artificial Intelligence · Computer Science 2018-03-09 Chengwei Zhang , Xiaohong Li , Jianye Hao , Siqi Chen , Karl Tuyls , Wanli Xue

We introduce Diffusion Augmented Agents (DAAG), a novel framework that leverages large language models, vision language models, and diffusion models to improve sample efficiency and transfer learning in reinforcement learning for embodied…

Machine Learning · Computer Science 2024-07-31 Norman Di Palo , Leonard Hasenclever , Jan Humplik , Arunkumar Byravan

Imitation Learning (IL) enables robots to acquire manipulation skills from expert demonstrations. Diffusion Policy (DP) models multi-modal expert behaviors but degrades when naively increasing stacked observation horizons, limiting…

Robotics · Computer Science 2026-05-11 Youqiang Gui , Yuxuan Zhou , Shen Cheng , Xinyang Yuan , Haoqiang Fan , Peng Cheng , Shuaicheng Liu

Long-horizon LM agents learn from multi-turn interaction, where a single early mistake can alter the subsequent state distribution and derail the whole trajectory. Existing recipes fall short in complementary ways: supervised fine-tuning…

Machine Learning · Computer Science 2026-05-14 Changhao Li , Rushi Qiang , Jiawei Huang , Chenxiao Gao , Chao Zhang , Niao He , Bo Dai

Safe and effective motion planning is crucial for autonomous robots. Diffusion models excel at capturing complex agent interactions, a fundamental aspect of decision-making in dynamic environments. Recent studies have successfully applied…

Robotics · Computer Science 2025-07-18 Giwon Lee , Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon