English
Related papers

Related papers: Horizon Imagination: Efficient On-Policy Rollout i…

200 papers

Learning optimal policies from sparse feedback is a known challenge in reinforcement learning. Hindsight Experience Replay (HER) is a multi-goal reinforcement learning algorithm that comes to solve such tasks. The algorithm treats every…

Machine Learning · Computer Science 2020-01-14 Binyamin Manela

World models aim to predict plausible futures consistent with past observations, a capability central to planning and decision-making in reinforcement learning. Yet, existing architectures face a fundamental memory trade-off: transformers…

Machine Learning · Computer Science 2026-05-20 Sebastian Stapf , Pablo Acuaviva Huertos , Aram Davtyan , Paolo Favaro

Generative AI has redefined artificial intelligence, enabling the creation of innovative content and customized solutions that drive business practices into a new era of efficiency and creativity. In this paper, we focus on diffusion…

Machine Learning · Computer Science 2024-03-21 Zihao Li , Hui Yuan , Kaixuan Huang , Chengzhuo Ni , Yinyu Ye , Minshuo Chen , Mengdi Wang

Denoising-based models, including diffusion and flow matching, have led to substantial advances in graph generation. Despite this progress, such models remain constrained by two fundamental limitations: a computational cost that scales…

Machine Learning · Computer Science 2026-04-02 Yoann Boget , Pablo Strasser , Alexandros Kalousis

This paper investigates the application of Diffusion Policy in non-stationary, vision-based RL settings, specifically targeting environments where task dynamics and objectives evolve over time. Our work is grounded in practical challenges…

Artificial Intelligence · Computer Science 2025-04-02 Gunbir Singh Baveja

Training visual reinforcement learning agents in a high-dimensional open world presents significant challenges. While various model-based methods have improved sample efficiency by learning interactive world models, these agents tend to be…

Machine Learning · Computer Science 2026-03-10 Jiajian Li , Qi Wang , Yunbo Wang , Xin Jin , Yang Li , Wenjun Zeng , Xiaokang Yang

Nonprehensile manipulation, such as pushing objects across cluttered environments, presents a challenging control problem due to complex contact dynamics and long-horizon planning requirements. In this work, we propose HeRD, a hierarchical…

Robotics · Computer Science 2025-12-12 Steven Caro , Stephen L. Smith

We present a novel perspective on goal-conditioned reinforcement learning by framing it within the context of denoising diffusion models. Analogous to the diffusion process, where Gaussian noise is used to create random trajectories that…

Machine Learning · Computer Science 2024-10-29 Vineet Jain , Siamak Ravanbakhsh

Low-field to high-field MRI synthesis has emerged as a cost-effective strategy to enhance image quality under hardware and acquisition constraints, particularly in scenarios where access to high-field scanners is limited or impractical.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zhenxuan Zhang , Peiyuan Jing , Ruicheng Yuan , Liwei Hu , Anbang Wang , Fanwen Wang , Yinzhe Wu , Kh Tohidul Islam , Zhaolin Chen , Zi Wang , Peter Lally , Guang Yang

Discrete diffusion has achieved state-of-the-art performance, outperforming or approaching autoregressive models on standard benchmarks. In this work, we introduce Discrete Diffusion with Planned Denoising (DDPD), a novel framework that…

Machine Learning · Computer Science 2025-04-11 Sulin Liu , Juno Nam , Andrew Campbell , Hannes Stärk , Yilun Xu , Tommi Jaakkola , Rafael Gómez-Bombarelli

Diffusion models have achieved remarkable progress across various visual generation tasks. However, their performance significantly declines when generating content at resolutions higher than those used during training. Although numerous…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Zhen Yang , Guibao Shen , Minyang Li , Liang Hou , Mushui Liu , Luozhou Wang , Xin Tao , Ying-Cong Chen

In layout-to-image (L2I) synthesis, controlled complex scenes are generated from coarse information like bounding boxes. Such a task is exciting to many downstream applications because the input layouts offer strong guidance to the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruyu Wang , Xuefeng Hou , Sabrina Schmedding , Marco F. Huber

Diffusion policies, widely adopted in decision-making scenarios such as robotics, gaming and autonomous driving, are capable of learning diverse skills from demonstration data due to their high representation power. However, the sub-optimal…

Machine Learning · Computer Science 2025-09-30 Ningyuan Yang , Jiaxuan Gao , Feng Gao , Yi Wu , Chao Yu

Vision-based imitation learning has enabled impressive robotic manipulation skills, but its reliance on object appearance while ignoring the underlying 3D scene structure leads to low training efficiency and poor generalization. To address…

Robotics · Computer Science 2026-03-03 Wenlong Xia , Jinhao Zhang , Ce Zhang , Yaojia Wang , Huizhe Li , Youmin Gong , Jie Mei

Image compression under ultra-low bitrates remains challenging for both conventional learned image compression (LIC) and generative vector-quantized (VQ) modeling. Conventional LIC suffers from severe artifacts due to heavy quantization,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Lei Lu , Yize Li , Yanzhi Wang , Wei Wang , Wei Jiang

Image Generation models are a trending topic nowadays, with many people utilizing Artificial Intelligence models in order to generate images. There are many such models which, given a prompt of a text, will generate an image which depicts…

Machine Learning · Computer Science 2025-05-20 Udaya Shreyas , L. N. Aadarsh

Effective connectivity estimation plays a crucial role in understanding the interactions and information flow between different brain regions. However, the functional time series used for estimating effective connectivity is derived from…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Qiankun Zuo , Ling Chen , Yanyan Shen , Michael Kwok-Po Ng , Baiying Lei , Shuqiang Wang

Latent diffusion models are the state-of-the-art for synthetic image generation. To align these models with human preferences, training the models using reinforcement learning on human feedback is crucial. Black et. al 2024 introduced…

Machine Learning · Computer Science 2024-04-09 Mo Kordzanganeh , Danial Keshvary , Nariman Arian

Manipulation of large objects over long horizons (such as carts in a warehouse) is an essential skill for deployable robotic systems. Large objects require mobile manipulation which involves simultaneous manipulation, navigation, and…

Robotics · Computer Science 2024-10-10 Yajvan Ravan , Zhutian Yang , Tao Chen , Tomás Lozano-Pérez , Leslie Pack Kaelbling

Real-world control systems require policies that are not only high-performing but also interpretable and robust. A promising direction toward this goal is model-based control, which learns system dynamics and cost functions from historical…

Systems and Control · Electrical Eng. & Systems 2025-11-20 Yuexin Bian , Jie Feng , Yuanyuan Shi