English
Related papers

Related papers: PANDORA: Diffusion Policy Learning for Dexterous R…

200 papers

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Reinforcement Learning (RL) has emerged as a central paradigm for advancing Large Language Models (LLMs), where pre-training and RL post-training share the same log-likelihood formulation. In contrast, recent RL approaches for diffusion…

Machine Learning · Computer Science 2025-09-30 Shuchen Xue , Chongjian Ge , Shilong Zhang , Yichen Li , Zhi-Ming Ma

With the rapid advancement of remote sensing technology, super-resolution image reconstruction is of great research and practical significance. Existing deep learning methods have made progress but still face limitations in handling complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Shijie Lyu

Diffusion models produce high-fidelity speech but are inefficient for real-time use due to long denoising steps and challenges in modeling intonation and rhythm. To improve this, we propose Diffusion Loss-Guided Policy Optimization (DLPO),…

Sound · Computer Science 2025-08-06 Jingyi Chen , Ju Seung Byun , Micha Elsner , Pichao Wang , Andrew Perrault

Learning a generalist embodied agent capable of completing multiple tasks poses challenges, primarily stemming from the scarcity of action-labeled robotic datasets. In contrast, a vast amount of human videos exist, capturing intricate tasks…

Machine Learning · Computer Science 2024-10-10 Haoran He , Chenjia Bai , Ling Pan , Weinan Zhang , Bin Zhao , Xuelong Li

Dexterous manipulation with contact-rich interactions is crucial for advanced robotics. While recent diffusion-based planning approaches show promise for simple manipulation tasks, they often produce unrealistic ghost states (e.g., the…

Robotics · Computer Science 2025-06-18 Zhixuan Liang , Yao Mu , Yixiao Wang , Tianxing Chen , Wenqi Shao , Wei Zhan , Masayoshi Tomizuka , Ping Luo , Mingyu Ding

A key challenge towards reliable robotic control is devising computational models that can both learn policies and guarantee robustness when deployed in the field. Inspired by the free energy principle in computational neuroscience, to…

Robotics · Computer Science 2026-03-10 Hozefa Jesawada , Giovanni Russo , Abdalla Swikir , Fares Abu-Dakka

Learning diverse policies for non-prehensile manipulation is essential for improving skill transfer and generalization to out-of-distribution scenarios. In this work, we enhance exploration through a two-fold approach within a hybrid…

Robotics · Computer Science 2025-04-29 Huy Le , Tai Hoang , Miroslav Gabriel , Gerhard Neumann , Ngo Anh Vien

Federated learning systems have been identified as an efficient approach to scaling distributed model training with a large amount of participants or data owners while guaranteeing data privacy. To apply the current most popular pre-trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-04 Qianli Liu , Zhaorui Zhang , Xin Yao , Benben Liu

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

Machine Learning · Computer Science 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

Denoising Diffusion Probabilistic Models (DDPMs) are powerful generative deep learning models that have been very successful at image generation, and, very recently, in path planning and control. In this paper, we investigate how to…

Robotics · Computer Science 2024-11-18 Michiel Nikken , Nicolò Botteghi , Wesley Roozing , Federico Califano

We study an LLM fine-tuning task for designing reward functions for sequential resource allocation problems in public health, guided by human preferences expressed in natural language. This setting presents a challenging testbed for…

Machine Learning · Computer Science 2025-11-19 Cheol Woo Kim , Shresth Verma , Mauricio Tec , Milind Tambe

The growing demand for parking has increased the need for automated parking planning methods that can operate reliably in confined spaces. In restricted and complex environments, high-precision maneuvers are required to achieve a high…

Robotics · Computer Science 2025-10-17 Mingyang Jiang , Yueyuan Li , Jiaru Zhang , Songan Zhang , Ming Yang

Learning long-horizon robotic manipulation requires jointly achieving expressive behavior modeling, real-time inference, and stable execution, which remains challenging for existing generative policies. Diffusion-based approaches offer…

Robotics · Computer Science 2026-05-19 Wu Songwei , Jiang Zhiduo , Sun Wandong , Xie Guanghu , Zhao Rui , Liu Hong , Liu Yang

Diffusion policies are competitive for offline reinforcement learning (RL) but are typically guided at sampling time by heuristics that lack a statistical notion of risk. We introduce LRT-Diffusion, a risk-aware sampling rule that treats…

Machine Learning · Computer Science 2026-02-20 Ximan Sun , Xiang Cheng

This tutorial provides an in-depth guide on inference-time guidance and alignment methods for optimizing downstream reward functions in diffusion models. While diffusion models are renowned for their generative modeling capabilities,…

Artificial Intelligence · Computer Science 2025-01-22 Masatoshi Uehara , Yulai Zhao , Chenyu Wang , Xiner Li , Aviv Regev , Sergey Levine , Tommaso Biancalani

Fine-tuning text-to-image diffusion models with human feedback is an effective method for aligning model behavior with human intentions. However, this alignment process often suffers from slow convergence due to the large size and noise…

Machine Learning · Computer Science 2025-04-03 Yongjin Yang , Sihyeon Kim , Hojung Jung , Sangmin Bae , SangMook Kim , Se-Young Yun , Kimin Lee

We aim to solve the problem of generating coarse-to-fine skills learning from demonstrations (LfD). To scale precision, traditional LfD approaches often rely on extensive fine-grained demonstrations with external interpolations or dynamics…

Robotics · Computer Science 2026-02-25 Nayoung Oh , Jaehyeong Jang , Moonkyeong Jung , Daehyung Park

Diffusion Large Language Models (dLLMs) have emerged as a promising non-autoregressive generative paradigm. Given the prohibitive computational cost of full fine-tuning, Parameter-Efficient Fine-Tuning (PEFT) has become the standard…

Artificial Intelligence · Computer Science 2026-05-29 Shuaidi Wang , Zhan Zhuang , Ruping Huang , Yu Zhang

Diffusion language models, as a promising alternative to traditional autoregressive (AR) models, enable faster generation and richer conditioning on bidirectional context. However, they suffer from a key discrepancy between training and…

Machine Learning · Computer Science 2025-09-26 Haoyu He , Katrin Renz , Yong Cao , Andreas Geiger