English
Related papers

Related papers: PhySe-RPO: Physics and Semantics Guided Relative P…

200 papers

Proximal Policy Optimization (PPO), a popular on-policy deep reinforcement learning method, employs a stochastic policy for exploration. In this paper, we propose a colored noise-based stochastic policy variant of PPO. Previous research…

Machine Learning · Computer Science 2024-06-18 Jakob Hollenstein , Georg Martius , Justus Piater

Flow-based generative models, including diffusion models, excel at modeling continuous distributions in high-dimensional spaces. In this work, we introduce Flow Policy Optimization (FPO), a simple on-policy reinforcement learning algorithm…

Machine Learning · Computer Science 2025-08-04 David McAllister , Songwei Ge , Brent Yi , Chung Min Kim , Ethan Weber , Hongsuk Choi , Haiwen Feng , Angjoo Kanazawa

Policy gradient methods ignore the potential value of adjusting environment variables: unobservable state features that are randomly determined by the environment in a physical setting, but are controllable in a simulator. This can lead to…

Machine Learning · Computer Science 2019-05-28 Supratik Paul , Michael A. Osborne , Shimon Whiteson

Recovering continuous-time dynamics from discrete observations is difficult because local supervision (e.g., pointwise regression targets, derivative approximations, or equation residuals) loses fidelity as the observation interval grows.…

Machine Learning · Computer Science 2026-05-12 Yuxiang Luo , Andrew Perrault

Image super-resolution pursuits reconstructing high-fidelity high-resolution counterpart for low-resolution image. In recent years, diffusion-based models have garnered significant attention due to their capabilities with rich prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Aiwen Jiang , Zhi Wei , Long Peng , Feiqiang Liu , Wenbo Li , Mingwen Wang

Popular reinforcement learning (RL) algorithms tend to produce a unimodal policy distribution, which weakens the expressiveness of complicated policy and decays the ability of exploration. The diffusion probability model is powerful to…

Machine Learning · Computer Science 2023-05-23 Long Yang , Zhixiong Huang , Fenghao Lei , Yucun Zhong , Yiming Yang , Cong Fang , Shiting Wen , Binbin Zhou , Zhouchen Lin

Sequence modeling approaches have shown promising results in robot imitation learning. Recently, diffusion models have been adopted for behavioral cloning in a sequence modeling fashion, benefiting from their exceptional capabilities in…

Robotics · Computer Science 2024-01-12 Xiang Li , Varun Belagali , Jinghuan Shang , Michael S. Ryoo

We propose MonoSE(3)-Diffusion, a monocular SE(3) diffusion framework that formulates markerless, image-based robot pose estimation as a conditional denoising diffusion process. The framework consists of two processes: a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Kangjian Zhu , Haobo Jiang , Yigong Zhang , Jianjun Qian , Jian Yang , Jin Xie

Recently, Masked Diffusion Models (MDMs) have shown promising potential across vision, language, and cross-modal generation. However, a notable discrepancy exists between their training and inference procedures. In particular, MDM inference…

Machine Learning · Computer Science 2025-12-30 Renping Zhou , Zanlin Ni , Tianyi Chen , Zeyu Liu , Yang Yue , Yulin Wang , Yuxuan Wang , Jingshu Liu , Gao Huang

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

Preference optimization for diffusion models aims to align them with human preferences for images. Previous methods typically use Vision-Language Models (VLMs) as pixel-level reward models to approximate human preferences. However, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Tao Zhang , Cheng Da , Kun Ding , Huan Yang , Kun Jin , Yan Li , Tingting Gao , Di Zhang , Shiming Xiang , Chunhong Pan

Chain-of-Thought (CoT) prompting has recently shown significant promise across various NLP and computer vision tasks by explicitly generating intermediate reasoning steps. However, we find that reinforcement learning (RL)-based fine-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Qingyang Yan , Guangyao Chen , Yixiong Zou

The integration of diffusion priors with temporal alignment has emerged as a transformative paradigm for video restoration, delivering fantastic perceptual quality, yet the practical deployment of such frameworks is severely constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jianfeng Liang , Shaocheng Shen , Botao Xu , Qiang Hu , Xiaoyun Zhang

Safety in reinforcement learning (RL) is typically enforced through objective shaping while keeping environment dynamics stationary with respect to observable state-action pairs. Under delayed harm, this can lead to replay: after a washout…

Machine Learning · Computer Science 2026-04-10 Prakul Sunil Hiremath

Diffusion strategies have advanced visual motor control by progressively denoising high-dimensional action sequences, providing a promising method for robot manipulation. However, as task complexity increases, the success rate of existing…

Robotics · Computer Science 2026-01-21 Weize Xie , Yi Ding , Ying He , Leilei Wang , Binwen Bai , Zheyi Zhao , Chenyang Wang , F. Richard Yu

Recent advances in reinforcement learning (RL) have achieved great successes by leveraging the multimodality and exploration capability of diffusion policies. Among these approaches, one representative branch focuses on the sampling-based…

Robotics · Computer Science 2026-05-29 Shutong Ding , Zejia Zhong , Zhongyi Wang , Ke Hu , Bikang Pan , Jingya Wang , Ye Shi

Many robotic systems, such as mobile manipulators or quadrotors, cannot be equipped with high-end GPUs due to space, weight, and power constraints. These constraints prevent these systems from leveraging recent developments in visuomotor…

Robotics · Computer Science 2024-07-02 Aaditya Prasad , Kevin Lin , Jimmy Wu , Linqi Zhou , Jeannette Bohg

Long chain-of-thought (CoT) reasoning improves large vision--language models, but visual information often fades during generation, limiting long-horizon multimodal reasoning. Existing methods either re-inject vision at inference or train…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xuan Gong , Hanbo Huang , Hao Zheng , Yiran Zhang , Wenbin Dai , Weishu Zhao , Shiyu Liang

Dynamic imaging addresses the recovery of a time-varying 2D or 3D object at each time instant using its undersampled measurements. In particular, in the case of dynamic tomography, only a single projection at a single view angle may be…

Image and Video Processing · Electrical Eng. & Systems 2024-05-09 Berk Iskender , Marc L. Klasky , Yoram Bresler

Real-World Image Super-Resolution is one of the most challenging task in image restoration. However, existing methods struggle with an accurate understanding of degraded image content, leading to reconstructed results that are both…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Junbo Qiao , Miaomiao Cai , Wei Li , Xudong Huang , Jie Hu , Xinghao Chen , Shaohui Lin , Hongkai Xiong