English
Related papers

Related papers: Fine-tuning Pocket-Aware Diffusion Models via Deno…

200 papers

We introduce Discrete flow Matching policy Optimization (DoMinO), a unified framework for Reinforcement Learning (RL) fine-tuning Discrete Flow Matching (DFM) models under a broad class of policy gradient methods. Our key idea is to view…

Machine Learning · Computer Science 2026-04-09 Maojiang Su , Po-Chung Hsieh , Weimin Wu , Mingcheng Lu , Jiunhau Chen , Jerry Yao-Chieh Hu , Han Liu

This paper applies deep reinforcement learning (DRL) to optimize liquidity provisioning in Uniswap v3, a decentralized finance (DeFi) protocol implementing an automated market maker (AMM) model with concentrated liquidity. We model the…

Computational Finance · Quantitative Finance 2025-01-14 Haonan Xu , Alessio Brini

Diffusion alignment adapts pretrained diffusion models to sample from reward-tilted distributions along the denoising trajectory. This process naturally admits a Sequential Monte Carlo (SMC) interpretation, where the denoising model acts as…

Machine Learning · Computer Science 2026-02-13 Zijing Ou , Jacob Si , Junyi Zhu , Ondrej Bohdal , Mete Ozay , Taha Ceritli , Yingzhen Li

Offline model-based optimization (MBO) aims to maximize a black-box objective function using only an offline dataset of designs and scores. These tasks span various domains, such as robotics, material design, and protein and molecular…

Machine Learning · Computer Science 2025-04-18 Ye Yuan , Youyuan Zhang , Can Chen , Haolun Wu , Zixuan Li , Jianmo Li , James J. Clark , Xue Liu

In this research, we propose a novel denoising diffusion model based on shortest-path modeling that optimizes residual propagation to enhance both denoising efficiency and quality. Drawing on Denoising Diffusion Implicit Models (DDIM) and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ping Chen , Xingpeng Zhang , Zhaoxiang Liu , Huan Hu , Xiang Liu , Kai Wang , Min Wang , Yanlin Qian , Shiguo Lian

Deep learning has emerged as a promising approach for learning the nonlinear mapping between diffusion-weighted MR images and tissue parameters, which enables automatic and deep understanding of the brain microstructures. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wenxin Fan , Jian Cheng , Qiyuan Tian , Ruoyou Wu , Juan Zou , Zan Chen , Shanshan Wang

Spiking Neural Networks (SNNs) has the ability to extract spatio-temporal features due to their spiking sequence. While previous research has primarily foucus on the classification of image and reinforcement learning. In our paper, we put…

Robotics · Computer Science 2025-03-18 Qianhao Wang , Yinqian Sun , Enmeng Lu , Qian Zhang , Yi Zeng

Model-based reinforcement learning approaches leverage a forward dynamics model to support planning and decision making, which, however, may fail catastrophically if the model is inaccurate. Although there are several existing methods…

Machine Learning · Computer Science 2020-09-30 Hang Lai , Jian Shen , Weinan Zhang , Yong Yu

Discrete diffusion has achieved state-of-the-art performance, outperforming or approaching autoregressive models on standard benchmarks. In this work, we introduce Discrete Diffusion with Planned Denoising (DDPD), a novel framework that…

Machine Learning · Computer Science 2025-04-11 Sulin Liu , Juno Nam , Andrew Campbell , Hannes Stärk , Yilun Xu , Tommi Jaakkola , Rafael Gómez-Bombarelli

Diffusion Policy (DP) excels in embodied control but suffers from high inference latency and computational cost due to multiple iterative denoising steps. The temporal complexity of embodied tasks demands a dynamic and adaptable computation…

Machine Learning · Computer Science 2025-12-19 Ye Li , Jiahe Feng , Yuan Meng , Kangye Ji , Chen Tang , Xinwan Wen , Shutao Xia , Zhi Wang , Wenwu Zhu

Diffusion-based robot navigation policies trained on large-scale imitation learning datasets, can generate multi-modal trajectories directly from the robot's visual observations, bypassing the traditional localization-mapping-planning…

Robotics · Computer Science 2026-03-16 Junhe Sheng , Ruofei Bai , Kuan Xu , Ruimeng Liu , Jie Chen , Shenghai Yuan , Wei-Yun Yau , Lihua Xie

Diffusion models have demonstrated remarkable success in various visual generation tasks, including image, video, and 3D content generation. Preference optimization (PO) is a prominent and growing area of research that aims to align these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Fu-Yun Wang , Keqiang Sun , Yao Teng , Xihui Liu , Jiale Yuan , Jiaming Song , Hongsheng Li

Machine Learning systems are increasingly deployed in decision-making settings that shape user behavior and, in turn, the data on which future decisions are based. Performative Prediction (PP) formalizes this feedback loop by modeling how…

Machine Learning · Computer Science 2026-05-13 Javier Sanguino Bautiste , Thomas Kehrenberg , Jose A. Lozano , Novi Quadrianto

Deep visual odometry has demonstrated great advancements by learning-to-optimize technology. This approach heavily relies on the visual matching across frames. However, ambiguous matching in challenging scenarios leads to significant errors…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shuo Wang , Wanting Li , Yongcai Wang , Zhaoxin Fan , Zhe Huang , Xudong Cai , Jian Zhao , Deying Li

Imitation learning, particularly Diffusion Policies based methods, has recently gained significant traction in embodied AI as a powerful approach to action policy generation. These models efficiently generate action policies by learning to…

Robotics · Computer Science 2025-04-15 Haiyong Yu , Yanqiong Jin , Yonghao He , Wei Sui

Deep generative models have achieved tremendous success in structure-based drug design in recent years, especially for generating 3D ligand molecules that bind to specific protein pocket. Notably, diffusion models have transformed ligand…

Machine Learning · Computer Science 2024-12-03 Daiheng Zhang , Chengyue Gong , Qiang Liu

Diffusion Policy is a powerful technique tool for learning end-to-end visuomotor robot control. It is expected that Diffusion Policy possesses scalability, a key attribute for deep neural networks, typically suggesting that increasing model…

Diffusion models are trained by learning a sequence of models that reverse each step of noise corruption. Typically, the model parameters are fully shared across multiple timesteps to enhance training efficiency. However, since the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Qianli Ma , Xuefei Ning , Dongrui Liu , Li Niu , Linfeng Zhang

Being an effective non-orthogonal multiple access (NOMA) technique, sparse code multiple access (SCMA) is promising for future wireless communication. Compared with orthogonal techniques, SCMA enjoys higher overloading tolerance and lower…

Information Theory · Computer Science 2018-04-03 Chuan Zhang , Chao Yang , Wei Xu , Shunqing Zhang , Zaichen Zhang , Xiaohu You

Self-Distillation Policy Optimization (SDPO) provides dense token-level credit assignment for reinforcement learning with large language models by leveraging the model's own feedback-conditioned predictions as a self-teacher. Unlike GRPO,…

Machine Learning · Computer Science 2026-05-28 Zehao Liu , Yuanpu Cao , Jinghui Chen , Vasant G. Honavar