English
Related papers

Related papers: Guiding Diffusion Models with Reinforcement Learni…

200 papers

Fine-tuning diffusion policies with reinforcement learning (RL) presents significant challenges. The long denoising sequence for each action prediction impedes effective reward propagation. Moreover, standard RL methods require millions of…

Molecule generation, especially generating 3D molecular geometries from scratch (i.e., 3D \textit{de novo} generation), has become a fundamental task in drug designs. Existing diffusion-based 3D molecule generation methods could suffer from…

Machine Learning · Computer Science 2022-09-14 Lei Huang , Hengtong Zhang , Tingyang Xu , Ka-Chun Wong

Protein structure prediction is pivotal for understanding the structure-function relationship of proteins, advancing biological research, and facilitating pharmaceutical development and experimental design. While deep learning methods and…

Machine Learning · Computer Science 2024-12-30 Kaihui Cheng , Ce Liu , Qingkun Su , Jun Wang , Liwei Zhang , Yining Tang , Yao Yao , Siyu Zhu , Yuan Qi

The success of RL for LLM post-training stems from an unreasonably uninformative source: a single bit of information per rollout as binary reward or preference label. At the other extreme, distillation offers dense supervision but requires…

Machine Learning · Computer Science 2026-02-12 Yuda Song , Lili Chen , Fahim Tajwar , Remi Munos , Deepak Pathak , J. Andrew Bagnell , Aarti Singh , Andrea Zanette

We study a fundamental problem in computational chemistry known as molecular conformation generation, trying to predict stable 3D structures from 2D molecular graphs. Existing machine learning approaches usually first predict distances…

Machine Learning · Computer Science 2021-06-09 Chence Shi , Shitong Luo , Minkai Xu , Jian Tang

Video generation models trained on heterogeneous data with likelihood-surrogate objectives can produce visually plausible rollouts that violate physical constraints in embodied manipulation. Although reinforcement-learning post-training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhenyang Ni , Yijiang Li , Ruochen Jiao , Simon Sinong Zhan , Sipeng Chen , Zhenfei Yin , Minshuo Chen , Philip Torr , Zhaoran Wang , Qi Zhu

In this work, we introduce a method to fine-tune a Transformer-based generative model for molecular de novo design. Leveraging the superior sequence learning capacity of Transformers over Recurrent Neural Networks (RNNs), our model can…

Machine Learning · Computer Science 2024-03-11 Pengcheng Xu , Tao Feng , Tianfan Fu , Siddhartha Laghuvarapu , Jimeng Sun

Diffusion and flow policies are gaining prominence in online reinforcement learning (RL) due to their expressive power, yet training them efficiently remains a critical challenge. A fundamental difficulty in online RL is the lack of direct…

Machine Learning · Computer Science 2026-01-14 Zeyang Li , Sunbochen Tang , Navid Azizan

Reinforcement Learning from Human Feedback (RLHF) is crucial for aligning Large Language Models (LLMs) with human values. However, RLHF has been continuously challenged by its high complexity in implementation and computation consumption,…

Machine Learning · Computer Science 2026-03-24 Yuhao Du , Zhuo Li , Pengyu Cheng , Zhihong Chen , Yuejiao Xie , Xiang Wan , Anningzhe Gao

Recent advances in video world modeling have enabled large-scale generative models to simulate embodied environments with high visual fidelity, providing strong priors for prediction, planning, and control. Yet, despite their realism, these…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Haoyang He , Jay Patrikar , Dong-Ki Kim , Max Smith , Daniel McGann , Ali-akbar Agha-mohammadi , Shayegan Omidshafiei , Sebastian Scherer

Recent advances at the intersection of reinforcement learning (RL) and visual intelligence have enabled agents that not only perceive complex visual scenes but also reason, generate, and act within them. This survey offers a critical and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Weijia Wu , Chen Gao , Joya Chen , Kevin Qinghong Lin , Qingwei Meng , Yiming Zhang , Yuke Qiu , Hong Zhou , Mike Zheng Shou

Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications…

Machine Learning · Computer Science 2025-11-26 Sifan Wang , Zehao Dou , Siming Shan , Tong-Rui Liu , Lu Lu

Generating high-quality and photorealistic 3D assets remains a longstanding challenge in 3D vision and computer graphics. Although state-of-the-art generative models, such as diffusion models, have made significant progress in 3D…

Graphics · Computer Science 2025-06-19 Qingming Liu , Zhen Liu , Dinghuai Zhang , Kui Jia

Reinforcement Learning (RL) is known for its strong decision-making capabilities and has been widely applied in various real-world scenarios. However, with the increasing availability of offline datasets and the lack of well-designed online…

Machine Learning · Computer Science 2025-09-03 Hanping Zhang , Yuhong Guo

The conformational landscape of proteins is crucial to understanding their functionality in complex biological processes. Traditional physics-based computational methods, such as molecular dynamics (MD) simulations, suffer from rare event…

Biomolecules · Quantitative Biology 2024-09-25 Yan Wang , Lihao Wang , Yuning Shen , Yiqun Wang , Huizhuo Yuan , Yue Wu , Quanquan Gu

Model-based reinforcement learning (MBRL) provides a way to learn a transition model of the environment, which can then be used to plan personalized policies for different patient cohorts and to understand the dynamics involved in the…

Machine Learning · Computer Science 2024-11-22 Abhishek Sharma , Sonali Parbhoo , Omer Gottesman , Finale Doshi-Velez

We present a novel way to predict molecular conformers through a simple formulation that sidesteps many of the heuristics of prior works and achieves state of the art results by using the advantages of scale. By training a diffusion…

Chemical Physics · Physics 2024-05-13 Yuyang Wang , Ahmed A. Elhag , Navdeep Jaitly , Joshua M. Susskind , Miguel Angel Bautista

Reinforcement learning has become a central paradigm for improving LLM reasoning, but most existing methods optimize policies over discrete token sequences. This creates a mismatch between the optimization space and the structure of…

Machine Learning · Computer Science 2026-05-19 Haoqiang Kang , Yizhe Zhang , Nikki Lijing Kuang , Yi-An Ma , Lianhui Qin

Recent large language models (LLMs) have demonstrated strong reasoning capabilities that benefits from online reinforcement learning (RL). These capabilities have primarily been demonstrated within the left-to-right autoregressive (AR)…

Computation and Language · Computer Science 2025-06-04 Siyan Zhao , Devaansh Gupta , Qinqing Zheng , Aditya Grover

Parallel Reinforcement Learning (RL) frameworks are essential for mapping RL workloads to multiple computational resources, allowing for faster generation of samples, estimation of values, and policy improvement. These computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-06 Jacky Kwok , Marten Lohstroh , Edward A. Lee