English
Related papers

Related papers: Self-Reflective Reinforcement Learning for Diffusi…

200 papers

Recent advances in text-conditioned image generation diffusion models have begun paving the way for new opportunities in modern medical domain, in particular, generating Chest X-rays (CXRs) from diagnostic reports. Nonetheless, to further…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Woojung Han , Chanyoung Kim , Dayun Ju , Yumin Shim , Seong Jae Hwang

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

We introduce the Diffusion Chain of Lateral Thought (DCoLT), a reasoning framework for diffusion language models. DCoLT treats each intermediate step in the reverse diffusion process as a latent "thinking" action and optimizes the entire…

Computation and Language · Computer Science 2025-11-03 Zemin Huang , Zhiyang Chen , Zijun Wang , Tiancheng Li , Guo-Jun Qi

Autoregressive and diffusion models represent two complementary generative paradigms. Autoregressive models excel at sequential planning and constraint composition, yet struggle with tasks that require explicit spatial or physical…

Artificial Intelligence · Computer Science 2026-02-03 Mu Yuan , Liekang Zeng , Guoliang Xing , Lan Zhang , Yunhao Liu

While diffusion models have shown exceptional capabilities in aesthetic image synthesis, they often struggle with complex spatial understanding and reasoning. Existing approaches resort to Multimodal Large Language Models (MLLMs) to enhance…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Wei Chen , Yancheng Long , Mingqiao Liu , Haojie Ding , Yankai Yang , Hongyang Wei , Yi-Fan Zhang , Bin Wen , Fan Yang , Tingting Gao , Han Li , Long Chen

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

Aligning generative diffusion models with human preferences via reinforcement learning (RL) is critical yet challenging. Most existing algorithms are often vulnerable to reward hacking, such as quality degradation, over-stylization, or…

Recent studies have demonstrated the efficacy of using Reinforcement Learning (RL) in building reasoning models that articulate chains of thoughts prior to producing final answers. However, despite ongoing advances that aim at enabling…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yue Fan , Xuehai He , Diji Yang , Kaizhi Zheng , Ching-Chen Kuo , Yuting Zheng , Sravana Jyothi Narayanaraju , Xinze Guan , Xin Eric Wang

Thanks to their remarkable flexibility, diffusion models and flow models have emerged as promising candidates for policy representation. However, efficient reinforcement learning (RL) upon these policies remains a challenge due to the lack…

Machine Learning · Computer Science 2026-03-31 Chenxiao Gao , Edward Chen , Tianyi Chen , Bo Dai

Unified multimodal understanding and generation models recently have achieve significant improvement in image generation capability, yet a large gap remains in instruction following and detail preservation compared to systems that tightly…

Chain-of-Thought (CoT) reasoning improves multi-step mathematical problem solving in large language models but remains vulnerable to exposure bias and error accumulation, as early mistakes propagate irreversibly through autoregressive…

Computation and Language · Computer Science 2026-04-21 Shidong Cao , Hongzhan Lin , Yuxuan Gu , Ziyang Luo , Jing Ma

Reflection removal of a single image remains a highly challenging task due to the complex entanglement between target scenes and unwanted reflections. Despite significant progress, existing methods are hindered by the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jichen Hu , Chen Yang , Zanwei Zhou , Jiemin Fang , Xiaokang Yang , Qi Tian , Wei Shen

Recent large language models (LLMs) have demonstrated strong reasoning capabilities that benefits from online reinforcement learning (RL). These capabilities have primarily been demonstrated within the left-to-right autoregressive (AR)…

Computation and Language · Computer Science 2025-06-04 Siyan Zhao , Devaansh Gupta , Qinqing Zheng , Aditya Grover

In recent years, Diffusion Models have become the new state-of-the-art in deep generative modeling, ending the long-time dominance of Generative Adversarial Networks. Inspired by the Regularization by Denoising principle, we introduce an…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Pasquale Cascarano , Lorenzo Stacchio , Andrea Sebastiani , Alessandro Benfenati , Ulugbek S. Kamilov , Gustavo Marfia

Diffusion models are powerful generative models that allow for precise control over the characteristics of the generated samples. While these diffusion models trained on large datasets have achieved success, there is often a need to…

Large Reasoning Models (LRMs) demonstrate strong performance in complex tasks but often face the challenge of overthinking, leading to substantially high inference costs. Existing approaches synthesize shorter reasoning responses for LRMs…

Computation and Language · Computer Science 2026-03-02 Hexuan Deng , Wenxiang Jiao , Xuebo Liu , Jun Rao , Min Zhang

Machine unlearning in text-to-image diffusion models aims to remove targeted concepts while preserving overall utility. Prior diffusion unlearning methods typically rely on supervised weight edits or global penalties; reinforcement-learning…

Machine Learning · Computer Science 2026-02-17 Mykola Vysotskyi , Zahar Kohut , Mariia Shpir , Taras Rumezhak , Volodymyr Karpiv

Diffusion models surpass previous generative models in sample quality and training stability. Recent works have shown the advantages of diffusion models in improving reinforcement learning (RL) solutions. This survey aims to provide an…

Machine Learning · Computer Science 2024-02-26 Zhengbang Zhu , Hanye Zhao , Haoran He , Yichao Zhong , Shenyu Zhang , Haoquan Guo , Tingting Chen , Weinan Zhang

Chain-of-Thought (CoT) reasoning has been extensively explored in large models to tackle complex understanding tasks. However, it still remains an open question whether such strategies can be applied to verifying and reinforcing image…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Ziyu Guo , Renrui Zhang , Chengzhuo Tong , Zhizheng Zhao , Rui Huang , Haoquan Zhang , Manyuan Zhang , Jiaming Liu , Shanghang Zhang , Peng Gao , Hongsheng Li , Pheng-Ann Heng

Diffusion-based large language models offer a non-autoregressive alternative for text generation, but enabling them to perform complex reasoning remains challenging. Reinforcement learning has recently emerged as an effective post-training…

Artificial Intelligence · Computer Science 2026-04-14 Shaoan Xie , Lingjing Kong , Xiangchen Song , Xinshuai Dong , Guangyi Chen , Eric P. Xing , Kun Zhang