English
Related papers

Related papers: Self-Reflective Reinforcement Learning for Diffusi…

200 papers

Diffusion and flow models achieve State-Of-The-Art (SOTA) generative performance, yet many practically important behaviors such as fine-grained prompt fidelity, compositional correctness, and text rendering are weakly specified by score or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

Machine Learning · Computer Science 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

Recently, diffusion models have garnered significant interest in the field of text processing due to their many potential advantages compared to conventional autoregressive models. In this work, we propose Diffusion-of-Thought (DoT), a…

Computation and Language · Computer Science 2024-12-06 Jiacheng Ye , Shansan Gong , Liheng Chen , Lin Zheng , Jiahui Gao , Han Shi , Chuan Wu , Xin Jiang , Zhenguo Li , Wei Bi , Lingpeng Kong

Large language models (LLMs) with Chain-of-Thought (CoT) reasoning have achieved strong performance across diverse tasks, including mathematics, coding, and general reasoning. A distinctive ability of these reasoning models is…

Artificial Intelligence · Computer Science 2025-12-17 Ge Yan , Chung-En Sun , Tsui-Wei , Weng

Recent improvements in conditional generative modeling have made it possible to generate high-quality images from language descriptions alone. We investigate whether these methods can directly address the problem of sequential…

Machine Learning · Computer Science 2023-07-11 Anurag Ajay , Yilun Du , Abhi Gupta , Joshua Tenenbaum , Tommi Jaakkola , Pulkit Agrawal

While image generation techniques are now capable of producing high-quality images that respect prompts which span multiple sentences, the task of text-guided image editing remains a challenge. Even edit requests that consist of only a few…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Saba Ahmadi , Rabiul Awal , Ankur Sikarwar , Amirhossein Kazemnejad , Ge Ya Luo , Juan A. Rodriguez , Sai Rajeswar , Siva Reddy , Christopher Pal , Benno Krojer , Aishwarya Agrawal

Large Language Models (LLMs) demonstrate their reasoning ability through chain-of-thought (CoT) generation. However, LLM's autoregressive decoding may limit the ability to revisit and refine earlier tokens in a holistic manner, which can…

Machine Learning · Computer Science 2026-04-24 Haoqiang Kang , Yizhe Zhang , Nikki Lijing Kuang , Nicklas Majamaki , Navdeep Jaitly , Yi-An Ma , Lianhui Qin

Diffusion models have emerged as powerful tools for 3D medical image generation, yet bridging the gap between standard training objectives and clinical relevance remains a challenge. This paper presents a method to enhance 3D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Yueying Tian , Xudong Han , Meng Zhou , Rodrigo Aviles-Espinosa , Rupert Young , Philip Birch

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

Machine Learning · Computer Science 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

Image retrieval remains a fundamental yet challenging problem in computer vision. While recent advances in Multimodal Large Language Models (MLLMs) have demonstrated strong reasoning capabilities, existing methods typically employ them only…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shangrong Wu , Yanghong Zhou , Yang Chen , Feng Zhang , P. Y. Mok

Diffusion and flow matching policies offer expressive, multimodal action modeling, yet they are frequently unstable in online reinforcement learning (RL) due to intractable likelihoods and gradients propagating through long sampling chains.…

Machine Learning · Computer Science 2026-03-10 Chubin Zhang , Zhenglin Wan , Feng Chen , Fuchao Yang , Lang Feng , Yaxin Zhou , Xingrui Yu , Yang You , Ivor Tsang , Bo An

This paper presents ThinkDiff, a novel alignment paradigm that empowers text-to-image diffusion models with multimodal in-context understanding and reasoning capabilities by integrating the strengths of vision-language models (VLMs).…

Machine Learning · Computer Science 2025-02-18 Zhenxing Mi , Kuan-Chieh Wang , Guocheng Qian , Hanrong Ye , Runtao Liu , Sergey Tulyakov , Kfir Aberman , Dan Xu

In language reasoning, longer chains of thought consistently yield better performance, which naturally suggests that visual latent reasoning may likewise benefit from longer latent sequences. However, we discover a counterintuitive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chenfeng Wang , Wei He , Xuhan Zhu , Chunpeng Zhou , Qizhen Li , Song Yan , Yufei Zheng , Chengjun Yu , Fan Lu , Wei Zhai , Yang Cao , Pengfei Yu , Zheng-Jun Zha

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Generative artificial intelligence holds significant potential for abuse, and generative image detection has become a key focus of research. However, existing methods primarily focused on detecting a specific generative model and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Peipei Yuan , Zijing Xie , Shuo Ye , Hong Chen , Yulong Wang

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

Recent advances in reasoning-centric language models have highlighted reinforcement learning (RL) as a promising method for aligning models with verifiable rewards. However, it remains contentious whether RL truly expands a model's…

Computation and Language · Computer Science 2025-06-02 Mingjie Liu , Shizhe Diao , Ximing Lu , Jian Hu , Xin Dong , Yejin Choi , Jan Kautz , Yi Dong

Multimodal large language models (MLLMs) have shown promising capabilities in reasoning tasks, yet still struggle with complex problems requiring explicit self-reflection and self-correction, especially compared to their unimodal text-based…

Computation and Language · Computer Science 2025-10-07 Zhongwei Wan , Zhihao Dou , Che Liu , Yu Zhang , Dongfei Cui , Qinjian Zhao , Hui Shen , Jing Xiong , Yi Xin , Yifan Jiang , Chaofan Tao , Yangfan He , Mi Zhang , Shen Yan

Super-resolution (SR) and image generation are important tasks in computer vision and are widely adopted in real-world applications. Most existing methods, however, generate images only at fixed-scale magnification and suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jinseok Kim , Tae-Kyun Kim

Diffusion-based image super-resolution (SR) methods have achieved remarkable success by leveraging large pre-trained text-to-image diffusion models as priors. However, these methods still face two challenges: the requirement for dozens of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Aiping Zhang , Zongsheng Yue , Renjing Pei , Wenqi Ren , Xiaochun Cao