English
Related papers

Related papers: Sketch Then Paint: Hierarchical Reinforcement Lear…

200 papers

Reinforcement Learning (RL) is pivotal for enhancing Large Language Model (LLM) reasoning, yet mainstream algorithms such as GRPO and DAPO remain constrained by a coarse-grained credit assignment paradigm, where all tokens within the same…

Computation and Language · Computer Science 2026-02-06 Hongze Tan , Zihan Wang , Jianfei Pan , Jinghao Lin , Hao Wang , Yifan Wu , Tao Chen , Zhihang Zheng , Zhihao Tang , Haihua Yang

Masked diffusion large language models (dLLMs) are emerging as promising alternatives to autoregressive LLMs, offering competitive performance while supporting unique generation capabilities such as inpainting. We explore how inpainting can…

Machine Learning · Computer Science 2025-09-15 Siyan Zhao , Mengchen Liu , Jing Huang , Miao Liu , Chenyu Wang , Bo Liu , Yuandong Tian , Guan Pang , Sean Bell , Aditya Grover , Feiyu Chen

Optimizing discrete diffusion model (DDM) with rewards remains a challenge: the non-autoregressive paradigm makes importance sampling intractable and rollout complex, puzzling reinforcement learning methods such as Group Relative Policy…

Artificial Intelligence · Computer Science 2025-10-06 Tianren Ma , Mu Zhang , Yibing Wang , Qixiang Ye

Faithful text rendering remains a persistent weakness of large text-to-image generative models, as it requires both semantic instruction following and fine-grained glyph-level structure. Prior methods often improve this ability through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Mingxuan Cui , Jingpu Yang , Fengxian Ji , Qian Jiang , Zhecheng Shi , Jiaming Wang , Zirui Song , Fajri Koto , Xiuying Chen

Reinforcement Learning with Verifiable Rewards (RLVR) offers a promising framework for optimizing large language models in reasoning tasks. However, existing RLVR algorithms focus on different granularities, and each has complementary…

Machine Learning · Computer Science 2026-01-12 Zijun Min , Bingshuai Liu , Ante Wang , Long Zhang , Anxiang Zeng , Haibo Zhang , Jinsong Su

Recent advances in diffusion models have demonstrated impressive capability in generating high-quality images for simple prompts. However, when confronted with complex prompts involving multiple objects and hierarchical structures, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Hongji Yang , Yucheng Zhou , Wencheng Han , Runzhou Tao , Zhongying Qiu , Jianfei Yang , Jianbing Shen

Reinforcement learning (RL) has garnered increasing attention in text-to-image (T2I) generation. However, most existing RL approaches are tailored to either diffusion models or autoregressive models, overlooking an important alternative:…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yifu Luo , Xinhao Hu , Keyu Fan , Haoyuan Sun , Zeyu Chen , Bo Xia , Tiantian Zhang , Yongzhe Chang , Xueqian Wang

Large Language Models (LLMs) show potential as sequential decision-making agents, but their application is often limited due to a reliance on large, computationally expensive models. This creates a need to improve smaller models, yet…

Computation and Language · Computer Science 2025-08-15 Jim Dilkes , Vahid Yazdanpanah , Sebastian Stein

Recent endeavors in Multimodal Large Language Models (MLLMs) aim to unify visual comprehension and generation by combining LLM and diffusion models, the state-of-the-art in each task, respectively. Existing approaches rely on spatial visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Kaihang Pan , Wang Lin , Zhongqi Yue , Tenglong Ao , Liyu Jia , Wei Zhao , Juncheng Li , Siliang Tang , Hanwang Zhang

Current mainstream methods of aligning diffusion models with human preferences typically employ VLM-based reward models. However, these reward models, pre-trained for semantic alignment, struggle to capture the essential perceptual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jaxon Zhang , Binxin Yang , Hubery Yin , Chen Li , Jing Lyu

Recent advancements highlight the importance of GRPO-based reinforcement learning methods and benchmarking in enhancing text-to-image (T2I) generation. However, current methods using pointwise reward models (RM) for scoring generated images…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yibin Wang , Zhimin Li , Yuhang Zang , Yujie Zhou , Jiazi Bu , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Text-to-image generation has evolved beyond single monolithic models to complex multi-component pipelines. These combine fine-tuned generators, adapters, upscaling blocks and even editing steps, leading to significant improvements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Uri Gadot , Rinon Gal , Yftah Ziser , Gal Chechik , Shie Mannor

Traditional preference tuning methods for LLMs/Visual Generative Models often rely solely on reward model labeling, which can be opaque, offer limited insights into the rationale behind preferences, and are prone to issues such as reward…

Machine Learning · Computer Science 2026-01-13 Hanyang Zhao , Haoxian Chen , Yucheng Guo , Genta Indra Winata , Tingting Ou , Ziyu Huang , David D. Yao , Wenpin Tang

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

Machine Learning · Computer Science 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Recent advancements underscore the significant role of Reinforcement Learning (RL) in enhancing the Chain-of-Thought (CoT) reasoning capabilities of large language models (LLMs). Two prominent RL algorithms, Direct Preference Optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Chengzhuo Tong , Ziyu Guo , Renrui Zhang , Wenyu Shan , Xinyu Wei , Zhenghao Xing , Hongsheng Li , Pheng-Ann Heng

While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks suffer from a foundational methodological flaw: by distributing identical advantages across…

Artificial Intelligence · Computer Science 2026-04-09 Zekai Ye , Qiming Li , Xiaocheng Feng , Ruihan Chen , Ziming Li , Haoyu Ren , Kun Chen , Dandan Tu , Bing Qin

We propose reinforcement learning (RL) strategies tailored for reasoning in large language models (LLMs) under strict memory and compute limits, with a particular focus on compatibility with LoRA fine-tuning. Building on early policy…

Machine Learning · Computer Science 2025-06-13 Alan Lee , Harry Tong

Diffusion large language models (dLLMs) are emerging as promising alternatives to autoregressive (AR) LLMs. Recently, this paradigm has been extended to multimodal tasks, leading to the development of diffusion multimodal large language…

Artificial Intelligence · Computer Science 2026-04-08 Keuntae Kim , Mingyu Kang , Yong Suk Choi

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

Computation and Language · Computer Science 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Reinforcement learning (RL), particularly GRPO, improves image generation quality significantly by comparing the relative performance of images generated within the same group. However, in the later stages of training, the model tends to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Henglin Liu , Huijuan Huang , Jing Wang , Chang Liu , Xiu Li , Xiangyang Ji
‹ Prev 1 2 3 10 Next ›