English
Related papers

Related papers: Post-Training and Test-Time Scaling of Generative …

200 papers

Instruction-guided image editing requires balancing target modification with non-target preservation. Recently, flow-based models have emerged as a strong and increasingly adopted backbone for instruction-guided image editing, thanks to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhuohan Ouyang , Zhe Qian , Wenhuo Cui , Chaoqun Wang

Trajectory Optimization (TO) and Reinforcement Learning (RL) offer complementary strengths for solving optimal control problems. TO efficiently computes locally optimal solutions but can struggle with non-convexity, while RL is more robust…

Robotics · Computer Science 2026-02-24 Elisa Alboni , Pietro Noah Crestaz , Elias Fontanari , Andrea Del Prete

Recently, vision-language model (VLM) agents have shown promising progress in open-world tasks, where successful task completion often requires multiple turns of visual perception and action execution. However, existing methods still rely…

Machine Learning · Computer Science 2026-05-22 Xiongbin Wu , Zhihao Luo , Shanzhe Lei , Lechao Zhang , Xuhong Wang , Jie Yang , Zhonglong Zheng , Yuanjie Zheng , Xin Tan , Wei Liu

Safe reinforcement learning has been a promising approach for optimizing the policy of an agent that operates in safety-critical applications. In this paper, we propose an algorithm, SNO-MDP, that explores and optimizes Markov decision…

Machine Learning · Computer Science 2020-08-18 Akifumi Wachi , Yanan Sui

Recent advancements in Reinforcement Learning (RL), particularly Group Relative Policy Optimization (GRPO), have significantly enhanced the reasoning capabilities of Large Language Models. However, applying these problem-centric…

Computation and Language · Computer Science 2026-05-26 Yihong Tang , Kehai Chen , Liang Yue , Benyou Wang , Min Zhang

We present a simple and intuitive approach for interactive control of physically simulated characters. Our work builds upon generative adversarial networks (GAN) and reinforcement learning, and introduces an imitation learning framework…

Graphics · Computer Science 2022-01-03 Pei Xu , Ioannis Karamouzas

Speech Recognition has seen a dramatic shift towards adopting Large Language Models (LLMs). This shift is partly driven by good scalability properties demonstrated by LLMs, ability to leverage large amounts of labelled, unlabelled speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Prashanth Gurunath Shivakumar , Yile Gu , Ankur Gandhe , Ivan Bulyko

Group Relative Policy Optimization (GRPO) has become a standard approach for training mathematical reasoning models; however, its reliance on multiple completions per prompt makes training computationally expensive. Although recent work has…

Machine Learning · Computer Science 2026-01-15 Kangda Wei , Ruihong Huang

Training large language models (LLMs) as interactive agents for controlling graphical user interfaces (GUIs) presents a unique challenge to optimize long-horizon action sequences with multimodal feedback from complex environments. While…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Fanbin Lu , Zhisheng Zhong , Shu Liu , Chi-Wing Fu , Jiaya Jia

Reinforcement learning (RL) has proven effective in strengthening the reasoning capabilities of large language models (LLMs). A widely adopted method, Group Relative Policy Optimization (GRPO), has shown strong empirical results in training…

Machine Learning · Computer Science 2026-03-11 Peter Chen , Xiaopeng Li , Ziniu Li , Xi Chen , Tianyi Lin

Group-Relative Policy Optimization (GRPO) has emerged as an efficient paradigm for aligning Large Language Models (LLMs), yet its efficacy is primarily confined to domains with verifiable ground truths. Extending GRPO to open-domain…

Machine Learning · Computer Science 2026-04-14 Yang Zhao , Hepeng Wang , Xiao Ding , Yangou Ouyang , Bibo Cai , Kai Xiong , Jinglong Gao , Zhouhao Sun , Li Du , Bing Qin , Ting Liu

Group-Relative Policy Optimization (GRPO) is a key technique for training large reasoning models, yet it suffers from a critical vulnerability: the \emph{Think-Answer Mismatch}, where noisy reward signals corrupt the learning process. This…

Machine Learning · Computer Science 2025-08-11 Si Shen , Peijun Shen , Wenhua Zhao , Danhao Zhu

Recently, post-training methods based on reinforcement learning, with a particular focus on Group Relative Policy Optimization (GRPO), have emerged as the robust paradigm for further advancement of text-to-image (T2I) models. However, these…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haoyuan Sun , Jing Wang , Yuxin Song , Yu Lu , Bo Fang , Yifu Luo , Jun Yin , Pengyu Zeng , Miao Zhang , Tiantian Zhang , Xueqian Wang , Shijian Lu

Predicting and planning interactive behaviors in complex traffic situations presents a challenging task. Especially in scenarios involving multiple traffic participants that interact densely, autonomous vehicles still struggle to interpret…

Multiagent Systems · Computer Science 2021-02-12 Julian Bernhard , Klemens Esterle , Patrick Hart , Tobias Kessler

The advancement of Text-to-SQL systems is currently hindered by the scarcity of high-quality training data and the limited reasoning capabilities of models in complex scenarios. In this paper, we propose a holistic framework that addresses…

Databases · Computer Science 2025-12-30 Cehua Yang , Dongyu Xiao , Junming Lin , Yuyang Song , Hanxu Yan , Shawn Guo , Wei Zhang , Jian Yang , Mingjie Tang , Bryan Dai

Large Language Models (LLMs) perform well in language tasks but often lack collaborative awareness and struggle to optimize global performance in multi-agent settings. We present a reinforcement learning-augmented LLM agent framework that…

Artificial Intelligence · Computer Science 2026-01-01 Dong Qiu , Duo Xu , Limengxi Yue

The success of Deepseek-R1 has drawn the LLM community's attention to reinforcement learning (RL) methods like GRPO. However, such rule-based 0/1 outcome reward methods lack the capability to regulate the intermediate reasoning processes…

Artificial Intelligence · Computer Science 2025-05-26 Muzhi Dai , Shixuan Liu , Qingyi Si

Learning agents that excel at sequential decision-making tasks must continuously resolve the problem of exploration and exploitation for optimal learning. However, such interactions with the environment online might be prohibitively…

Machine Learning · Computer Science 2024-12-30 Ambedkar Dukkipati , Ranga Shaarad Ayyagari , Bodhisattwa Dasgupta , Parag Dutta , Prabhas Reddy Onteru

Finetuning Large Vision-Language Models with reinforcement learning has emerged as a promising approach to enhance their capability in object-level grounding. However, existing methods, mainly based on GRPO, assign rewards at the response…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yuyuan Liu , Yiping Ji , Anjie Le , Jiayuan Zhu , Jiazhen Pan , Can Peng , Jiajun Deng , Fengbei Liu , Junde Wu

Group Relative Policy Optimization (GRPO) has been a key driver of recent progress in reinforcement learning with verifiable rewards (RLVR) for large language models, but it is typically trained in a low-staleness, near-on-policy regime…

Machine Learning · Computer Science 2026-05-19 Minghao Tian , Yunfei Xie , Chen Wei