English
Related papers

Related papers: Edit-GRPO: A Locality-Preserving Policy Optimizati…

200 papers

Trust region-based optimization methods have become foundational reinforcement learning algorithms that offer stability and strong empirical performance in continuous control tasks. Growing interest in scalable and reusable control policies…

Machine Learning · Computer Science 2025-08-21 Thomas Gallien

The advent of autonomous agents is transforming interactions with Graphical User Interfaces (GUIs) by employing natural language as a powerful intermediary. Despite the predominance of Supervised Fine-Tuning (SFT) methods in current GUI…

Machine Learning · Computer Science 2026-04-22 Jiaqi Tang , Yu Xia , Yi-Feng Wu , Yuwei Hu , Yuhui Chen , Qing-Guo Chen , Xiaogang Xu , Xiangyu Wu , Hao Lu , Yanqing Ma , Shiyin Lu , Qifeng Chen

Significant progress has been made in recent years in image captioning, an active topic in the fields of vision and language. However, existing methods tend to yield overly general captions and consist of some of the most frequent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Jie Wu , Tianshui Chen , Hefeng Wu , Zhi Yang , Guangchun Luo , Liang Lin

A basic aspiration for interpretability research in large language models is to "localize" semantically meaningful behaviors to particular components within the LLM. There are various heuristics for finding candidate locations within the…

Machine Learning · Computer Science 2025-02-20 Zihao Wang , Victor Veitch

While reinforcement learning has advanced the alignment of text-to-image (T2I) models, state-of-the-art policy gradient methods are still hampered by training instability and high variance, hindering convergence speed and compromising image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Jeongjae Lee , Jong Chul Ye

The development of vision-language and generative models has significantly advanced text-guided image editing, which seeks the preservation of core elements in the source image while implementing modifications based on the target text.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yoonjeon Kim , Soohyun Ryu , Yeonsung Jung , Hyunkoo Lee , Joowon Kim , June Yong Yang , Jaeryong Hwang , Eunho Yang

Group Relative Policy Optimization (GRPO) has been shown to be an effective algorithm when an accurate reward model is available. However, such a highly reliable reward model is not available in many real-world tasks. In this paper, we…

Machine Learning · Computer Science 2026-01-12 Yuki Ichihara , Yuu Jinnai , Tetsuro Morimura , Mitsuki Sakamoto , Ryota Mitsuhashi , Eiji Uchibe

The accelerated advancement of generative AI significantly enhance the viability and effectiveness of generative regional editing methods. This evolution render the image manipulation more accessible, thereby intensifying the risk of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Zhihao Sun , Haipeng Fang , Xinying Zhao , Danding Wang , Juan Cao

Radiology report generation requires advanced medical image analysis, effective temporal reasoning, and accurate text generation. Although recent innovations, particularly multimodal large language models, have shown improved performance,…

Computation and Language · Computer Science 2025-11-11 Kai Zhang , Christopher Malon , Lichao Sun , Martin Renqiang Min

With the great success of text-conditioned diffusion models in creative text-to-image generation, various text-driven image editing approaches have attracted the attentions of many researchers. However, previous works mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhiyuan Ma , Guoli Jia , Bowen Zhou

Group Relative Policy Optimization (GRPO) is a promising policy-based approach for Large Language Model alignment, yet its performance is often limited by training instability and suboptimal convergence. In this paper, we identify and…

Machine Learning · Computer Science 2025-12-12 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino , Paolo Mori

While large-scale pre-trained text-to-image models can synthesize diverse and high-quality human-centric images, an intractable problem is how to preserve the face identity for conditioned face images. Existing methods either require…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zhuowei Chen , Shancheng Fang , Wei Liu , Qian He , Mengqi Huang , Yongdong Zhang , Zhendong Mao

Reinforcement learning (RL), particularly GRPO, improves image generation quality significantly by comparing the relative performance of images generated within the same group. However, in the later stages of training, the model tends to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Henglin Liu , Huijuan Huang , Jing Wang , Chang Liu , Xiu Li , Xiangyang Ji

Recently, text-guided image manipulation has received increasing attention in the research field of multimedia processing and computer vision due to its high flexibility and controllability. Its goal is to semantically manipulate parts of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Ryugo Morita , Zhiqiang Zhang , Man M. Ho , Jinjia Zhou

In this paper, we tackle the problem of performing consistent and unified modifications across a set of related images. This task is particularly challenging because these images may vary significantly in pose, viewpoint, and spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yue Ma , Xinyu Wang , Qianli Ma , Qinghe Wang , Mingzhe Zheng , Xiangpeng Yang , Hao Li , Chongbo Zhao , Jixuan Ying , Harry Yang , Hongyu Liu , Qifeng Chen

Real-world exposure correction is fundamentally challenged by spatially non-uniform degradations, where diverse exposure errors frequently coexist within a single image. However, existing exposure correction methods are still largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ao Li , Jiawei Sun , Le Dong , Zhenyu Wang , Weisheng Dong

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bo Yu , Fengze Yang , Yiming Liu , Chao Wang , Xuewen Luo , Taozhe Li , Ruimin Ke , Xiaofan Zhou , Chenxi Liu

Reinforcement learning (RL) has become a key driver of language model reasoning. Among RL algorithms, Group Relative Policy Optimization (GRPO) is the de facto standard, avoiding the need for a critic by using per-prompt baselines and…

Machine Learning · Computer Science 2026-02-02 Cheng Ge , Caitlyn Heqi Yin , Hao Liang , Jiawei Zhang

Recent advancements underscore the significant role of Reinforcement Learning (RL) in enhancing the Chain-of-Thought (CoT) reasoning capabilities of large language models (LLMs). Two prominent RL algorithms, Direct Preference Optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Chengzhuo Tong , Ziyu Guo , Renrui Zhang , Wenyu Shan , Xinyu Wei , Zhenghao Xing , Hongsheng Li , Pheng-Ann Heng

Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications for interactive editing, existing methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Haitian Zheng , Zhe Lin , Jingwan Lu , Scott Cohen , Eli Shechtman , Connelly Barnes , Jianming Zhang , Qing Liu , Yuqian Zhou , Sohrab Amirghodsi , Jiebo Luo