English
Related papers

Related papers: GRPO-TTA: Test-Time Visual Tuning for Vision-Langu…

200 papers

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

Computation and Language · Computer Science 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang

Group Relative Policy Optimization (GRPO) has significantly advanced the reasoning ability of large language models (LLMs), particularly by boosting their mathematical performance. However, GRPO and related entropy-regularization methods…

Computation and Language · Computer Science 2025-10-13 Xingyu Lin , Yilin Wen , En Wang , Du Su , Wenbin Liu , Chenfu Bao , Zhonghou Lv

Test-time adaptation (TTA) intends to adapt the pretrained model to test distributions with only unlabeled test data streams. Most of the previous TTA methods have achieved great success on simple test data streams such as independently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Longhui Yuan , Binhui Xie , Shuang Li

Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Chang'an Yi , Haotian Chen , Yifan Zhang , Yonghui Xu , Yan Zhou , Lizhen Cui

The recent success and openness of DeepSeek-R1 have brought widespread attention to Group Relative Policy Optimization (GRPO) as a reinforcement learning method for large reasoning models (LRMs). In this work, we analyze the GRPO objective…

Machine Learning · Computer Science 2026-01-07 Gang Li , Ming Lin , Tomer Galanti , Zhengzhong Tu , Tianbao Yang

Instruction-guided image editing requires balancing target modification with non-target preservation. Recently, flow-based models have emerged as a strong and increasingly adopted backbone for instruction-guided image editing, thanks to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhuohan Ouyang , Zhe Qian , Wenhuo Cui , Chaoqun Wang

Recently, Group Relative Policy Optimization (GRPO) has shown promising potential for aligning text-to-image (T2I) models, yet existing GRPO-based methods suffer from two critical limitations. (1) \textit{Shared credit assignment}:…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Qiang Lyu , Zicong Chen , Chongxiao Wang , Haolin Shi , Shibo Gao , Ran Piao , Youwei Zeng , Jianlou Si , Fei Ding , Jing Li , Chun Pong Lau , Weiqiang Wang

Large Language Models (LLMs) have demonstrated remarkable proficiency in English mathematical reasoning, yet a significant performance disparity persists in multilingual contexts, largely attributed to deficiencies in language…

Computation and Language · Computer Science 2026-03-27 Xu Huang , Zhejian Lai , Zixian Huang , Jiajun Chen , Shujian Huang

Reinforcement learning with verifiable reward has recently emerged as a central paradigm for post-training large language models (LLMs); however, prevailing mean-based methods, such as Group Relative Policy Optimization (GRPO), suffer from…

Machine Learning · Computer Science 2025-10-02 Tao Ren , Jinyang Jiang , Hui Yang , Wan Tian , Minhao Zou , Guanghao Li , Zishi Zhang , Qinghao Wang , Shentao Qin , Yanjun Zhao , Rui Tao , Hui Shao , Yijie Peng

Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through direct token-level loss intervention, its efficacy is…

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

Machine Learning · Computer Science 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Vision-language models have showcased impressive zero-shot classification capabilities when equipped with suitable text prompts. Previous studies have shown the effectiveness of test-time prompt tuning; however, these methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuhan Zhu , Guozhen Zhang , Chen Xu , Haocheng Shen , Xiaoxin Chen , Gangshan Wu , Limin Wang

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

Recent advances in large language models have highlighted the critical need for precise control over model outputs through predefined constraints. While existing methods attempt to achieve this through either direct instruction-response…

Computation and Language · Computer Science 2025-03-27 Zhouhong Gu , Xingzhou Chen , Xiaoran Shi , Tao Wang , Suhang Zheng , Tianyu Li , Hongwei Feng , Yanghua Xiao

Vision-Language Models seamlessly discriminate among arbitrary semantic categories, yet they still suffer from poor generalization when presented with challenging examples. For this reason, Episodic Test-Time Adaptation (TTA) strategies…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Matteo Farina , Gianni Franchi , Giovanni Iacca , Massimiliano Mancini , Elisa Ricci

Adapting models to dynamic, real-world environments characterized by shifting data distributions and unseen test scenarios is a critical challenge in deep learning. In this paper, we consider a realistic and challenging Test-Time Adaptation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Manogna Sreenivas , Soma Biswas

Recently, Large Language Models (LLMs) have rapidly evolved, approaching Artificial General Intelligence (AGI) while benefiting from large-scale reinforcement learning to enhance Human Alignment (HA) and Reasoning. Recent reward-based…

Machine Learning · Computer Science 2025-06-19 Xuerui Su , Shufang Xie , Guoqing Liu , Yingce Xia , Renqian Luo , Peiran Jin , Zhiming Ma , Yue Wang , Zun Wang , Yuting Liu

While Reinforcement Learning from Verifiable Rewards (RLVR) has advanced reasoning in Large Vision-Language Models (LVLMs), prevailing frameworks suffer from a foundational methodological flaw: by distributing identical advantages across…

Artificial Intelligence · Computer Science 2026-04-09 Zekai Ye , Qiming Li , Xiaocheng Feng , Ruihan Chen , Ziming Li , Haoyu Ren , Kun Chen , Dandan Tu , Bing Qin

Recent flow matching models for text-to-image generation have achieved remarkable quality, yet their integration with reinforcement learning for human preference alignment remains suboptimal, hindering fine-grained reward-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xiaoxuan He , Siming Fu , Yuke Zhao , Wanli Li , Jian Yang , Dacheng Yin , Fengyun Rao , Bo Zhang

Recently, vision-language model (VLM) agents have shown promising progress in open-world tasks, where successful task completion often requires multiple turns of visual perception and action execution. However, existing methods still rely…

Machine Learning · Computer Science 2026-05-22 Xiongbin Wu , Zhihao Luo , Shanzhe Lei , Lechao Zhang , Xuhong Wang , Jie Yang , Zhonglong Zheng , Yuanjie Zheng , Xin Tan , Wei Liu