English
Related papers

Related papers: Overcoming Catastrophic Forgetting in Visual Conti…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for post-training reasoning models. However, group-based methods such as Group Relative Policy Optimization (GRPO) face a critical dilemma in…

Machine Learning · Computer Science 2026-04-07 Yuning Wu , Ke Wang , Devin Chen , Kai Wei

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

Machine Learning · Computer Science 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Vision-Language-Action (VLA) models excel in robotic manipulation but are constrained by their heavy reliance on expert demonstrations, leading to demonstration bias and limiting performance. Reinforcement learning (RL) is a vital…

Robotics · Computer Science 2025-12-02 Senyu Fei , Siyin Wang , Li Ji , Ao Li , Shiduo Zhang , Liming Liu , Jinlong Hou , Jingjing Gong , Xianzhong Zhao , Xipeng Qiu

Chain-of-Thought (CoT) prompting has recently shown significant promise across various NLP and computer vision tasks by explicitly generating intermediate reasoning steps. However, we find that reinforcement learning (RL)-based fine-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Qingyang Yan , Guangyao Chen , Yixiong Zou

Recent advances in vision-language models (VLMs) reasoning have been largely attributed to the rise of reinforcement Learning (RL), which has shifted the community's focus away from the supervised fine-tuning (SFT) paradigm. Many studies…

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu

Video generation models produce visually coherent content but struggle with tasks requiring spatial reasoning and multi-step planning. Reinforcement learning (RL) offers a path to improve generalization, but its effectiveness in video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ming Liu , Yunbei Zhang , Shilong Liu , Liwen Wang , Wensheng Zhang

Pre-trained models with parameter-efficient fine-tuning (PEFT) have demonstrated promising potential for class-incremental learning (CIL), yet catastrophic forgetting still persists when adapting models to new tasks. In this paper, we…

Machine Learning · Computer Science 2026-05-11 Fengqiang Wan , Yipeng Lin , Kan Lv , Yang Yang

Long chain-of-thought (CoT) reasoning improves large vision--language models, but visual information often fades during generation, limiting long-horizon multimodal reasoning. Existing methods either re-inject vision at inference or train…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xuan Gong , Hanbo Huang , Hao Zheng , Yiran Zhang , Wenbin Dai , Weishu Zhao , Shiyu Liang

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau

Simulation offers a scalable and low-cost way to enrich vision-language-action (VLA) training, reducing reliance on expensive real-robot demonstrations. However, most sim-real co-training methods rely on supervised fine-tuning (SFT), which…

Robotics · Computer Science 2026-03-09 Liangzhi Shi , Shuaihang Chen , Feng Gao , Yinuo Chen , Kang Chen , Tonghe Zhang , Hongzhi Zang , Weinan Zhang , Chao Yu , Yu Wang

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective paradigm for improving the reasoning capabilities of large language models. However, RLVR training is often hindered by sparse binary rewards and weak credit…

Computation and Language · Computer Science 2026-05-15 Mengjie Ren , Jie Lou , Boxi Cao , Xueru Wen , Hongyu Lin , Xianpei Han , Le Sun , Xing Yu , Yaojie Lu

Existing table understanding methods face challenges due to complex table structures and intricate logical reasoning. While supervised finetuning (SFT) dominates existing research, reinforcement learning (RL), such as Group Relative Policy…

Computation and Language · Computer Science 2026-03-27 Xiaoqiang Kang , Shengen Wu , Zimu Wang , Yilin Liu , Xiaobo Jin , Kaizhu Huang , Wei Wang , Yutao Yue , Xiaowei Huang , Qiufeng Wang

Catastrophic forgetting remains a central challenge in continual learning (CL) with pre-trained models. While existing approaches typically freeze the backbone and fine-tune a small number of parameters to mitigate forgetting, they still…

Machine Learning · Computer Science 2025-09-03 Jiao Chen , Jiayi He , Fangfang Chen , Zuohong Lv , Jianhua Tang

Differentiable reinforcement learning (RL) frameworks like DiffRO offer a powerful approach for controllable text-to-speech (TTS), but are vulnerable to reward hacking, particularly for nuanced tasks like emotion control. The policy model…

Sound · Computer Science 2026-02-17 Cong Wang , Changfeng Gao , Yang Xiang , Zhihao Du , Keyu An , Han Zhao , Qian Chen , Xiangang Li , Yingming Gao , Ya Li

Contemporary reinforcement learning with verifiable reward methods post-train language models on multi-step reasoning by assigning a single outcome reward uniformly across all tokens in a trajectory. Such uniform assignment ignores which…

Artificial Intelligence · Computer Science 2026-05-27 Ankur Samanta , Akshayaa Magesh , Ayush Jain , Youliang Yu , Daniel Jiang , Kavosh Asadi , Kaveh Hassani , Paul Sajda , Jalaj Bhandari , Yonathan Efroni

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Recent works have demonstrated the effectiveness of reinforcement learning (RL)-based post-training for enhancing the reasoning capabilities of large language models (LLMs). In particular, Group Relative Policy Optimization (GRPO) has shown…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jinyoung Park , Jeehye Na , Jinyoung Kim , Hyunwoo J. Kim

While Supervised Fine-Tuning (SFT) and Rejection Sampling Fine-Tuning (RFT) are standard for LLM alignment, they either rely on costly expert data or discard valuable negative samples, leading to data inefficiency. To address this, we…

Machine Learning · Computer Science 2026-04-24 Zehua Liu , Shuqi Liu , Tao Zhong , Mingxuan Yuan

Extending large language models (LLMs) to low-resource languages often incurs an "alignment tax": improvements in the target language come at the cost of catastrophic forgetting in general capabilities. We argue that this trade-off arises…

Computation and Language · Computer Science 2026-05-15 Zeli Su , Ziyin Zhang , Zhou Liu , Xuexian Song , Zhankai Xu , Longfei Zheng , Xiaolu Zhang , Rong Fu , Guixian Xu , Wentao Zhang