中文
相关论文

相关论文: S-GRPO: Unified Post-Training for Large Vision-Lan…

200 篇论文

Generative speech enhancement offers a promising alternative to traditional discriminative methods by modeling the distribution of clean speech conditioned on noisy inputs. Post-training alignment via reinforcement learning (RL) effectively…

音频与语音处理 · 电气工程与系统科学 2026-01-26 Haoxu Wang , Biao Tian , Yiheng Jiang , Zexu Pan , Shengkui Zhao , Bin Ma , Daren Chen , Xiangang Li

With the rapid advancement of large language models (LLMs), their robustness against adversarial manipulations, particularly jailbreak backdoor attacks, has become critically important. Existing approaches to embedding jailbreak…

计算与语言 · 计算机科学 2025-09-25 Wence Ji , Jiancan Wu , Aiying Li , Shuyi Zhang , Junkang Wu , An Zhang , Xiang Wang , Xiangnan He

Post-training has become central to turning pretrained large language models (LLMs) into aligned, capable, and deployable systems. Recent progress spans supervised fine-tuning (SFT), preference optimization, reinforcement learning (RL),…

Despite recent advances in Large Video Language Models (LVLMs), they still struggle with fine-grained temporal understanding, hallucinate, and often make simple mistakes on even simple video question-answering tasks, all of which pose…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Pritam Sarkar , Ali Etemad

Complex video reasoning remains a significant challenge for Multimodal Large Language Models (MLLMs), as current R1-based methodologies often prioritize text-centric reasoning derived from text-based and image-based developments. In video…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Bo Fang , Yuxin Song , Qiangqiang Wu , Haoyuan Sun , Wenhao Wu , Antoni B. Chan

Rapid urbanization intensifies the demand for Urban General Intelligence (UGI), referring to AI systems that can understand and reason about complex urban environments. Recent studies have built urban foundation models using supervised…

人工智能 · 计算机科学 2025-10-21 Qiongyan Wang , Xingchen Zou , Yutian Jiang , Haomin Wen , Jiaheng Wei , Qingsong Wen , Yuxuan Liang

As large language model agents tackle increasingly complex long-horizon tasks, effective post-training becomes critical. Prior work faces fundamental challenges: outcome-only rewards fail to precisely attribute credit to intermediate steps,…

计算与语言 · 计算机科学 2026-04-30 Mukai Li , Qingcheng Zeng , Tianqing Fang , Zhenwen Liang , Linfeng Song , Qi Liu , Haitao Mi , Dong Yu

Group-Relative Policy Optimization (GRPO) has emerged as the standard for training reasoning capabilities in large language models through reinforcement learning. By estimating advantages using group-mean rewards rather than a learned…

人工智能 · 计算机科学 2026-03-06 Anisha Garg , Claire Zhang , Nishit Neema , David Bick , Ganesh Venkatesh , Joel Hestness

In an era where tool-augmented AI agents are becoming increasingly vital, our findings highlight the ability of Group Relative Policy Optimization (GRPO) to empower SLMs, which are traditionally constrained in tool use. The ability to use…

计算与语言 · 计算机科学 2025-09-10 Dhruvi Paprunia , Vansh Kharidia , Pankti Doshi

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

计算与语言 · 计算机科学 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria

Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) are two prominent post-training paradigms for refining the capabilities and aligning the behavior of Large Language Models (LLMs). Existing approaches that integrate SFT and RL…

机器学习 · 计算机科学 2026-03-18 Wenhao Zhang , Yuexiang Xie , Yuchang Sun , Yanxi Chen , Guoyin Wang , Yaliang Li , Bolin Ding , Jingren Zhou

Small Vision Language Models (SVLMs) generally refer to models with parameter sizes less than or equal to 2B. Their low cost and power consumption characteristics confer high commercial value. However, their reasoning abilities are limited…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Fanyi Wang , Binzhi Dong , Haotian Hu , Jinjin Xu , Zhiwang Zhang

Unified models capable of interleaved generation have emerged as a promising paradigm, with the community increasingly converging on autoregressive modeling for text and flow matching for image generation. To advance this direction, we…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Jie Liu , Zilyu Ye , Linxiao Yuan , Shenhan Zhu , Yu Gao , Jie Wu , Kunchang Li , Xionghui Wang , Xiaonan Nie , Weilin Huang , Wanli Ouyang

Intent detection, a critical component in task-oriented dialogue (TOD) systems, faces significant challenges in adapting to the rapid influx of integrable tools with complex interrelationships. Existing approaches, such as zero-shot…

计算与语言 · 计算机科学 2025-04-22 Zihao Feng , Xiaoxue Wang , Ziwei Bai , Donghang Su , Bowen Wu , Qun Yu , Baoxun Wang

Recent advances in large language models (LLMs) highlight the importance of post training techniques for improving reasoning and mathematical ability. Group Relative Policy Optimization (GRPO) has shown promise in this domain by combining…

机器学习 · 计算机科学 2026-03-20 Gabriele Carrino , Andrea Sassella , Nicolo Brunello , Federico Toschi , Mark James Carman

Aligning denoising generative models with human preferences or verifiable rewards remains a key challenge. While policy-gradient online reinforcement learning (RL) offers a principled post-training framework, its direct application is…

机器学习 · 计算机科学 2026-04-28 Bingda Tang , Yuhui Zhang , Xiaohan Wang , Jiayuan Mao , Ludwig Schmidt , Serena Yeung-Levy

Continual post-training (CPT) is a popular and effective technique for adapting foundation models like multimodal large language models to specific and ever-evolving downstream tasks. While existing research has primarily concentrated on…

机器学习 · 计算机科学 2026-01-22 Song Lai , Haohan Zhao , Rong Feng , Changyi Ma , Wenzhuo Liu , Hongbo Zhao , Xi Lin , Dong Yi , Qingfu Zhang , Hongbin Liu , Gaofeng Meng , Fei Zhu

LLM-based search agents are increasingly trained on entity-centric synthetic data to solve complex, knowledge-intensive tasks. However, prevailing training methods like Group Relative Policy Optimization (GRPO) discard this rich entity…

In this work, we present a simple yet theoretically motivated improvement to Supervised Fine-Tuning (SFT) for the Large Language Model (LLM), addressing its limited generalization compared to reinforcement learning (RL). Through…

机器学习 · 计算机科学 2026-03-02 Yongliang Wu , Yizhou Zhou , Zhou Ziheng , Yingzhe Peng , Xinyu Ye , Xinting Hu , Wenbo Zhu , Lu Qi , Ming-Hsuan Yang , Xu Yang

Visual reasoning is crucial for understanding complex multimodal data and advancing Artificial General Intelligence. Existing methods enhance the reasoning capability of Multimodal Large Language Models (MLLMs) through Reinforcement…

计算机视觉与模式识别 · 计算机科学 2026-05-07 Chaoyang Wang , Zeyu Zhang , Meng Meng , Xu Zhou , Haiyun Jiang