中文
相关论文

相关论文: TempSamp-R1: Effective Temporal Sampling with Rein…

200 篇论文

Group relative policy optimization (GRPO) has become a standard post-training paradigm for improving reasoning and preference alignment in large language models (LLMs), and has recently shown strong effectiveness in LLM-based recommender…

信息检索 · 计算机科学 2026-03-09 Yu Wang , Yonghui Yang , Le Wu , Jiancan Wu , Hefei Xu , Hui Lin

Large Language Models (LLMs) generate functionally correct solutions but often fall short in code efficiency, a critical bottleneck for real-world deployment. In this paper, we introduce a novel test-time iterative optimization framework to…

软件工程 · 计算机科学 2025-06-04 Mingzhe Du , Luu Anh Tuan , Yue Liu , Yuhao Qing , Dong Huang , Xinyi He , Qian Liu , Zejun Ma , See-kiong Ng

Multimodal large language models (MLLMs) have recently shown strong performance in visual understanding, yet they often lack temporal awareness, particularly in egocentric settings where reasoning depends on the correct ordering and…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Zhiyang Xu , Tian Qin , Bowen Jin , Zhengfeng Lai , Meng Cao , Lifu Huang , Peng Zhang

Vision-language models (VLMs), such as CLIP, have gained significant popularity as foundation models, with numerous fine-tuning methods developed to enhance performance on downstream tasks. However, due to their inherent vulnerability and…

机器学习 · 计算机科学 2025-08-28 Lijun Sheng , Jian Liang , Zilei Wang , Ran He

Temporal reasoning over long, multi-session dialogues is a critical capability for conversational agents. However, existing works and our pilot study have shown that as dialogue histories grow in length and accumulate noise, current…

Extending large language models (LLMs) to low-resource languages often incurs an "alignment tax": improvements in the target language come at the cost of catastrophic forgetting in general capabilities. We argue that this trade-off arises…

计算与语言 · 计算机科学 2026-05-15 Zeli Su , Ziyin Zhang , Zhou Liu , Xuexian Song , Zhankai Xu , Longfei Zheng , Xiaolu Zhang , Rong Fu , Guixian Xu , Wentao Zhang

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Sitong Gong , Lu Zhang , Yunzhi Zhuge , Xu Jia , Pingping Zhang , Huchuan Lu

Applying Reinforcement Learning (RL) to Video Large Language Models (Video-LLMs) shows significant promise for complex video reasoning. However, popular Reinforcement Fine-Tuning (RFT) methods, such as outcome-based Group Relative Policy…

计算与语言 · 计算机科学 2025-05-27 Yunxin Li , Xinyu Chen , Zitao Li , Zhenyu Liu , Longyue Wang , Wenhan Luo , Baotian Hu , Min Zhang

Video temporal grounding (VTG) aims to locate precise segments in videos based on language queries, which is a fundamental challenge in video understanding. While recent Multimodal Large Language Models (MLLMs) have shown promise in…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Lu Dong , Haiyu Zhang , Han Lin , Ziang Yan , Xiangyu Zeng , Hongjie Zhang , Yifei Huang , Yi Wang , Zhen-Hua Ling , Limin Wang , Yali Wang

To advance time series forecasting (TSF), various methods have been proposed to improve prediction accuracy, evolving from statistical techniques to data-driven deep learning architectures. Despite their effectiveness, most existing methods…

机器学习 · 计算机科学 2026-04-21 Yitong Zhou , Yucong Luo , Mingyue Cheng , Qi Liu , Jiahao Wang , Daoyu Wang , Enhong Chen

Temporal Video Grounding (TVG), which requires pinpointing relevant temporal segments from video based on language query, has always been a highly challenging task in the field of video understanding. Videos often have a larger volume of…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Feng Yue , Zhaoxing Zhang , Junming Jiao , Zhengyu Liang , Shiwen Cao , Feifei Zhang , Rong Shen

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

计算与语言 · 计算机科学 2026-05-29 Redacted by arXiv

Video Large Language Models (Video LLMs) have achieved significant success by adopting the paradigm of large-scale pre-training followed by supervised fine-tuning (SFT). However, existing approaches struggle with temporal reasoning due to…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Shicheng Li , Lei Li , Kun Ouyang , Shuhuai Ren , Yuanxin Liu , Yuanxing Zhang , Fuzheng Zhang , Lingpeng Kong , Qi Liu , Xu Sun

Multimodal Large Language Models (MLLMs) have gained significant traction for their ability to process diverse input data types and generate coherent, contextually relevant outputs across various applications. While supervised fine-tuning…

机器学习 · 计算机科学 2025-03-31 Zhiyuan Liu , Yuting Zhang , Feng Liu , Changwang Zhang , Ying Sun , Jun Wang

We propose Rec-R1, a general reinforcement learning framework that bridges large language models (LLMs) with recommendation systems through closed-loop optimization. Unlike prompting and supervised fine-tuning (SFT), Rec-R1 directly…

信息检索 · 计算机科学 2026-01-30 Jiacheng Lin , Tian Wang , Kun Qian

Group-based reinforcement learning algorithms such as Group Reward Policy Optimization (GRPO) have proven effective for fine-tuning large language models (LLMs) with human feedback. However, generating and storing multiple responses per…

机器学习 · 计算机科学 2025-07-01 Liangyu Wang , Huanyi Xie , Xinhai Wang , Tianjin Huang , Mengdi Li , Di Wang

Reinforcement learning has advanced video reasoning in large multi-modal models, yet dominant pipelines either rely on on-policy self-exploration, which plateaus at the model's knowledge boundary, or hybrid replay that mixes policies and…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Haojian Huang , Chuanyu Qin , Yinchuan Li , Yingcong Chen

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy…

机器学习 · 计算机科学 2024-06-07 Yaozhong Gan , Renye Yan , Zhe Wu , Junliang Xing

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

机器学习 · 计算机科学 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta