English
Related papers

Related papers: PoLi-RL: A Point-to-List Reinforcement Learning Fr…

200 papers

Class-Incremental Learning (CIL) aims to learn new classes sequentially while retaining the knowledge of previously learned classes. Recently, pre-trained models (PTMs) combined with parameter-efficient fine-tuning (PEFT) have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jiangpeng He , Zhihao Duan , Fengqing Zhu

Large language models (LLMs) are typically trained by reinforcement learning (RL) with verifiable rewards (RLVR) and supervised fine-tuning (SFT) on reasoning traces to improve their reasoning abilities. However, how these methods shape…

Artificial Intelligence · Computer Science 2026-05-28 Kohsei Matsutani , Shota Takashiro , Gouki Minegishi , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have empowered large language models (LLMs) to tackle challenging reasoning tasks such as mathematics and programming. Despite its promise, the RLVR paradigm poses…

Computation and Language · Computer Science 2026-02-17 Jiaming Li , Longze Chen , Ze Gong , Yukun Chen , Lu Wang , Wanwei He , Run Luo , Min Yang

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

Artificial Intelligence · Computer Science 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

The next point-of-interest (POI) recommendation task aims to predict the users' immediate next destinations based on their preferences and historical check-ins, holding significant value in location-based services. Recently, large language…

Artificial Intelligence · Computer Science 2025-10-17 Penglong Zhai , Jie Li , Fanyi Di , Yue Liu , Yifang Yuan , Jie Huang , Peng Wu , Sicong Wang , Mingyang Yin , Tingting Hu , Yao Xu , Xin Li

Speech large language models (LLMs) have driven significant progress in end-to-end speech understanding and recognition, yet they continue to struggle with accurately recognizing rare words and domain-specific terminology. This paper…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Bo Ren , Ruchao Fan , Yelong Shen , Weizhu Chen , Jinyu Li

Training Large Reasoning Model (LRM) is usually unstable and unpredictable, especially on hard problems or weak foundation models. We found that the current post-training scaling strategy can still improve on these cases. We propose…

Machine Learning · Computer Science 2026-01-22 Yutong Chen , Jiandong Gao , Ji Wu

Progress in long-context reasoning for large language models (LLMs) has lagged behind other recent advances. This gap arises not only from the intrinsic difficulty of processing long texts, but also from the scarcity of reliable human…

Computation and Language · Computer Science 2026-03-16 Ziyi Yang , Weizhou Shen , Chenliang Li , Ruijun Chen , Fanqi Wan , Ming Yan , Xiaojun Quan , Fei Huang

We explore a novel approach for Semantic Role Labeling (SRL) by casting it as a sequence-to-sequence process. We employ an attention-based model enriched with a copying mechanism to ensure faithful regeneration of the input sequence, while…

Computation and Language · Computer Science 2018-07-10 Angel Daza , Anette Frank

Sequential Recommendation (SR) aims to predict the next interaction of a user based on their behavior sequence, where complementary relations often provide essential signals for predicting the next item. However, mainstream models relying…

Information Retrieval · Computer Science 2026-04-22 Qian Zhang , Lech Szymanski , Haibo Zhang , Jeremiah D. Deng

Recent advances in vision-language models (VLMs) reasoning have been largely attributed to the rise of reinforcement Learning (RL), which has shifted the community's focus away from the supervised fine-tuning (SFT) paradigm. Many studies…

Reinforcement learning from verifiable rewards (RLVR) has shown strong promise for LLM reasoning, but outcome-based RLVR remains inefficient on hard problems because correct final-answer rollouts are rare and sample-level credit assignment…

Machine Learning · Computer Science 2026-05-22 Xitai Jiang , Zihan Tang , Wenze Lin , Yang Yue , Shenzhi Wang , Gao Huang

Recent advances in medical large language models have explored Test-Time Reinforcement Learning (TTRL) to enhance reasoning. However, standard TTRL often relies on majority voting (MV) as a heuristic supervision signal, which can be…

Machine Learning · Computer Science 2026-03-11 Kailong Fan , Anqi Pu , Yichen Wu , Wanhua Li , Yicong Li , Hanspeter Pfister , Huafeng Liu , Xiang Li , Quanzheng Li , Ning Guo

Direct evaluation of LLMs on benchmarks can be misleading because comparatively strong performance may reflect task familiarity rather than capability. The train-before-test approach controls for task familiarity by giving each model…

Machine Learning · Computer Science 2026-03-16 Kun Wang , Reinhard Heckel

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Recent advances of Reinforcement Learning (RL) have highlighted its potential in complex reasoning tasks, yet effective training often relies on external supervision, which limits the broader applicability. In this work, we propose a novel…

Artificial Intelligence · Computer Science 2025-06-11 Kongcheng Zhang , Qi Yao , Shunyu Liu , Yingjie Wang , Baisheng Lai , Jieping Ye , Mingli Song , Dacheng Tao

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

As large language model agents tackle increasingly complex long-horizon tasks, effective post-training becomes critical. Prior work faces fundamental challenges: outcome-only rewards fail to precisely attribute credit to intermediate steps,…

Computation and Language · Computer Science 2026-04-30 Mukai Li , Qingcheng Zeng , Tianqing Fang , Zhenwen Liang , Linfeng Song , Qi Liu , Haitao Mi , Dong Yu

This paper studies semantic parsing for interlanguage (L2), taking semantic role labeling (SRL) as a case task and learner Chinese as a case language. We first manually annotate the semantic roles for a set of learner texts to derive a gold…

Computation and Language · Computer Science 2018-08-30 Zi Lin , Yuguang Duan , Yuanyuan Zhao , Weiwei Sun , Xiaojun Wan

Reinforcement learning (RL) has proven effective in incentivizing the reasoning abilities of large language models (LLMs), but suffers from severe efficiency challenges due to its trial-and-error nature. While the common practice employs…

Computation and Language · Computer Science 2025-10-17 Liang Chen , Xueting Han , Li Shen , Jing Bai , Kam-Fai Wong