English
Related papers

Related papers: WIST: Web-Grounded Iterative Self-Play Tree for Do…

200 papers

Reinforcement learning with verifiable rewards has become a common way to improve explicit reasoning in large language models, but final-answer correctness alone does not reveal whether the reasoning trace is faithful, reliable, or useful…

Artificial Intelligence · Computer Science 2026-05-08 Tianyang Han , Hengyu Shi , Junjie Hu , Xu Yang , Zhiling Wang , Junhao Su

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

Test-time inference has emerged as a powerful paradigm for enabling language models to ``think'' longer and more carefully about complex challenges, much like skilled human experts. While reinforcement learning (RL) can drive…

Computation and Language · Computer Science 2025-08-18 Kanishk Gandhi , Ayush Chakravarthy , Anikait Singh , Nathan Lile , Noah D. Goodman

Reinforcement learning (RL) has significantly improved the reasoning ability of large language models. However, current reward models underperform in challenging reasoning scenarios and predominant RL training paradigms rely on rule-based…

Computation and Language · Computer Science 2025-07-30 Meng Zhou , Bei Li , Jiahao Liu , Xiaowen Shi , Yang Bai , Rongxiang Weng , Jingang Wang , Xunliang Cai

Long video understanding is challenging due to rich and complicated multimodal clues in long temporal range.Current methods adopt reasoning to improve the model's ability to analyze complex video clues in long videos via text-form…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Houlun Chen , Xin Wang , Guangyao Li , Yuwei Zhou , Yihan Chen , Jia Jia , Wenwu Zhu

The performance of automatic speech recognition (ASR) systems typically degrades significantly when the training and test data domains are mismatched. In this paper, we show that self-training (ST) combined with an uncertainty-based…

Computation and Language · Computer Science 2021-02-17 Sameer Khurana , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Large Language Models (LLMs) are changing the coding paradigm, known as vibe coding, yet synthesizing algorithmically sophisticated and robust code still remains a critical challenge. Incentivizing the deep reasoning capabilities of LLMs is…

Computation and Language · Computer Science 2026-02-18 Chansung Park , Juyong Jiang , Fan Wang , Sayak Paul , Jiasi Shen , Jing Tang , Jianguo Li

Large language models have achieved strong performance on medical reasoning benchmarks, yet their deployment in clinical settings demands rigorous verification to ensure factual accuracy. While reward models offer a scalable approach for…

Artificial Intelligence · Computer Science 2026-01-29 Hang Zhang , Ruheng Wang , Yuelyu Ji , Mingu Kwak , Xizhi Wu , Chenyu Li , Li Zhang , Wenqi Shi , Yifan Peng , Yanshan Wang

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for complex reasoning tasks with clear correctness signals such as math and coding. However, extending it to real-world reasoning tasks is challenging, as evaluation…

Machine Learning · Computer Science 2025-10-06 Anisha Gunjal , Anthony Wang , Elaine Lau , Vaskar Nath , Yunzhong He , Bing Liu , Sean Hendryx

Language models rely on semantic priors to perform in-context learning, which leads to poor performance on tasks involving inductive reasoning. Instruction-tuning methods based on imitation learning can superficially enhance the in-context…

Computation and Language · Computer Science 2025-04-16 Nafis Sadeq , Xin Xu , Zhouhang Xie , Julian McAuley , Byungkyu Kang , Prarit Lamba , Xiang Gao

Reinforcement Learning with Verifiable Rewards (RLVR) is an effective paradigm for improving the reasoning capabilities of large language models. However, existing RLVR methods utilize rollouts in an indiscriminate and short-horizon manner:…

Machine Learning · Computer Science 2026-05-26 Xiaodong Lu , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Zhijun Chen , Yu Luo , Fuzhen Zhuang , Yikun Ban , Deqing Wang

Given a textual passage and an answer, humans are able to ask questions with various expressions, but this ability is still challenging for most question generation (QG) systems. Existing solutions mainly focus on the internal knowledge…

Computation and Language · Computer Science 2023-10-24 Qi Gou , Zehua Xia , Bowen Yu , Haiyang Yu , Fei Huang , Yongbin Li , Nguyen Cam-Tu

Developing custom reasoning models via Reinforcement Learning (RL) that can incorporate organization-specific knowledge has great potential to address problems faced by enterprise customers. In many of these problems, the reward function is…

Recent AI advancements, such as OpenAI's new models, are transforming LLMs into LRMs (Large Reasoning Models) that perform reasoning during inference, taking extra time and compute for higher-quality outputs. We aim to uncover the…

Artificial Intelligence · Computer Science 2025-02-11 Guanghao Ye , Khiem Duc Pham , Xinzhi Zhang , Sivakanth Gopi , Baolin Peng , Beibin Li , Janardhan Kulkarni , Huseyin A. Inan

Recent advancements in large language models (LLMs) have shifted the post-training paradigm from traditional instruction tuning and human preference alignment toward reinforcement learning (RL) focused on reasoning capabilities. However,…

Artificial Intelligence · Computer Science 2025-11-12 Qianxi He , Qingyu Ren , Shanzhe Lei , Xuhong Wang , Yingchun Wang

With the rapid advancement of large language models (LLMs) technologies, their application in the domain of autonomous driving has become increasingly widespread. However, existing methods suffer from unstructured reasoning, poor…

Artificial Intelligence · Computer Science 2026-01-09 Chang Zhao , Zheming Yang , Yunqing Hu , Qi Guo , Zijian Wang , Pengcheng Li , Wen Ji

Self-play fine-tuning enables large language models to improve beyond supervised fine-tuning without additional human annotations by contrasting annotated responses with self-generated ones. Many existing methods rely on a fixed divergence…

Machine Learning · Computer Science 2026-04-24 Wenjie Liao , Like Wu , Liangjie Zhao , Shihui Xu , Shigeru Fujimura

Text-driven video editing enables users to modify video content only using text queries. While existing methods can modify video content if explicit descriptions of editing targets with precise spatial locations and temporal boundaries are…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yiqing Shen , Chenjia Li , Mathias Unberath

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

The recent DeepSeek-R1 release has demonstrated the immense potential of reinforcement learning (RL) in enhancing the general reasoning capabilities of large language models (LLMs). While DeepSeek-R1 and other follow-up work primarily focus…