English
Related papers

Related papers: Every Step Evolves: Scaling Reinforcement Learning…

200 papers

K2-Think is a reasoning system that achieves state-of-the-art performance with a 32B parameter model, matching or surpassing much larger models like GPT-OSS 120B and DeepSeek v3.1. Built on the Qwen2.5 base model, our system shows that…

Recent advancements in large language models have demonstrated how chain-of-thought (CoT) and reinforcement learning (RL) can improve performance. However, applying such reasoning strategies to the visual generation domain remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Dongzhi Jiang , Ziyu Guo , Renrui Zhang , Zhuofan Zong , Hao Li , Le Zhuo , Shilin Yan , Pheng-Ann Heng , Hongsheng Li

Large language models (LLMs) and multimodal LLMs (MLL-Ms) excel at chain-of-thought reasoning but face distribution shift at test-time and a lack of verifiable supervision. Recent test-time reinforcement learning (TTRL) methods derive…

Computation and Language · Computer Science 2026-03-09 Jianghao Wu , Yasmeen George , Jin Ye , Yicheng Wu , Daniel F. Schmidt , Jianfei Cai

Large Language Models (LLMs) have shown significant promise in automated theorem proving, yet progress is often constrained by the scarcity of diverse and high-quality formal language data. To address this issue, we introduce…

Computation and Language · Computer Science 2025-12-02 Xinyuan Zhou , Yi Lei , Xiaoyu Zhou , Jingyi Sun , Yu Zhu , Zhongyi Ye , Weitai Zhang , Quan Liu , Si Wei , Cong Liu

Multimodal interleaved datasets featuring free-form interleaved sequences of images and text are crucial for training frontier large multimodal models (LMMs). Despite the rapid progression of open-source LMMs, there remains a pronounced…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Anas Awadalla , Le Xue , Oscar Lo , Manli Shu , Hannah Lee , Etash Kumar Guha , Matt Jordan , Sheng Shen , Mohamed Awadalla , Silvio Savarese , Caiming Xiong , Ran Xu , Yejin Choi , Ludwig Schmidt

Recent advancements in Large Language Models (LLMs) have revealed a significant performance gap between closed-source and open-source models, particularly in tasks requiring complex reasoning and precise instruction following. This paper…

Artificial Intelligence · Computer Science 2025-07-01 Ziqi Zhong , Xunzhu Tang

Large-scale reinforcement learning (RL) methods have proven highly effective in enhancing the reasoning abilities of large language models (LLMs), particularly for tasks with verifiable solutions such as mathematics and coding. However,…

Computation and Language · Computer Science 2025-04-15 Zhaopeng Feng , Shaosheng Cao , Jiahan Ren , Jiayuan Su , Ruizhe Chen , Yan Zhang , Zhe Xu , Yao Hu , Jian Wu , Zuozhu Liu

Chain-of-Thought (CoT) prompting enables complex reasoning in large language models (LLMs), including applications in information retrieval (IR). However, it often leads to overthinking, where models produce excessively long and…

Information Retrieval · Computer Science 2025-05-30 Dohyeon Lee , Yeonseok Jeong , Seung-won Hwang

Inspired by DeepSeek-R1's success in eliciting reasoning abilities through rule-based reinforcement learning (RL), we introduce Video-R1 as the first attempt to systematically explore the R1 paradigm for incentivizing video reasoning within…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Kaituo Feng , Kaixiong Gong , Bohao Li , Zonghao Guo , Yibing Wang , Tianshuo Peng , Junfei Wu , Xiaoying Zhang , Benyou Wang , Xiangyu Yue

Large Multimodal Models (LMMs) demonstrate significant cross-modal reasoning capabilities. However, financial applications face challenges due to the lack of high-quality multimodal reasoning datasets and the inefficiency of existing…

Computation and Language · Computer Science 2025-06-17 Kai Lan , Jiayong Zhu , Jiangtong Li , Dawei Cheng , Guang Chen , Changjun Jiang

This paper introduces STAR-1, a high-quality, just-1k-scale safety dataset specifically designed for large reasoning models (LRMs) like DeepSeek-R1. Built on three core principles -- diversity, deliberative reasoning, and rigorous filtering…

Computation and Language · Computer Science 2025-11-12 Zijun Wang , Haoqin Tu , Yuhan Wang , Juncheng Wu , Yanqing Liu , Jieru Mei , Brian R. Bartoldson , Bhavya Kailkhura , Cihang Xie

Large language models achieve breakthroughs in complex reasoning via long chain-of-thought sequences. However, this often leads to severe reasoning inflation, causing substantial computational redundancy. To maximize Intelligence per Token,…

Computation and Language · Computer Science 2026-03-19 Tingcheng Bian , Jinchang Luo , Mingquan Cheng , Jinyu Zhang , Xiaoling Xia , Ni Li , Yan Tao , Haiwei Wang

Reinforcement learning (RL) has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs). While RL has demonstrated substantial performance gains, it still faces key challenges, including low…

Machine Learning · Computer Science 2025-11-18 Yihang Yao , Guangtao Zeng , Raina Wu , Yang Zhang , Ding Zhao , Zhang-Wei Hong , Chuang Gan

The ongoing evolution of language models has led to the development of large-scale architectures that demonstrate exceptional performance across a wide range of tasks. However, these models come with significant computational and energy…

Artificial Intelligence · Computer Science 2025-11-19 Xialie Zhuang , Peixian Ma , Zhikai Jia , Zane Cao , Shiwei Liu

Large language models have demonstrated strong reasoning capabilities in complex tasks through tool integration, which is typically framed as a Markov Decision Process and optimized with trajectory-level RL algorithms such as GRPO. However,…

As multimodal reasoning improves the overall capabilities of Large Vision Language Models (LVLMs), recent studies have begun to explore safety-oriented reasoning, aiming to enhance safety awareness by analyzing potential safety risks during…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Fenghua Weng , Chaochao Lu , Xia Hu , Wenqi Shao , Wenjie Wang

Chain-of-Thought (CoT) reasoning has proven effective in enhancing large language models (LLMs) on complex tasks, spurring research into its underlying mechanisms. However, two primary challenges remain for real-world applications: (1) the…

Computation and Language · Computer Science 2025-05-20 Qiguang Chen , Libo Qin , Jinhao Liu , Yue Liao , Jiaqi Wang , Jingxuan Zhou , Wanxiang Che

We introduce Phi-4-reasoning, a 14-billion parameter reasoning model that achieves strong performance on complex reasoning tasks. Trained via supervised fine-tuning of Phi-4 on carefully curated set of "teachable" prompts-selected for the…

Large Reasoning Models (LRMs) increasingly rely on reasoning traces with complex internal structures. However, existing work lacks a unified answer to three fundamental questions: (1) what defines high-quality reasoning, (2) how to reliably…

Computation and Language · Computer Science 2026-02-10 Haoran Zhang , Yafu Li , Zhi Wang , Zhilin Wang , Shunkai Zhang , Xiaoye Qu , Yu Cheng

Text-to-Motion generation has become a fundamental task in human-machine interaction, enabling the synthesis of realistic human motions from natural language descriptions. Although recent advances in large language models and reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Runqi Ouyang , Haoyun Li , Zhenyuan Zhang , Xiaofeng Wang , Zeyu Zhang , Zheng Zhu , Guan Huang , Sirui Han , Xingang Wang
‹ Prev 1 3 4 5 6 7 10 Next ›