English
Related papers

Related papers: Skywork Open Reasoner 1 Technical Report

200 papers

Recent large reasoning models such as DeepSeek-R1 exhibit strong complex problems solving abilities by generating long chain-of-thought (CoT) reasoning steps. It is challenging to directly train small language models (SLMs) to emerge long…

Computation and Language · Computer Science 2025-06-19 Zhaoyang Wang , Jinqi Jiang , Tian Qiu , Hui Liu , Xianfeng Tang , Huaxiu Yao

We show that reinforcement learning with verifiable reward using one training example (1-shot RLVR) is effective in incentivizing the math reasoning capabilities of large language models (LLMs). Applying RLVR to the base model…

DeepSeek-R1 has shown that long chain-of-thought (CoT) reasoning can naturally emerge through a simple reinforcement learning (RL) framework with rule-based rewards, where the training may directly start from the base models-a paradigm…

Machine Learning · Computer Science 2025-08-07 Weihao Zeng , Yuzhen Huang , Qian Liu , Wei Liu , Keqing He , Zejun Ma , Junxian He

While Large Language Models (LLMs) achieve high performance on standard mathematical benchmarks, their problem-solving abilities depend on the context and textual formatting. We introduce the Robust Reasoning Benchmark (RRB), a pipeline of…

Machine Learning · Computer Science 2026-05-22 Pavel Golikov , Evgenii Opryshko , Gennady Pekhimenko , Mark C. Jeffrey

Chain-of-Thought (CoT) reasoning successfully enhances the reasoning capabilities of Large Language Models (LLMs), yet it incurs substantial computational overhead for inference. Existing CoT compression methods often suffer from a critical…

Machine Learning · Computer Science 2026-05-26 Yuntian Tang , Bohan Jia , Wenxuan Huang , Lianyue Zhang , Jiao Xie , Wenxi Li , Wei Li , Jie Hu , Xinghao Chen Rongrong Ji , Shaohui Lin

Logical reasoning is a critical benchmark for evaluating the capabilities of large language models (LLMs), as it reflects their ability to derive valid conclusions from given premises. While the combination of test-time scaling with…

Computation and Language · Computer Science 2025-08-28 Ramya Keerthy Thatikonda , Wray Buntine , Ehsan Shareghi

We present PCL-Reasoner-V1.5, a 32-billion-parameter large language model (LLM) for mathematical reasoning. The model is built upon Qwen2.5-32B and refined via supervised fine-tuning (SFT) followed by reinforcement learning (RL). A central…

Machine Learning · Computer Science 2026-01-22 Yao Lu , Dengdong Fan , Jianzheng Nie , Fan Xu , Jie Chen , Bin Zhou , Yonghong Tian

In this paper, we ask: what truly determines the effectiveness of RL training data for enhancing language models' reasoning capabilities? While recent advances like o1, Deepseek R1, and Kimi1.5 demonstrate RL's potential, the lack of…

Machine Learning · Computer Science 2025-02-18 Xuefeng Li , Haoyang Zou , Pengfei Liu

Recently, slow-thinking reasoning systems, such as o1, have demonstrated remarkable capabilities in solving complex reasoning tasks. These systems typically engage in an extended thinking process before responding to a query, allowing them…

Future robotic systems operating in real-world environments will require on-board embodied intelligence without continuous cloud connection, balancing capabilities with constraints on computational power and memory. This work presents an…

Robotics · Computer Science 2025-09-03 Liam Boyle , Nicolas Baumann , Paviththiren Sivasothilingam , Michele Magno , Luca Benini

We introduce SafeWork-R1, a cutting-edge multimodal reasoning model that demonstrates the coevolution of capabilities and safety. It is developed by our proposed SafeLadder framework, which incorporates large-scale, progressive,…

Artificial Intelligence · Computer Science 2025-08-08 Shanghai AI Lab , : , Yicheng Bao , Guanxu Chen , Mingkang Chen , Yunhao Chen , Chiyu Chen , Lingjie Chen , Sirui Chen , Xinquan Chen , Jie Cheng , Yu Cheng , Dengke Deng , Yizhuo Ding , Dan Ding , Xiaoshan Ding , Yi Ding , Zhichen Dong , Lingxiao Du , Yuyu Fan , Xinshun Feng , Yanwei Fu , Yuxuan Gao , Ruijun Ge , Tianle Gu , Lujun Gui , Jiaxuan Guo , Qianxi He , Yuenan Hou , Xuhao Hu , Hong Huang , Kaichen Huang , Shiyang Huang , Yuxian Jiang , Shanzhe Lei , Jie Li , Lijun Li , Hao Li , Juncheng Li , Xiangtian Li , Yafu Li , Lingyu Li , Xueyan Li , Haotian Liang , Dongrui Liu , Qihua Liu , Zhixuan Liu , Bangwei Liu , Huacan Liu , Yuexiao Liu , Zongkai Liu , Chaochao Lu , Yudong Lu , Xiaoya Lu , Zhenghao Lu , Qitan Lv , Caoyuan Ma , Jiachen Ma , Xiaoya Ma , Zhongtian Ma , Lingyu Meng , Ziqi Miao , Yazhe Niu , Yuezhang Peng , Yuan Pu , Han Qi , Chen Qian , Xingge Qiao , Jingjing Qu , Jiashu Qu , Wanying Qu , Wenwen Qu , Xiaoye Qu , Qihan Ren , Qingnan Ren , Qingyu Ren , Jing Shao , Wenqi Shao , Shuai Shao , Dongxing Shi , Xin Song , Xinhao Song , Yan Teng , Xuan Tong , Yingchun Wang , Xuhong Wang , Shujie Wang , Xin Wang , Yige Wang , Yixu Wang , Yuanfu Wang , Futing Wang , Ruofan Wang , Wenjie Wang , Yajie Wang , Muhao Wei , Xiaoyu Wen , Fenghua Weng , Yuqi Wu , Yingtong Xiong , Xingcheng Xu , Chao Yang , Yue Yang , Yang Yao , Yulei Ye , Zhenyun Yin , Yi Yu , Bo Zhang , Qiaosheng Zhang , Jinxuan Zhang , Yexin Zhang , Yinqiang Zheng , Hefeng Zhou , Zhanhui Zhou , Pengyu Zhu , Qingzi Zhu , Yubo Zhu , Bowen Zhou

Large language models (LLMs) have recently shown strong reasoning abilities in domains like mathematics, coding, and scientific problem-solving, yet their potential for ranking tasks, where prime examples include retrieval, recommender…

Information Retrieval · Computer Science 2025-10-17 Tao Feng , Zhigang Hua , Zijie Lei , Yan Xie , Shuang Yang , Bo Long , Jiaxuan You

Recent advances in reasoning-enhanced Large Language Models such as OpenAI-o1/3 and DeepSeek-R1 have significantly improved performance on complex tasks. However, the quality and transparency of their internal reasoning processes remain…

Computation and Language · Computer Science 2025-06-04 Juncheng Wu , Sheng Liu , Haoqin Tu , Hang Yu , Xiaoke Huang , James Zou , Cihang Xie , Yuyin Zhou

Emerging reasoning LLMs such as OpenAI-o1 and DeepSeek-R1 have achieved strong performance on complex reasoning tasks by generating long chain-of-thought (CoT) traces. However, these long CoTs result in increased token usage, leading to…

Machine Learning · Computer Science 2025-11-18 Yuxiang Zhang , Zhengxu Yu , Weihang Pan , Zhongming Jin , Qiang Fu , Deng Cai , Binbin Lin , Jieping Ye

DeepSearch paradigms have become a core enabler for deep reasoning models, allowing them to invoke external search tools to access up-to-date, domain-specific knowledge beyond parametric boundaries, thereby enhancing the depth and factual…

Artificial Intelligence · Computer Science 2025-12-11 Hengzhi Lan , Yue Yu , Li Qian , Li Peng , Jie Wu , Wei Liu , Jian Luan , Ting Bai

The rapid development of large reasoning models (LRMs), such as OpenAI-o3 and DeepSeek-R1, has led to significant improvements in complex reasoning over non-reasoning large language models~(LLMs). However, their enhanced capabilities,…

Computers and Society · Computer Science 2025-11-18 Kaiwen Zhou , Chengzhi Liu , Xuandong Zhao , Shreedhar Jangam , Jayanth Srinivasa , Gaowen Liu , Dawn Song , Xin Eric Wang

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

The paradigm shift in large language models (LLMs) from instinctive responses to chain-of-thought (CoT) reasoning has fueled two prevailing assumptions: (1) reasoning capabilities only emerge in sufficiently large models, and (2) such…

Currently, many large language models (LLMs) are utilized for software engineering tasks such as code generation. The emergence of more advanced models known as large reasoning models (LRMs), such as OpenAI's o3, DeepSeek R1, and Qwen3.…

Software Engineering · Computer Science 2025-09-18 Kevin Halim , Sin G. Teo , Ruitao Feng , Zhenpeng Chen , Yang Gu , Chong Wang , Yang Liu

The recent DeepSeek-R1 has showcased the emergence of reasoning capabilities in LLMs through reinforcement learning (RL) with rule-based rewards. Despite its success in language models, its application in multi-modal domains, particularly…

Artificial Intelligence · Computer Science 2025-05-27 Zhengxi Lu , Yuxiang Chai , Yaxuan Guo , Xi Yin , Liang Liu , Hao Wang , Han Xiao , Shuai Ren , Guanjing Xiong , Hongsheng Li