English
Related papers

Related papers: rStar2-Agent: Agentic Reasoning Technical Report

200 papers

Intelligent agents need to generalize from past experience to achieve goals in complex environments. World models facilitate such generalization and allow learning behaviors from imagined outcomes to increase sample-efficiency. While…

Machine Learning · Computer Science 2022-02-15 Danijar Hafner , Timothy Lillicrap , Mohammad Norouzi , Jimmy Ba

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

Artificial Intelligence · Computer Science 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

A key trend in Large Reasoning Models (e.g., OpenAI's o3) is the native agentic ability to use external tools such as web browsers for searching and writing/executing code for image manipulation to think with images. In the open-source…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Ziyu Liu , Yuhang Zang , Yushan Zou , Zijian Liang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Aiming at efficient and dense chain-of-thought (CoT) reasoning, latent reasoning methods fine-tune Large Language Models (LLMs) to substitute discrete language tokens with continuous latent tokens. These methods consume fewer tokens…

Artificial Intelligence · Computer Science 2026-01-30 Zhi Zheng , Wee Sun Lee

Large Language Model(LLM)-based agents have shown strong capabilities in web information seeking, with reinforcement learning (RL) becoming a key optimization paradigm. However, planning remains a bottleneck, as existing methods struggle…

Computation and Language · Computer Science 2026-01-08 Xinmiao Yu , Liwen Zhang , Xiaocheng Feng , Yong Jiang , Bing Qin , Pengjun Xie , Jingren Zhou

Agentic search has recently emerged as a powerful paradigm, where an agent interleaves multi-step reasoning with on-demand retrieval to solve complex questions. Despite its success, how to design a retriever for agentic search remains…

Information Retrieval · Computer Science 2026-01-22 Wenhan Liu , Xinyu Ma , Yutao Zhu , Yuchen Li , Daiting Shi , Dawei Yin , Zhicheng Dou

Despite recent progress in large-scale reinforcement learning (RL) for reasoning, the training recipe for building high-performing reasoning models remains elusive. Key implementation details of frontier models, such as DeepSeek-R1,…

Machine Learning · Computer Science 2025-06-06 Yang Chen , Zhuolin Yang , Zihan Liu , Chankyu Lee , Peng Xu , Mohammad Shoeybi , Bryan Catanzaro , Wei Ping

Practical guidance on training Large Language Models (LLMs) to leverage Code Interpreter across diverse tasks remains lacking. We present R1-Code-Interpreter, an extension of a text-only LLM trained via multi-turn supervised fine-tuning…

Artificial Intelligence · Computer Science 2026-03-05 Yongchao Chen , Yueying Liu , Junwei Zhou , Yilun Hao , Jingquan Wang , Yang Zhang , Na Li , Chuchu Fan

We present a controlled study of multi-hop contextual reasoning in large language models, providing a clean demonstration of the task-method dissociation: rule-based pattern matching achieves 100% success on structured information retrieval…

Artificial Intelligence · Computer Science 2026-01-09 Brady Steele , Micah Katz

The frontier of mathematics is defined by problems whose solutions are not yet known, yet it remains unclear whether language models can meaningfully engage with such problems without human intervention. A major obstacle is the lack of…

Computation and Language · Computer Science 2026-05-28 Guijin Son , Seungyeop Yi , Minju Gwak , Hyunwoo Ko , Wongi Jang , Youngjae Yu

Vision-language agents that orchestrate specialized tools for image restoration (IR) have emerged as a promising method, yet most existing frameworks operate in a training-free manner. They rely on heuristic task scheduling and exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yisheng Zhang , Guoli Jia , Haote Hu , Shanxu Zhao , Kaikai Zhao , Long Sun , Xinwei Long , Kai Tian , Che Jiang , Zhaoxiang Liu , Kai Wang , Shiguo Lian , Kaiyan Zhang , Bowen Zhou

While recent vision-language models (VLMs) demonstrate strong image understanding, their ability to "think with images", i.e., to reason through multi-step visual interactions, remains limited. We introduce VISTA-Gym, a scalable training…

Large language models (LLMs) excel at complex reasoning tasks but remain computationally expensive, limiting their practical deployment. To address this, recent works have focused on distilling reasoning capabilities into smaller language…

Computation and Language · Computer Science 2025-11-06 Minki Kang , Jongwon Jeong , Seanie Lee , Jaewoong Cho , Sung Ju Hwang

We present GLM-4.5, an open-source Mixture-of-Experts (MoE) large language model with 355B total parameters and 32B activated parameters, featuring a hybrid reasoning method that supports both thinking and direct response modes. Through…

Computation and Language · Computer Science 2025-08-11 5 Team , Aohan Zeng , Xin Lv , Qinkai Zheng , Zhenyu Hou , Bin Chen , Chengxing Xie , Cunxiang Wang , Da Yin , Hao Zeng , Jiajie Zhang , Kedong Wang , Lucen Zhong , Mingdao Liu , Rui Lu , Shulin Cao , Xiaohan Zhang , Xuancheng Huang , Yao Wei , Yean Cheng , Yifan An , Yilin Niu , Yuanhao Wen , Yushi Bai , Zhengxiao Du , Zihan Wang , Zilin Zhu , Bohan Zhang , Bosi Wen , Bowen Wu , Bowen Xu , Can Huang , Casey Zhao , Changpeng Cai , Chao Yu , Chen Li , Chendi Ge , Chenghua Huang , Chenhui Zhang , Chenxi Xu , Chenzheng Zhu , Chuang Li , Congfeng Yin , Daoyan Lin , Dayong Yang , Dazhi Jiang , Ding Ai , Erle Zhu , Fei Wang , Gengzheng Pan , Guo Wang , Hailong Sun , Haitao Li , Haiyang Li , Haiyi Hu , Hanyu Zhang , Hao Peng , Hao Tai , Haoke Zhang , Haoran Wang , Haoyu Yang , He Liu , He Zhao , Hongwei Liu , Hongxi Yan , Huan Liu , Huilong Chen , Ji Li , Jiajing Zhao , Jiamin Ren , Jian Jiao , Jiani Zhao , Jianyang Yan , Jiaqi Wang , Jiayi Gui , Jiayue Zhao , Jie Liu , Jijie Li , Jing Li , Jing Lu , Jingsen Wang , Jingwei Yuan , Jingxuan Li , Jingzhao Du , Jinhua Du , Jinxin Liu , Junkai Zhi , Junli Gao , Ke Wang , Lekang Yang , Liang Xu , Lin Fan , Lindong Wu , Lintao Ding , Lu Wang , Man Zhang , Minghao Li , Minghuan Xu , Mingming Zhao , Mingshu Zhai , Pengfan Du , Qian Dong , Shangde Lei , Shangqing Tu , Shangtong Yang , Shaoyou Lu , Shijie Li , Shuang Li , Shuang-Li , Shuxun Yang , Sibo Yi , Tianshu Yu , Wei Tian , Weihan Wang , Wenbo Yu , Weng Lam Tam , Wenjie Liang , Wentao Liu , Xiao Wang , Xiaohan Jia , Xiaotao Gu , Xiaoying Ling , Xin Wang , Xing Fan , Xingru Pan , Xinyuan Zhang , Xinze Zhang , Xiuqing Fu , Xunkai Zhang , Yabo Xu , Yandong Wu , Yida Lu , Yidong Wang , Yilin Zhou , Yiming Pan , Ying Zhang , Yingli Wang , Yingru Li , Yinpei Su , Yipeng Geng , Yitong Zhu , Yongkun Yang , Yuhang Li , Yuhao Wu , Yujiang Li , Yunan Liu , Yunqing Wang , Yuntao Li , Yuxuan Zhang , Zezhen Liu , Zhen Yang , Zhengda Zhou , Zhongpei Qiao , Zhuoer Feng , Zhuorui Liu , Zichen Zhang , Zihan Wang , Zijun Yao , Zikang Wang , Ziqiang Liu , Ziwei Chai , Zixuan Li , Zuodong Zhao , Wenguang Chen , Jidong Zhai , Bin Xu , Minlie Huang , Hongning Wang , Juanzi Li , Yuxiao Dong , Jie Tang

Large-language-model (LLM)-based AI agents have recently showcased impressive versatility by employing dynamic reasoning, an adaptive, multi-step process that coordinates with external tools. This shift from static, single-turn inference to…

Machine Learning · Computer Science 2026-01-08 Jiin Kim , Byeongjun Shin , Jinha Chung , Minsoo Rhu

Affordance prediction, which identifies interaction regions on objects based on language instructions, is critical for embodied AI. Prevailing end-to-end models couple high-level reasoning and low-level grounding into a single monolithic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Zixin Zhang , Kanghao Chen , Hanqing Wang , Hongfei Zhang , Harold Haodong Chen , Chenfei Liao , Litao Guo , Ying-Cong Chen

Training large language models (LLMs) to reason via reinforcement learning (RL) significantly improves their problem-solving capabilities. In agentic settings, existing methods like ReAct prompt LLMs to explicitly plan before every action;…

Large language model based multi-agent systems have demonstrated significant potential in social simulation and complex task resolution domains. However, current frameworks face critical challenges in system architecture design,…

Large language models (LLMs) have shown promise in medical domains, but their ability to handle specialized neurological reasoning requires systematic evaluation. We developed a comprehensive benchmark using 305 questions from Israeli Board…

Information Retrieval · Computer Science 2025-08-21 Moran Sorka , Alon Gorenshtein , Dvir Aran , Shahar Shelly

Unmanned Aerial Vehicles (UAVs) are increasingly used in defense, surveillance, and disaster response, yet most systems still operate at SAE Level 2 to 3 autonomy. Their dependence on rule-based control and narrow AI limits adaptability in…

Artificial Intelligence · Computer Science 2025-12-03 Anis Koubaa , Khaled Gabr