English
Related papers

Related papers: LongCat-Flash-Prover: Advancing Native Formal Reas…

200 papers

Reinforcement learning (RL) has emerged as a dominant paradigm for eliciting long-horizon reasoning in Large Language Models (LLMs). However, scaling Tool-Integrated Reasoning (TIR) via RL remains challenging due to interaction collapse: a…

Computation and Language · Computer Science 2026-02-03 Xuqin Zhang , Quan He , Zhenrui Zheng , Zongzhang Zhang , Xu He , Dong Li

We introduce our Leanabell-Prover-V2, a 7B large language models (LLMs) that can produce formal theorem proofs in Lean 4, with verifier-integrated Long Chain-of-Thoughts (CoT). Following our previous work Leanabell-Prover-V1, we continual…

Artificial Intelligence · Computer Science 2025-07-14 Xingguang Ji , Yahui Liu , Qi Wang , Jingyuan Zhang , Yang Yue , Rui Shi , Chenxi Sun , Fuzheng Zhang , Guorui Zhou , Kun Gai

Multimodal sentiment analysis aims to integrate textual, acoustic, and visual information for deep emotional understanding. Despite the progress of multimodal large language models (MLLMs) via supervised fine-tuning, their "black-box"…

Computation and Language · Computer Science 2026-04-14 Miaosen Luo , Zhenhao Yang , Jieshen Long , Jinghu Sun , Yichu Liu , Sijie Mai

We introduce LongCat-Flash-Omni, a state-of-the-art open-source omni-modal model with 560 billion parameters, excelling at real-time audio-visual interaction. By adopting a curriculum-inspired progressive training strategy that transitions…

Multimedia · Computer Science 2025-12-01 Meituan LongCat Team , Bairui Wang , Bayan , Bin Xiao , Bo Zhang , Bolin Rong , Borun Chen , Chang Wan , Chao Zhang , Chen Huang , Chen Chen , Chen Chen , Chengxu Yang , Chengzuo Yang , Cong Han , Dandan Peng , Delian Ruan , Detai Xin , Disong Wang , Dongchao Yang , Fanfan Liu , Fengjiao Chen , Fengyu Yang , Gan Dong , Gang Huang , Gang Xu , Guanglu Wan , Guoqiang Tan , Guoqiao Yu , Haibo Qiu , Hao Lu , Hongbo Liu , Hongyu Xiang , Jiaheng Wu , Jian Yang , Jiaxing Liu , Jing Huang , Jingang Wang , Jinrui Ding , Juchao Jiang , Jun Kuang , Jun Wang , Junhui Mei , Ke Ding , Kefeng Zhang , Lei Chen , Liang Shi , Limeng Qiao , Liming Zheng , Lin Ma , Liuyang Guo , Liya Ma , Luying Sun , Man Gao , Mengshen Zhu , Miao Cao , Minliang Lin , Nuo Xu , Peng Shi , Qi Zhang , Qian Fang , Qian Wang , Qian Yang , Quanxiu Wang , Rongxiang Weng , Rongxin Guo , Ruoxuan Liang , Senbin Yang , Shanbo Xu , Shanglin Lei , Shengze Ye , Shimin Chen , Shuaiqi Chen , Shujie Hu , Shuo Li , Siqi Yang , Siyu Xu , Siyu Ren , Song Li , Songxiang Liu , Tianhao Bai , Tianye Dai , Wei Hong , Wei Wang , Weixiao Zhao , Wengang Cao , Wenlong Zhu , Wenlong He , Xi Su , Xi Nan , Xiaohan Zhao , Xiaohao Wang , Xiaoyu Zhao , Xiaoyu Wang , Xiaoyu Li , Xin Pan , Xin Chen , Xiusong Sun , Xu Xiang , Xudong Xing , Xuezhi Cao , Xunliang Cai , Yang Yang , Yanli Tan , Yao Yao , Yerui Sun , Yi Chen , Yifan Lu , Yin Gong , Yining Zhang , Yitian Chen , Yiyang Gan , Yuchen Tang , Yuchen Xie , Yueqian Wang , Yuewen Zheng , Yufei Zhang , Yufeng Zhong , Yulei Qian , Yuqi Peng , Yuqian Li , Yuwei Jiang , Zeyang Hu , Zheng Zhang , Zhengkun Tian , Zhiqing Hong , Zhixiong Zeng , Zhuqi Mi , Ziran Li , Ziwen Wang , Ziyi Zhao , Ziyuan Zhuang , Zizhe Zhao

Tool-Integrated Reasoning (TIR) has significantly enhanced the capabilities of Large Language Models (LLMs), yet current agents tend to exhibit cognitive offloading, redundantly invoking external tools even for simple tasks. In this paper,…

Computation and Language · Computer Science 2026-01-22 Zhaiyu Fang , Ruipeng Sun

With the rapid advancement of large language models (LLMs) technologies, their application in the domain of autonomous driving has become increasingly widespread. However, existing methods suffer from unstructured reasoning, poor…

Artificial Intelligence · Computer Science 2026-01-09 Chang Zhao , Zheming Yang , Yunqing Hu , Qi Guo , Zijian Wang , Pengcheng Li , Wen Ji

Large Language Models (LLMs), when enhanced through reasoning-oriented post-training, evolve into powerful Large Reasoning Models (LRMs). Tool-Integrated Reasoning (TIR) further extends their capabilities by incorporating external tools,…

Computation and Language · Computer Science 2025-07-30 Yifan Wei , Xiaoyan Yu , Yixuan Weng , Tengfei Pan , Angsheng Li , Li Du

Chain-of-Thought (CoT) reasoning significantly elevates the complex problem-solving capabilities of multimodal large language models (MLLMs). However, adapting CoT to vision typically discretizes signals to fit LLM inputs, causing early…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Tao Cheng , Shi-Zhe Chen , Hao Zhang , Yixin Qin , Jinwen Luo , Zheng Wei

Chain-of-thought (CoT) reasoning improves large language models (LLMs) on difficult tasks, but it also makes inference expensive because every intermediate step must be generated as a discrete token. Latent reasoning reduces visible token…

Computation and Language · Computer Science 2026-05-11 Xuan Li , Yining Wang , Yuchen Liu , Guanjun Liu , Delai Qiu , Shengping Liu , Jiaen Liang , Wei Huang , Jun Yu , Junnan Zhu

The research in AI-based formal mathematical reasoning has shown an unstoppable growth trend. These studies have excelled in mathematical competitions like IMO and have made significant progress. This paper focuses on formal verification,…

Artificial Intelligence · Computer Science 2025-06-10 Jialun Cao , Yaojie Lu , Meiziniu Li , Haoyang Ma , Haokun Li , Mengda He , Cheng Wen , Le Sun , Hongyu Zhang , Shengchao Qin , Shing-Chi Cheung , Cong Tian

Mathematical reasoning is a cornerstone of artificial general intelligence and a primary benchmark for evaluating the capabilities of Large Language Models (LLMs). While state-of-the-art models show promise, they often falter when faced…

Computation and Language · Computer Science 2025-07-29 Yifan Hao , Fangning Chao , Yaqian Hao , Zhaojun Cui , Huan Bai , Haiyu Zhang , Yankai Liu , Chao Deng , Junlan Feng

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

While Mixture-of-Experts (MoE) architectures have become the standard for sparsity scaling in large language models, they increasingly face diminishing returns and system-level bottlenecks. In this work, we explore embedding scaling as a…

Computation and Language · Computer Science 2026-02-12 Hong Liu , Jiaqi Zhang , Chao Wang , Xing Hu , Linkun Lyu , Jiaqi Sun , Xurui Yang , Bo Wang , Fengcun Li , Yulei Qian , Lingtong Si , Yerui Sun , Rumei Li , Peng Pei , Yuchen Xie , Xunliang Cai

Large language models (LLMs) excel in complex tasks through advanced prompting techniques like Chain-of-Thought (CoT) and Tree-of-Thought (ToT), but their reliance on manually crafted, task-specific prompts limits adaptability and…

Computation and Language · Computer Science 2025-07-04 Tao Xiong , Xavier Hu , Wenyan Fan , Shengyu Zhang

Autoformalization aims to translate natural-language mathematical statements into a formal language. While LLMs have accelerated progress in this area, existing methods still suffer from low accuracy. We identify two key abilities for…

Computation and Language · Computer Science 2025-12-29 Yutong Wu , Di Huang , Ruosi Wan , Yue Peng , Shijie Shang , Chenrui Cao , Lei Qi , Rui Zhang , Zidong Du , Jie Yan , Xing Hu

While statement autoformalization has advanced rapidly, full-theorem autoformalization remains largely unexplored. Existing iterative refinement methods in statement autoformalization typically improve isolated aspects of formalization,…

Computation and Language · Computer Science 2026-05-08 Lan Zhang , Marco Valentino , André Freitas

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models…

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

Computation and Language · Computer Science 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong

Large Language Models (LLMs) empowered with Tool-Integrated Reasoning (TIR) can iteratively plan, call external tools, and integrate returned information to solve complex, long-horizon reasoning tasks. Agentic Reinforcement Learning…

Computation and Language · Computer Science 2026-01-21 Jianghao Su , Xia Zeng , Luhui Liu , Chao Luo , Ye Chen , Zhuoran Zhuang

Vision-language models with extended reasoning succeed on complex problems, but many real-world problems require external tools that internal reasoning alone often cannot resolve. Agentic reasoning therefore interleaves two behaviors with a…

Computation and Language · Computer Science 2026-05-28 Minki Kang , Shizhe Diao , Ryo Hachiuma , Sung Ju Hwang , Pavlo Molchanov , Yu-Chiang Frank Wang , Byung-Kwan Lee