English
Related papers

Related papers: LongCat-Flash-Prover: Advancing Native Formal Reas…

200 papers

We present Genie-CAT, a tool-augmented large-language-model (LLM) system designed to accelerate scientific hypothesis generation in protein design. Using metalloproteins (e.g., ferredoxins) as a case study, Genie-CAT integrates four…

Quantitative Methods · Quantitative Biology 2025-11-25 Bruno Jacob , Khushbu Agarwal , Marcel Baer , Peter Rice , Simone Raugei

Large language models (LLMs) tackle complex tasks by generating long chains of thought or "reasoning traces" that act as latent variables in the generation of an output given a query. A model's ability to generate such traces can be…

Computation and Language · Computer Science 2025-12-03 Alexander Gurung , Nikolay Malkin , Mirella Lapata

While current Multimodal Large Language Models (MLLMs) have demonstrated proficiency in reasoning tasks such as mathematics and logic, their capacity for long-chain reflective reasoning, a prerequisite for solving complex real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Xiangyu Zhao , Junming Lin , Tianhao Liang , Yifan Zhou , Wenhao Chai , Yuzhe Gu , Weiyun Wang , Kai Chen , Gen Luo , Wenwei Zhang , Junchi Yan , Hua Yang , Haodong Duan , Xue Yang

Effective tool use is essential for agentic AI, yet training agents to utilize tools remains challenging due to manually designed rewards, limited training data, and poor multi-tool selection, resulting in slow adaptation, wasted…

Artificial Intelligence · Computer Science 2026-01-13 Quy Minh Le , Minh Sao Khue Luu , Khanh-Tung Tran , Duc-Hai Nguyen , Hoang-Quoc-Viet Pham , Quan Le , Hoang Thanh Lam , Hoang D. Nguyen

Large Language Models (LLMs) have been successful in mathematical reasoning tasks such as formal theorem proving when integrated with interactive proof assistants like Lean. Existing approaches involve training or fine-tuning an LLM on a…

Machine Learning · Computer Science 2025-03-07 Adarsh Kumarappan , Mo Tiwari , Peiyang Song , Robert Joseph George , Chaowei Xiao , Anima Anandkumar

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

Large language models (LLMs) excel in natural language generation but often confidently produce incorrect responses, especially in tasks like mathematical reasoning. Chain-of-thought prompting, self-verification, and multi-agent debate are…

Computation and Language · Computer Science 2026-03-30 Mahmood Hegazy

Vision-Language Models (VLMs) show promise for autonomous driving, yet their struggle with hallucinations, inefficient reasoning, and limited real-world validation hinders accurate perception and robust step-by-step reasoning. To overcome…

This paper proposes a group deliberation oriented multi-agent conversational model to address the limitations of single large language models in complex reasoning tasks. The model adopts a three-level role division architecture consisting…

Artificial Intelligence · Computer Science 2026-01-01 Zheyu Shi , Dong Qiu , Shanlong Yu

We describe L-FLAT, a Logtalk Toolkit for teaching Formal Languages and Automata Theory. L-FLAT supports the definition of \textsl{alphabets}, the definition of \textsl{orders} over alphabet symbols, the partial definition of…

Programming Languages · Computer Science 2011-12-19 Paulo Moura , Artur Miguel Dias

Large Language Models (LLMs) increasingly rely on Chain-of-Thought (CoT) reasoning to improve accuracy on complex tasks. However, always generating lengthy reasoning traces is inefficient, leading to excessive token usage and higher…

Reinforcement Learning (RL) plays a crucial role in aligning large language models (LLMs) with human preferences and improving their ability to perform complex tasks. However, current approaches either require significant computational…

Machine Learning · Computer Science 2025-02-12 Kaixuan Ji , Guanlin Liu , Ning Dai , Qingping Yang , Renjie Zheng , Zheng Wu , Chen Dun , Quanquan Gu , Lin Yan

We present Ring-lite, a Mixture-of-Experts (MoE)-based large language model optimized via reinforcement learning (RL) to achieve efficient and robust reasoning capabilities. Built upon the publicly available Ling-lite model, a 16.8 billion…

As language models are increasingly deployed for complex autonomous tasks, their ability to reason accurately over longer horizons becomes critical. An essential component of this ability is planning and managing a long, complex…

The shift toward interacting with frozen, "black-box" Large Language Models (LLMs) has transformed prompt engineering from a heuristic exercise into a critical optimization challenge. We propose a Reinforcement Learning (RL) framework for…

Artificial Intelligence · Computer Science 2026-05-15 Krishna Sayana , Ketan Todi , Ambarish Jash

We present Lean Refactor, a plug-and-play retrieval-augmented agentic framework for multi-objective, controllable, and version-robust refactoring of Lean proofs. LLM-generated proofs are notoriously correct-but-verbose and brittle across…

Logic in Computer Science · Computer Science 2026-05-21 Jialin Lu , Soonho Kong , Rodrigo Stehling , Kaiyu Yang , Zhangyang Wang , Weiran Sun , Wuyang Chen

Assessing the quality of outputs generated by generative models, such as large language models and vision language models, presents notable challenges. Traditional methods for evaluation typically rely on either human assessments, which are…

Computation and Language · Computer Science 2024-10-10 Yaswanth Narsupalli , Abhranil Chandra , Sreevatsa Muppirala , Manish Gupta , Pawan Goyal

We present VAPO, Value-based Augmented Proximal Policy Optimization framework for reasoning models., a novel framework tailored for reasoning models within the value-based paradigm. Benchmarked the AIME 2024 dataset, VAPO, built on the Qwen…

Reward models are critical for aligning vision-language systems with human preferences, yet current approaches suffer from hallucination, weak visual grounding, and an inability to use tools for verification, limiting their reliability on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Shengyuan Ding , Xinyu Fang , Ziyu Liu , Yuhang Zang , Yuhang Cao , Xiangyu Zhao , Haodong Duan , Xiaoyi Dong , Jianze Liang , Bin Wang , Conghui He , Dahua Lin , Jiaqi Wang

Recent advancements, such as DeepSeek-Prover-V2-671B and Kimina-Prover-Preview-72B, demonstrate a prevailing trend in leveraging reinforcement learning (RL)-based large-scale training for automated theorem proving. Surprisingly, we discover…

Artificial Intelligence · Computer Science 2025-06-16 Chenrui Cao , Liangcheng Song , Zenan Li , Xinyi Le , Xian Zhang , Hui Xue , Fan Yang