English
Related papers

Related papers: Datarus-R1: An Adaptive Multi-Step Reasoning LLM f…

200 papers

Large Language Models (LLMs) have shown significant promise in automated theorem proving, yet progress is often constrained by the scarcity of diverse and high-quality formal language data. To address this issue, we introduce…

Computation and Language · Computer Science 2025-12-02 Xinyuan Zhou , Yi Lei , Xiaoyu Zhou , Jingyi Sun , Yu Zhu , Zhongyi Ye , Weitai Zhang , Quan Liu , Si Wei , Cong Liu

AI-generated content has evolved from monolithic models to modular workflows, particularly on platforms like ComfyUI, enabling customization in creative pipelines. However, crafting effective workflows requires great expertise to…

Computation and Language · Computer Science 2025-06-12 Zhenran Xu , Yiyu Wang , Xue Yang , Longyue Wang , Weihua Luo , Kaifu Zhang , Baotian Hu , Min Zhang

Large Language Models (LLMs), enhanced through agent tuning, have demonstrated remarkable capabilities in Chain-of-Thought (CoT) and tool utilization, significantly surpassing the performance of standalone models. However, the multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Tianhong Gao , Yannian Fu , Weiqun Wu , Haixiao Yue , Shanshan Liu , Gang Zhang

Large reasoning models exhibit remarkable reasoning capabilities via long, elaborate reasoning trajectories. Supervised fine-tuning on such reasoning traces, also known as distillation, can be a cost-effective way to boost reasoning…

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

Reward modeling is essential for aligning large language models with human preferences through reinforcement learning. To provide accurate reward signals, a reward model (RM) should stimulate deep thinking and conduct interpretable…

Computation and Language · Computer Science 2026-03-09 Xiusi Chen , Gaotang Li , Ziqi Wang , Bowen Jin , Cheng Qian , Yu Wang , Hongru Wang , Yu Zhang , Denghui Zhang , Tong Zhang , Hanghang Tong , Heng Ji

In this work, we present JT-DA-8B (JiuTian Data Analyst 8B), a specialized large language model designed for complex table reasoning tasks across diverse real-world scenarios. To address the lack of high-quality supervision in tabular…

Artificial Intelligence · Computer Science 2025-12-09 Ce Chi , Xing Wang , Zhendong Wang , Xiaofan Liu , Ce Li , Zhiyan Song , Chen Zhao , Kexin Yang , Boshen Shi , Jingjing Yang , Chao Deng , Junlan Feng

We present that hierarchical LLM reasoning via scaling thought templates can effectively optimize the reasoning search space and outperform the mathematical reasoning capabilities of powerful LLMs like OpenAI o1-preview and DeepSeek V3. We…

Computation and Language · Computer Science 2025-03-12 Ling Yang , Zhaochen Yu , Bin Cui , Mengdi Wang

Large Language Models (LLMs) have transformed listwise document reranking by enabling global reasoning over candidate sets, yet single models often struggle to balance fine-grained relevance scoring with holistic cross-document analysis. We…

Computation and Language · Computer Science 2025-08-26 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

We introduce ThinkTwice, a simple two-phase framework that jointly optimizes LLMs to solve reasoning problems and refine the answers, based on Group Relative Policy Optimization (GRPO). In each pair of training steps, ThinkTwice first…

Artificial Intelligence · Computer Science 2026-04-08 Difan Jiao , Qianfeng Wen , Blair Yang , Zhenwei Tang , Ashton Anderson

Large Language Models (LLMs) have demonstrated powerful reasoning capabilities through Chain-of-Thought (CoT) in various tasks, yet the inefficiency of token-by-token generation hinders real-world deployment in latency-sensitive recommender…

Information Retrieval · Computer Science 2026-05-12 Yiwen Chen , Fuwei Zhang , Zehao Chen , Deqing Wang , Hehan Li , Peizhi Xu , Hanmeng Liu , Shuanglong Li , Xin Pei , Fuzhen Zhuang , Zhao Zhang

We present MiMo-7B, a large language model born for reasoning tasks, with optimization across both pre-training and post-training stages. During pre-training, we enhance the data preprocessing pipeline and employ a three-stage data mixing…

Recent advances in large language models (LLMs) have popularized test-time scaling, where models generate additional reasoning tokens before producing final answers. These approaches have demonstrated significant performance improvements on…

Artificial Intelligence · Computer Science 2026-01-13 Wenxun Wu , Yuanyang Li , Guhan Chen , Linyue Wang , Hongyang Chen

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Large language models (LLMs) inevitably make mistakes when performing step-by-step mathematical reasoning. Process Reward Models (PRMs) have emerged as a promising solution by evaluating each reasoning step. However, existing PRMs typically…

Computation and Language · Computer Science 2025-03-28 Shuaijie She , Junxiao Liu , Yifeng Liu , Jiajun Chen , Xin Huang , Shujian Huang

Large Reasoning Models (LRMs) have shown remarkable capabilities in solving complex problems through reinforcement learning (RL), particularly by generating long reasoning traces. However, these extended outputs often exhibit substantial…

Computation and Language · Computer Science 2025-05-22 Wei Liu , Ruochen Zhou , Yiyun Deng , Yuzhen Huang , Junteng Liu , Yuntian Deng , Yizhe Zhang , Junxian He

Recent advances in Large Audio-Language Models (LALMs) have made real-time, streaming spoken interaction increasingly practical. In this setting, reasoning quality and responsiveness are tightly coupled: delaying reasoning until the speech…

Computation and Language · Computer Science 2026-05-27 Zhiyuan Song , Weici Zhao , Yang Xiao , Suhao Yu , Cheng Zhu , Jiatao Gu

Large language models (LLMs) are increasingly being deployed in cost and latency-sensitive settings. While chain-of-thought improves reasoning, it can waste tokens on simple requests. We study selective thinking for tool-using LLMs and…

Large reasoning models (LRMs) achieve strong performance through extended reasoning traces, but they often exhibit overthinking behavior for low-complexity queries. Existing efforts to mitigate this issue are fundamentally limited by…

Machine Learning · Computer Science 2026-02-27 Zihang Xu , Haozhi Xie , Ziqi Miao , Wuxuan Gong , Chen Qian , Lijun Li

Despite recent breakthroughs in reasoning-enhanced large language models (LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine translation (MT), where human translators naturally employ structured, multi-layered…

Computation and Language · Computer Science 2025-05-27 Minggui He , Yilun Liu , Shimin Tao , Yuanchang Luo , Hongyong Zeng , Chang Su , Li Zhang , Hongxia Ma , Daimeng Wei , Weibin Meng , Hao Yang , Boxing Chen , Osamu Yoshie