English
Related papers

Related papers: Nanbeige4-3B Technical Report: Exploring the Front…

200 papers

We present Nanbeige4.1-3B, a unified generalist language model that simultaneously achieves strong agentic behavior, code generation, and general reasoning with only 3B parameters. To the best of our knowledge, it is the first open-source…

Large language models (LLMs) have exhibited impressive reasoning abilities on a wide range of complex tasks. However, enhancing these capabilities through post-training remains resource intensive, particularly in terms of data and…

Artificial Intelligence · Computer Science 2025-08-13 Shuo Cai , Su Lu , Qi Zhou , Kejing Yang , Zhijie Sang , Congkai Xie , Hongxia Yang

We present MiMo-7B, a large language model born for reasoning tasks, with optimization across both pre-training and post-training stages. During pre-training, we enhance the data preprocessing pipeline and employ a three-stage data mixing…

We present EXAONE Deep series, which exhibits superior capabilities in various reasoning tasks, including math and coding benchmarks. We train our models mainly on the reasoning-specialized dataset that incorporates long streams of thought…

We introduce Phi-4-reasoning, a 14-billion parameter reasoning model that achieves strong performance on complex reasoning tasks. Trained via supervised fine-tuning of Phi-4 on carefully curated set of "teachable" prompts-selected for the…

Large foundation language models have shown their versatility in being able to be adapted to perform a wide variety of downstream tasks, such as text generation, sentiment analysis, semantic search etc. However, training such large…

Machine Learning · Computer Science 2023-04-13 Venkat Srinivasan , Darshan Gandhi , Urmish Thakker , Raghu Prabhakar

Mathematical reasoning is a cornerstone of artificial general intelligence and a primary benchmark for evaluating the capabilities of Large Language Models (LLMs). While state-of-the-art models show promise, they often falter when faced…

Computation and Language · Computer Science 2025-07-29 Yifan Hao , Fangning Chao , Yaqian Hao , Zhaojun Cui , Huan Bai , Haiyu Zhang , Yankai Liu , Chao Deng , Junlan Feng

Challenging the prevailing consensus that small models inherently lack robust reasoning, this report introduces VibeThinker-1.5B, a 1.5B-parameter dense model developed via our Spectrum-to-Signal Principle (SSP). This challenges the…

Artificial Intelligence · Computer Science 2025-11-11 Sen Xu , Yi Zhou , Wei Wang , Jixin Min , Zhibin Yin , Yingwei Dai , Shixi Liu , Lianyu Pang , Yirong Chen , Junlin Zhang

In this report, we introduce DASD-4B-Thinking, a lightweight yet highly capable, fully open-source reasoning model. It achieves SOTA performance among open-source models of comparable scale across challenging benchmarks in mathematics,…

Machine Learning · Computer Science 2026-01-15 Shaotian Yan , Kaiyuan Liu , Chen Shen , Bing Wang , Sinan Fan , Jun Zhang , Yue Wu , Zheng Wang , Jieping Ye

Adapting large language models (LLMs) to low-resource languages remains a major challenge due to data scarcity and cross-lingual drift. This work presents a two-stage adaptation of Qwen2.5-3B to Tibetan, a morphologically rich and…

Computation and Language · Computer Science 2025-12-04 Lifeng Chen , Ryan Lai , Tianming Liu

We introduce Motif-2-12.7B-Reasoning, a 12.7B parameter language model designed to bridge the gap between open-weight systems and proprietary frontier models in complex reasoning and long-context understanding. Addressing the common…

The rapid advancement of large language models has given rise to a plethora of applications across a myriad of real-world tasks, mainly centered on aligning with human intent. However, the complexities inherent in human intent necessitate a…

Computation and Language · Computer Science 2024-05-21 Xiaobo Liang , Haoke Zhang , Helan hu , Juntao Li , Jun Xu , Min Zhang

We present a novel approach for training small language models for reasoning-intensive document ranking that combines knowledge distillation with reinforcement learning optimization. While existing methods often rely on expensive human…

Information Retrieval · Computer Science 2025-07-01 Chris Samarinas , Hamed Zamani

We present Phi-4-reasoning-vision-15B, a compact open-weight multimodal reasoning model, and share the motivations, design choices, experiments, and learnings that informed its development. Our goal is to contribute practical insight to the…

Artificial Intelligence · Computer Science 2026-03-05 Jyoti Aneja , Michael Harrison , Neel Joshi , Tyler LaBonte , John Langford , Eduardo Salinas

Recent research enhances language model reasoning by scaling test-time compute via longer chain-of-thought traces. This often improves accuracy but also introduces redundancy and high computational cost, especially for small language models…

Machine Learning · Computer Science 2025-05-26 Xuechen Zhang , Zijian Huang , Chenshun Ni , Ziyang Xiong , Jiasi Chen , Samet Oymak

Proprietary AI systems have recently demonstrated impressive capabilities on complex proof-based problems, with gold-level performance reported at the 2025 International Mathematical Olympiad (IMO). However, the training pipelines behind…

Artificial Intelligence · Computer Science 2026-04-07 LM-Provers , Yuxiao Qu , Amrith Setlur , Jasper Dekoninck , Edward Beeching , Jia Li , Ian Wu , Lewis Tunstall , Aviral Kumar

This paper investigates the capacity of small language models (0.5B-5B parameters) to generate empathetic responses for individuals with PTSD. We introduce Trauma-Informed Dialogue for Empathy (TIDE), a novel dataset comprising 10,000…

Computation and Language · Computer Science 2025-09-23 Suhas BN , Yash Mahajan , Dominik Mattioli , Andrew M. Sherrill , Rosa I. Arriaga , Chris W. Wiese , Saeed Abdullah

While frontier large language models (LLMs) continue to push capability boundaries, their deployment remains confined to GPU-powered cloud infrastructure. We challenge this paradigm with SmallThinker, a family of LLMs natively designed -…

We introduce Stable Code, the first in our new-generation of code language models series, which serves as a general-purpose base code language model targeting code completion, reasoning, math, and other software engineering-based tasks.…

Emerging 6G visions, reflected in ongoing standardization efforts within 3GPP, IETF, ETSI, ITU-T, and the O-RAN Alliance, increasingly characterize networks as AI-native systems in which high-level semantic reasoning layers operate above…

Networking and Internet Architecture · Computer Science 2026-03-03 Mohamed Amine Ferrag , Abderrahmane Lakas , Merouane Debbah
‹ Prev 1 2 3 10 Next ›