English
Related papers

Related papers: CCI4.0: A Bilingual Pretraining Dataset for Enhanc…

200 papers

We present Logics-STEM, a state-of-the-art reasoning model fine-tuned on Logics-STEM-SFT-Dataset, a high-quality and diverse dataset at 10M scale that represents one of the largest-scale open-source long chain-of-thought corpora.…

Citation intention Classification (CIC) tools classify citations by their intention (e.g., background, motivation) and assist readers in evaluating the contribution of scientific literature. Prior research has shown that pretrained language…

Computation and Language · Computer Science 2024-10-18 Zeren Shui , Petros Karypis , Daniel S. Karls , Mingjian Wen , Saurav Manchanda , Ellad B. Tadmor , George Karypis

Background: Motivational interviewing (MI) is an effective counseling approach for promoting health behavior change, but its impact is constrained by the need for highly trained human counselors. Objective: This study aimed to explore a…

Computation and Language · Computer Science 2025-12-18 Run-ze Hu , Yang Yang , Yi-hang Yang , Jing-qi Kong , Jia-hui Luo , Wen-yu Yang , Jing Chen , Jing-yao Liu , Hui-qun Zeng , Lei Zhang , Zheng Liu

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language processing tasks. However, Chinese LLMs face unique challenges, primarily due to the dominance of unstructured free text and the lack of…

Computation and Language · Computer Science 2025-10-08 Chengwei Wu , Jiapu Wang , Mingyang Gao , Xingrui Zhuo , Jipeng Guo , Runlin Lei , Haoran Luo , Tianyu Chen , Haoyi Zhou , Shirui Pan , Zechao Li

Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs). Yet, its potential in multimodal large language models (MLLMs) remains largely untapped, hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Lingxiao Li , Yifan Wang , Xinyan Gao , Chen Tang , Xiangyu Yue , Chenyu You

Data-centric distillation, including data augmentation, selection, and mixing, offers a promising path to creating smaller, more efficient student Large Language Models (LLMs) that retain strong reasoning abilities. However, there still…

Artificial Intelligence · Computer Science 2026-02-09 Ruichen Zhang , Rana Muhammad Shahroz Khan , Zhen Tan , Dawei Li , Song Wang , Tianlong Chen

Large language models (LLMs) have shown impressive performance on complex reasoning by leveraging chain-of-thought (CoT) prompting to generate intermediate reasoning chains as the rationale to infer the answer. However, existing CoT studies…

Computation and Language · Computer Science 2024-05-21 Zhuosheng Zhang , Aston Zhang , Mu Li , Hai Zhao , George Karypis , Alex Smola

Multimodal reasoning is a critical component in the pursuit of artificial intelligence systems that exhibit human-like intelligence, especially when tackling complex tasks. While the chain-of-thought (CoT) technique has gained considerable…

Artificial Intelligence · Computer Science 2023-09-26 Jingxuan Wei , Cheng Tan , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Recently, DeepSeek-R1 (671B) (DeepSeek-AIet al., 2025) has demonstrated its excellent reasoning ability in complex tasks and has publiclyshared its methodology. This provides potentially high-quality chain-of-thought (CoT) data for…

Artificial Intelligence · Computer Science 2025-04-17 Qianjin Yu , Keyu Wu , Zihan Chen , Chushu Zhang , Manlin Mei , Lingjun Huang , Fang Tan , Yongsheng Du , Kunlin Liu , Yurui Zhu

Large Reasoning Models (LRMs) like o1 and DeepSeek-R1 have shown remarkable progress in natural language reasoning with long chain-of-thought (CoT), yet they remain inefficient or inaccurate when handling complex mathematical operations.…

Computation and Language · Computer Science 2025-06-13 Chengpeng Li , Zhengyang Tang , Ziniu Li , Mingfeng Xue , Keqin Bao , Tian Ding , Ruoyu Sun , Benyou Wang , Xiang Wang , Junyang Lin , Dayiheng Liu

As the latest advancements in natural language processing, large language models (LLMs) have achieved human-level language understanding and generation abilities in many real-world tasks, and even have been regarded as a potential path to…

As an indispensable ingredient of intelligence, commonsense reasoning is crucial for large language models (LLMs) in real-world scenarios. In this paper, we propose CORECODE, a dataset that contains abundant commonsense knowledge manually…

Computation and Language · Computer Science 2023-12-21 Dan Shi , Chaobin You , Jiantao Huang , Taihao Li , Deyi Xiong

Building high-quality data resources is crucial for advancing artificial intelligence research and applications in specific domains, particularly in the Chinese medical domain. Existing Chinese medical datasets are limited in size and…

Computation and Language · Computer Science 2025-07-22 Yuanhe Tian , Junjie Liu , Zhizhou Kou , Yuxiang Li , Yan Song

Mathematical reasoning is an important capability of large language models~(LLMs) for real-world applications. To enhance this capability, existing work either collects large-scale math-related texts for pre-training, or relies on stronger…

Computation and Language · Computer Science 2024-05-24 Kun Zhou , Beichen Zhang , Jiapeng Wang , Zhipeng Chen , Wayne Xin Zhao , Jing Sha , Zhichao Sheng , Shijin Wang , Ji-Rong Wen

Recent advances have enabled Large Language Models (LLMs) to tackle reasoning tasks by generating chain-of-thought (CoT) rationales, yet these gains have largely applied to high-resource languages, leaving low-resource languages behind. In…

Computation and Language · Computer Science 2025-11-27 Khanh-Tung Tran , Barry O'Sullivan , Hoang D. Nguyen

A long-standing goal of AI systems is to perform complex multimodal reasoning like humans. Recently, large language models (LLMs) have made remarkable strides in such multi-step reasoning on the language modality solely by leveraging the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ge Zheng , Bin Yang , Jiajin Tang , Hong-Yu Zhou , Sibei Yang

The advancements of neural dialogue generation models show promising results on modeling short-text conversations. However, training such models usually needs a large-scale high-quality dialogue corpus, which is hard to access. In this…

Computation and Language · Computer Science 2022-04-27 Yida Wang , Pei Ke , Yinhe Zheng , Kaili Huang , Yong Jiang , Xiaoyan Zhu , Minlie Huang

Large Language Models (LLMs) trained on historical web data inevitably become outdated. We investigate evaluation strategies and update methods for LLMs as new data becomes available. We introduce a web-scale dataset for time-continual…

Solving complex chart Q&A tasks requires advanced visual reasoning abilities in multimodal large language models (MLLMs), including recognizing key information from visual inputs and conducting reasoning over it. While fine-tuning MLLMs for…

Computation and Language · Computer Science 2025-09-03 Wei He , Zhiheng Xi , Wanxu Zhao , Xiaoran Fan , Yiwen Ding , Zifei Shan , Tao Gui , Qi Zhang , Xuanjing Huang

Requiring a large language model (LLM) to generate intermediary reasoning steps, known as Chain of Thought (CoT), has been shown to be an effective way of boosting performance. Previous approaches have focused on generating multiple…

Computation and Language · Computer Science 2025-05-28 Haritz Puerto , Tilek Chubakov , Xiaodan Zhu , Harish Tayyar Madabushi , Iryna Gurevych