English
Related papers

Related papers: RefineX: Learning to Refine Pre-training Data at S…

200 papers

High-quality data is crucial for the pre-training performance of large language models. Unfortunately, existing quality filtering methods rely on a known high-quality dataset as reference, which can introduce potential bias and compromise…

Computation and Language · Computer Science 2024-08-16 Ruihang Li , Yixuan Wei , Miaosen Zhang , Nenghai Yu , Han Hu , Houwen Peng

Pretrained Large Language Models (LLMs) achieve strong performance across a wide range of tasks, yet exhibit substantial variability in the various layers' training quality with respect to specific downstream applications, limiting their…

Computation and Language · Computer Science 2025-10-27 Hadi Askari , Shivanshu Gupta , Fei Wang , Anshuman Chhabra , Muhao Chen

High-quality multilingual training data is essential for effectively pretraining large language models (LLMs). Yet, the availability of suitable open-source multilingual datasets remains limited. Existing state-of-the-art datasets mostly…

Large Language Models (LLMs) are pretrained on massive datasets and later instruction-tuned via supervised fine-tuning (SFT) or reinforcement learning (RL). Best practices emphasize large, diverse pretraining data, whereas post-training…

Machine Learning · Computer Science 2026-03-03 Adel Javanmard , Baharan Mirzasoleiman , Vahab Mirrokni

Long-context language models unlock advanced capabilities in reasoning, code generation, and document summarization by leveraging dependencies across extended spans of text. However, a significant portion of readily available long-text data…

Computation and Language · Computer Science 2025-10-31 Haoran Deng , Yingyu Lin , Zhenghao Lin , Xiao Liu , Yizhou Sun , Yi-An Ma , Yeyun Gong

The current pretraining paradigm for large language models relies on massive compute and internet-scale raw text, creating a significant barrier to foundational research. In contrast, biological systems demonstrate highly sample-efficient…

Computation and Language · Computer Science 2026-05-21 Guan Wang , Changling Liu , Chenyu Wang , Cai Zhou , Yuhao Sun , Yifei Wu , Shuai Zhen , Luca Scimeca , Yasin Abbasi Yadkori

The performance of Large Language Models (LLMs) is substantially influenced by the pretraining corpus, which consists of vast quantities of unsupervised data processed by the models. Despite its critical role in model performance, ensuring…

Computation and Language · Computer Science 2024-10-11 Ranchi Zhao , Zhen Leng Thai , Yifan Zhang , Shengding Hu , Yunqi Ba , Jie Zhou , Jie Cai , Zhiyuan Liu , Maosong Sun

Large Language Models (LLMs) often generate substantively relevant content but fail to adhere to formal constraints, leading to outputs that are conceptually correct but procedurally flawed. Traditional prompt refinement approaches focus on…

Artificial Intelligence · Computer Science 2026-01-08 Alberto Purpura , Li Wang , Sahil Badyal , Eugenio Beaufrand , Adam Faulkner

Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). However, careful evaluations by human reveal that the translations produced by LLMs still contain multiple errors. Importantly, feeding back such…

Computation and Language · Computer Science 2024-06-24 Zhaopeng Feng , Yan Zhang , Hao Li , Bei Wu , Jiayu Liao , Wenqiang Liu , Jun Lang , Yang Feng , Jian Wu , Zuozhu Liu

Predicates are foundational components in data analysis systems. However, modern workloads increasingly involve unstructured documents, which demands semantic understanding, beyond traditional value-based predicates. Given enormous…

Databases · Computer Science 2026-05-22 Hengrui Zhang , Yulong Hui , Yihao Liu , Huanchen Zhang

Pre-training large language models (LLMs) necessitates enormous diverse textual corpora, making effective data selection a key challenge for balancing computational resources and model performance. Current methodologies primarily emphasize…

Computation and Language · Computer Science 2025-04-22 Xiaoxuan Zhu , Zhouhong Gu , Baiqian Wu , Suhang Zheng , Tao Wang , Tianyu Li , Hongwei Feng , Yanghua Xiao

Large Language Models (LLMs) have demonstrated exceptional performance across various tasks, with pre-training stage serving as the cornerstone of their capabilities. However, the conventional fixed-length data composition strategy for…

Computation and Language · Computer Science 2025-06-30 Qing Yang , Qiyao Peng , Hongtao Liu , Kai Liu , Bing Qin , Ting Liu

In this work, we investigate whether small language models can determine high-quality subsets of large-scale text datasets that improve the performance of larger language models. While existing work has shown that pruning based on the…

Machine Learning · Computer Science 2024-06-03 Zachary Ankner , Cody Blakeney , Kartik Sreenivasan , Max Marion , Matthew L. Leavitt , Mansheej Paul

Code reproduction is a cornerstone of scientific validity, yet it remains a formidable challenge in computer networking research due to the scarcity of open-source implementations and the complexity of heterogeneous system architectures.…

Networking and Internet Architecture · Computer Science 2026-02-17 Yining Jiang , Yunxin Xu , Wenyun Xu , Yufan Zhu , Tangtang He , Haiying Huang , Letian Zhu , Qingyu Song , Qiang Su , Lizhao You , Lu Tang , Wanjin Feng , Yuchao Zhang , Linghe Kong , Qiao Xiang , Jiwu Shu

Large language models (LLMs) have demonstrated broad utility across molecular domains, spanning drug discovery and materials design. Analyzing LLMs' latent representations is crucial for elucidating their underlying mechanisms, improving…

Machine Learning · Computer Science 2026-02-03 Zhuoran Li , Xu Sun , Wanyu Lin , Jiannong Cao

Large language models (LLMs) have exhibited impressive reasoning abilities on a wide range of complex tasks. However, enhancing these capabilities through post-training remains resource intensive, particularly in terms of data and…

Artificial Intelligence · Computer Science 2025-08-13 Shuo Cai , Su Lu , Qi Zhou , Kejing Yang , Zhijie Sang , Congkai Xie , Hongxia Yang

Since the advent of reasoning-based large language models, many have found great success from distilling reasoning capabilities into student models. Such techniques have significantly bridged the gap between reasoning and standard LLMs on…

Large language models (LLMs) deliver impressive results but face challenges from increasing model sizes and computational costs. Structured pruning reduces model size and speeds up inference but often causes uneven degradation across…

Computation and Language · Computer Science 2025-05-28 Hexuan Deng , Wenxiang Jiao , Xuebo Liu , Jing Li , Min Zhang , Zhaopeng Tu

The exponential growth of scientific literature in PDF format necessitates advanced tools for efficient and accurate document understanding, summarization, and content optimization. Traditional methods fall short in handling complex layouts…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Kun Qian , Wenjie Li , Tianyu Sun , Wenhong Wang , Wenhan Luo

Reasoning is a key component of language understanding in Large Language Models. While Chain-of-Thought prompting enhances performance via explicit intermediate steps, it suffers from sufficient token overhead and a fixed reasoning…

Computation and Language · Computer Science 2025-11-18 Xinyuan Wang , Dongjie Wang , Wangyang Ying , Haoyue Bai , Nanxu Gong , Sixun Dong , Kunpeng Liu , Yanjie Fu