English
Related papers

Related papers: AdaSTaR: Adaptive Data Sampling for Training Self-…

200 papers

Reinforcement finetuning (RFT) has shown great potential for enhancing the mathematical reasoning capabilities of large language models (LLMs), but it is often sample- and compute-inefficient, requiring extensive training. In this work, we…

Machine Learning · Computer Science 2026-02-03 Taiwei Shi , Yiyang Wu , Linxin Song , Tianyi Zhou , Jieyu Zhao

Self-taught reasoners (STaRs) enhance the mathematical reasoning abilities of large language models (LLMs) by leveraging self-generated responses for self-training. Recent studies have incorporated reward models to guide response selection…

Artificial Intelligence · Computer Science 2025-09-30 Feng Xiong , Hongling Xu , Yifei Wang , Runxi Cheng , Yong Wang , Xiangxiang Chu

The reasoning abilities of large language models (LLMs) have improved with chain-of-thought (CoT) prompting, allowing models to solve complex tasks stepwise. However, training CoT capabilities requires detailed reasoning data, which is…

Artificial Intelligence · Computer Science 2025-04-11 Fu-Chieh Chang , Yu-Ting Lee , Hui-Ying Shih , Yi Hsuan Tseng , Pei-Yuan Wu

Large language models (LLMs) have achieved remarkable progress, with post-training playing a crucial role in enhancing their reasoning capabilities. Among post-training paradigms, supervised fine-tuning (SFT) is widely used: it leverages…

Computation and Language · Computer Science 2026-05-27 Lisong Sun , Li Wang , Chen Zhang , Jinyang Wu , Kui Zhang , Tianhao Peng , Wenjun Wu

Large language models (LLMs) have shown remarkable reasoning capabilities, yet aligning such abilities to small language models (SLMs) remains a challenge due to distributional mismatches and limited model capacity. Existing reasoning…

Computation and Language · Computer Science 2025-05-28 Yong Wu , Weihang Pan , Ke Li , Chen Binhui , Ping Li , Binbin Lin

Large language models (LLMs) are increasingly being deployed in cost and latency-sensitive settings. While chain-of-thought improves reasoning, it can waste tokens on simple requests. We study selective thinking for tool-using LLMs and…

Generating step-by-step "chain-of-thought" rationales improves language model performance on complex reasoning tasks like mathematics or commonsense question-answering. However, inducing language model rationale generation currently…

Machine Learning · Computer Science 2022-05-23 Eric Zelikman , Yuhuai Wu , Jesse Mu , Noah D. Goodman

Space-time adaptive processing (STAP) is one of the most effective approaches to suppressing ground clutters in airborne radar systems. It basically takes two forms, i.e., full-dimension STAP (FD-STAP) and reduced-dimension STAP (RD-STAP).…

Information Theory · Computer Science 2022-02-11 Di Song , Shengyao Chen , Feng Xi , Zhong Liu

Table reasoning with large language models (LLMs) plays a critical role in building intelligent systems capable of understanding and analyzing tabular data. Despite recent progress, existing methods still face key limitations: their…

Artificial Intelligence · Computer Science 2026-01-27 Huajian Zhang , Mingyue Cheng , Yucong Luo , Xiaoyu Tao

Common self-improvement approaches for large language models (LLMs), such as STaR, iteratively fine-tune LLMs on self-generated solutions to improve their problem-solving ability. However, these approaches discard the large amounts of…

Machine Learning · Computer Science 2024-08-15 Arian Hosseini , Xingdi Yuan , Nikolay Malkin , Aaron Courville , Alessandro Sordoni , Rishabh Agarwal

The newly released OpenAI-o1 and DeepSeek-R1 have demonstrated that test-time scaling can significantly improve model performance, especially in complex tasks such as logical reasoning. Common test-time scaling methods involve generating…

Computation and Language · Computer Science 2025-10-01 Zhendong Tan , Xingjun Zhang , Chaoyi Hu , Yancheng Pan , Shaoxun Wang

Mathematical reasoning is a primary indicator of large language models (LLMs) intelligence. However, existing LLMs exhibit failures of robustness and generalization. This paper attributes these deficiencies to spurious reasoning, i.e.,…

Artificial Intelligence · Computer Science 2025-10-14 Zhejian Lai , Xiang Geng , Zhijun Wang , Yang Bai , Jiahuan Li , Rongxiang Weng , Jingang Wang , Xuezhi Cao , Xunliang Cai , Shujian Huang

Large language models (LLMs) excel at mathematical reasoning and logical problem-solving. The current popular training paradigms primarily use supervised fine-tuning (SFT) and reinforcement learning (RL) to enhance the models' reasoning…

Machine Learning · Computer Science 2025-08-05 Jack Chen , Fazhong Liu , Naruto Liu , Yuhan Luo , Erqu Qin , Harry Zheng , Tian Dong , Haojin Zhu , Yan Meng , Xiao Wang

Large Language Models (LLMs) tend to generate a long reasoning chain when solving complex tasks. However, as the reasoning chain extends, critical intermediate steps and the original prompt will be buried in the context, receiving…

Computation and Language · Computer Science 2026-03-30 Hongxiang Zhang , Yuan Tian , Tianyi Zhang

Table serialization remains a critical bottleneck for Large Language Models (LLMs) in complex table question answering, hindered by challenges such as structural neglect, representation gaps, and reasoning opacity. Existing serialization…

Computation and Language · Computer Science 2026-05-27 Xiaoke Guo , Songze Li , Zhiqiang Liu , Zhaoyan Gong , Yuanxiang Liu , Huajun Chen , Wen Zhang

Adapting large language models (LLMs) to specialized financial reasoning typically requires expensive fine-tuning that produces model-locked expertise. Training-free alternatives have emerged, yet our experiments show that leading methods…

Computation and Language · Computer Science 2026-03-18 Tik Yu Yim , Wenting Tan , Sum Yee Chan , Tak-Wah Lam , Siu Ming Yiu

Present Large Language Models (LLM) self-training methods always under-sample on challenging queries, leading to inadequate learning on difficult problems which limits LLMs' ability. Therefore, this work proposes a difficulty-aware…

Computation and Language · Computer Science 2025-03-13 Boyang Xue , Qi Zhu , Hongru Wang , Rui Wang , Sheng Wang , Hongling Xu , Fei Mi , Yasheng Wang , Lifeng Shang , Qun Liu , Kam-Fai Wong

While fine-tuning is a de facto standard method for training deep neural networks, it still suffers from overfitting when using small target datasets. Previous methods improve fine-tuning performance by maintaining knowledge of the source…

Machine Learning · Computer Science 2024-03-18 Shin'ya Yamaguchi , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

The performance of automatic speech recognition (ASR) systems typically degrades significantly when the training and test data domains are mismatched. In this paper, we show that self-training (ST) combined with an uncertainty-based…

Computation and Language · Computer Science 2021-02-17 Sameer Khurana , Niko Moritz , Takaaki Hori , Jonathan Le Roux

The remarkable success of Large Language Models (LLMs) relies heavily on their substantial scale, which poses significant challenges during model deployment in terms of latency and memory consumption. Recently, numerous studies have…

Computation and Language · Computer Science 2024-12-19 Weiyu Huang , Yuezhou Hu , Guohao Jian , Jun Zhu , Jianfei Chen
‹ Prev 1 2 3 10 Next ›