English
Related papers

Related papers: Same Evidence, Different Answers: Canonical-Contex…

200 papers

Process Reward Models (PRMs) play a central role in evaluating and guiding multi-step reasoning in large language models (LLMs), especially for mathematical problem solving. However, we identify a pervasive length bias in existing PRMs:…

Computation and Language · Computer Science 2026-05-20 Congmin Zheng , Jiachen Zhu , Jianghao Lin , Xinyi Dai , Weiwen Liu , Haoxuan Li , Yong Yu , Weinan Zhang , Mengyue Yang

Self-distillation has emerged as an effective post-training paradigm for LLMs, often improving performance while shortening reasoning traces. However, in mathematical reasoning, we find that it can reduce response length while degrading…

Computation and Language · Computer Science 2026-05-21 Jeonghye Kim , Xufang Luo , Minbeom Kim , Sangmook Lee , Dohyung Kim , Jiwon Jeon , Dongsheng Li , Yuqing Yang

Knowledge distillation conducts an effective model compression method while holding some limitations:(1) the feature based distillation methods only focus on distilling the feature map but are lack of transferring the relation of data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Muzhou Yu , Sia Huat Tan , Kailu Wu , Runpei Dong , Linfeng Zhang , Kaisheng Ma

On-policy distillation offers dense, per-token supervision for training reasoning models; however, it remains unclear under which conditions this signal is beneficial and under which it is detrimental. Which teacher model should be used,…

Large-scale self-supervised pre-trained speech encoders outperform conventional approaches in speech recognition and translation tasks. Due to the high cost of developing these large models, building new encoders for new tasks and deploying…

Computation and Language · Computer Science 2023-12-29 Heng-Jui Chang , Ning Dong , Ruslan Mavlyutov , Sravya Popuri , Yu-An Chung

Prompt learning has emerged as a valuable technique in enhancing vision-language models (VLMs) such as CLIP for downstream tasks in specific domains. Existing work mainly focuses on designing various learning forms of prompts, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Zheng Li , Xiang Li , Xinyi Fu , Xin Zhang , Weiqiang Wang , Shuo Chen , Jian Yang

On-policy self-distillation (SD) improves LLM reasoning by using teacher-side privileged information (PI) to turn sparse verifier outcomes into dense token-level supervision. Existing methods usually assume trusted PI, such as reference…

Computation and Language · Computer Science 2026-05-28 Jiazhen Huang , Xiao Chen , Xiao Luo , Yong Dai , Senkang Hu , Yuzhi Zhao

The ability of large language models (LLMs) to execute complex instructions is essential for their real-world applications. However, several recent studies indicate that LLMs struggle with challenging instructions. In this paper, we propose…

Machine Learning · Computer Science 2024-10-11 Julian Katz-Samuels , Zheng Li , Hyokun Yun , Priyanka Nigam , Yi Xu , Vaclav Petricek , Bing Yin , Trishul Chilimbi

On-policy distillation (OPD) leverages dense teacher rewards to enhance reasoning models. However, scaling OPD to long-horizon tasks exposes a critical flaw: as the student's generated prefix inevitably diverges from the teacher's thought…

Machine Learning · Computer Science 2026-05-29 Zhicheng Yang , Zhijiang Guo , Yifan Song , Minrui Xu , Yongxin Wang , Yiwei Wang , Xiaodan Liang , Jing Tang

Language models generate functionally correct code that tends toward excessive verbosity, with elaborate documentation and defensive patterns that diverge from human baselines. Two prompting mechanisms have emerged for stylistic control:…

Software Engineering · Computer Science 2025-11-19 Jeremiah Bohr

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Chain-of-thought (CoT) prompting with large language models has proven effective in numerous natural language processing tasks, but designing prompts that generalize well to diverse problem types can be challenging, especially in the…

Computation and Language · Computer Science 2023-06-12 Zhanming Jie , Wei Lu

In-context learning (ICL) has been instrumental in adapting Large Language Models (LLMs) to downstream tasks using correct input-output examples. Recent advances have attempted to improve model performance through principles derived from…

Computation and Language · Computer Science 2026-05-26 Hao Sun , Yong Jiang , Bo Wang , Yingyan Hou , Yan Zhang , Pengjun Xie , Fei Huang

Large code models (LCMs) have remarkably advanced the field of code generation. Despite their impressive capabilities, they still face practical deployment issues, such as high inference costs, limited accessibility of proprietary LCMs, and…

Software Engineering · Computer Science 2025-05-21 Yujia Chen , Yang Ye , Zhongqi Li , Yuchi Ma , Cuiyun Gao

The ability of large language models (LLMs) to $``$learn in context$"$ based on the provided prompt has led to an explosive growth in their use, culminating in the proliferation of AI assistants such as ChatGPT, Claude, and Bard. These AI…

Computation and Language · Computer Science 2024-05-30 Namrata Shivagunde , Vladislav Lialin , Sherin Muckatira , Anna Rumshisky

On-policy distillation (OPD) has become a popular training paradigm in the LLM community. This paradigm selects a larger model as the teacher to provide dense, fine-grained signals for each sampled trajectory, in contrast to reinforcement…

Machine Learning · Computer Science 2026-04-09 Chenxu Yang , Chuanyu Qin , Qingyi Si , Minghui Chen , Naibin Gu , Dingyu Yao , Zheng Lin , Weiping Wang , Jiaqi Wang , Nan Duan

The deployment of large language models (LLMs) faces considerable challenges concerning resource constraints and inference efficiency. Recent research has increasingly focused on smaller, task-specific models enhanced by distilling…

Computation and Language · Computer Science 2024-09-20 Wei Wang , Zhaowei Li , Qi Xu , Yiqing Cai , Hang Song , Qi Qi , Ran Zhou , Zhida Huang , Tao Wang , Li Xiao

While recent work in Reinforcement Learning with Verifiable Rewards (RLVR) has shown that a small subset of critical tokens disproportionately drives reasoning gains, an analogous token-level understanding of On-Policy Distillation (OPD)…

Computation and Language · Computer Science 2026-05-12 Yuxuan Jiang , Runchao Li , Shubhashis Roy Dipta , Dawei Li , Zhao Yang

The deployment and application of Large Language Models (LLMs) is hindered by their memory inefficiency, computational demands, and the high costs of API inferences. Traditional distillation methods, which transfer the capabilities of LLMs…

Computation and Language · Computer Science 2024-11-21 Yifei Zhang , Bo Pan , Chen Ling , Yuntong Hu , Liang Zhao

Large Language Models (LLMs) have demonstrated substantial progress in biomedical and clinical applications, motivating rigorous evaluation of their ability to answer nuanced, evidence-based questions. We curate a multi-source benchmark…

Computation and Language · Computer Science 2025-09-16 Can Wang , Yiqun Chen