English
Related papers

Related papers: Beyond Output Critique: Self-Correction via Task D…

200 papers

Deploying large language models (LLMs) is challenging because they are memory inefficient and compute-intensive for practical applications. In reaction, researchers train smaller task-specific models by either finetuning with human labels…

Computation and Language · Computer Science 2023-07-06 Cheng-Yu Hsieh , Chun-Liang Li , Chih-Kuan Yeh , Hootan Nakhost , Yasuhisa Fujii , Alexander Ratner , Ranjay Krishna , Chen-Yu Lee , Tomas Pfister

Large language models (LLMs) have been able to perform various forms of reasoning tasks in a wide range of scenarios, but are they truly engaging in task abstraction and rule-based reasoning beyond mere memorization? To answer this…

Machine Learning · Computer Science 2025-12-09 Guanyu Chen , Peiyang Wang , Yizhou Jiang , Yuqian Liu , Chujie Zhao , Ying Fang , Tianren Zhang , Feng Chen

Diffusion large language models (DLLMs) have emerged as powerful generative models with the promise of fast text generation through parallel decoding. However, realizing this potential in practice remains challenging: reducing the number of…

Pre-trained language models (e.g., BERT (Devlin et al., 2018) and its variants) have achieved remarkable success in varieties of NLP tasks. However, these models usually consist of hundreds of millions of parameters which brings challenges…

Computation and Language · Computer Science 2020-04-07 Wenhui Wang , Furu Wei , Li Dong , Hangbo Bao , Nan Yang , Ming Zhou

Knowledge distillation allows smaller neural networks to emulate the performance of larger, teacher models with reduced computational demands. Traditional methods for Large Language Models (LLMs) often necessitate extensive fine-tuning,…

Computation and Language · Computer Science 2025-05-02 Tyler McDonald , Ali Emami

While Large Language Models (LLMs) have demonstrated significant promise as agents in interactive tasks, their substantial computational requirements and restricted number of calls constrain their practical utility, especially in…

Machine Learning · Computer Science 2024-05-07 Maryam Hashemzadeh , Elias Stengel-Eskin , Sarath Chandar , Marc-Alexandre Cote

Large Language Models (LLMs) continue to set new standards in knowledge-intensive and complex reasoning tasks, yet their high computational demands limit widespread adoption. While distilling large models into smaller ones offers a…

Computation and Language · Computer Science 2025-06-05 Xiaofeng Zhou , Heyan Huang , Lizi Liao

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

General-purpose Large Language Models (LLMs) are frequently fine-tuned through supervised fine-tuning (SFT) to enhance performance in specific domains. Better results can be achieved by distilling the chain-of-thought of a larger model at…

Machine Learning · Computer Science 2026-03-24 Andrey Goncharov , Daniil Vyazhev , Petr Sychev , Edvard Khalafyan , Alexey Zaytsev

We propose a self-correction mechanism for Large Language Models (LLMs) to mitigate issues such as toxicity and fact hallucination. This method involves refining model outputs through an ensemble of critics and the model's own feedback.…

Large language models (LLMs) excel in complex reasoning tasks, and distilling their reasoning capabilities into smaller models has shown promise. However, we uncover an interesting phenomenon, which we term the Small Model Learnability Gap:…

Artificial Intelligence · Computer Science 2025-11-14 Yuetai Li , Xiang Yue , Zhangchen Xu , Fengqing Jiang , Luyao Niu , Bill Yuchen Lin , Bhaskar Ramasubramanian , Radha Poovendran

Large language models (LLMs) like GPT-4, DeepSeek-R1, and ReasonFlux have shown significant improvements in various reasoning tasks. However, smaller LLMs still struggle with complex mathematical reasoning because they fail to effectively…

Computation and Language · Computer Science 2025-02-27 Ling Yang , Zhaochen Yu , Tianjun Zhang , Minkai Xu , Joseph E. Gonzalez , Bin Cui , Shuicheng Yan

Large Language Models (LLMs) have recently made significant advances in code generation through the 'Chain-of-Thought' prompting technique. This technique empowers the model to autonomously devise "solution plans" to tackle intricate…

Software Engineering · Computer Science 2024-03-21 Zhihong Sun , Chen Lyu , Bolun Li , Yao Wan , Hongyu Zhang , Ge Li , Zhi Jin

Large language models (LLMs) have garnered increasing attention owing to their powerful logical reasoning capabilities. Generally, larger LLMs (L-LLMs) that require paid interfaces exhibit significantly superior performance compared to…

Artificial Intelligence · Computer Science 2025-11-11 Dong Chen , Shilin Zhang , Fei Gao , Yueting Zhuang , Siliang Tang , Qidong Liu , Mingliang Xu

While Vision-Language Models (VLMs) have shown remarkable abilities in visual and language reasoning tasks, they invariably generate flawed responses. Self-correction that instructs models to refine their outputs presents a promising…

Computation and Language · Computer Science 2025-06-06 Jiayi He , Hehai Lin , Qingyun Wang , Yi Fung , Heng Ji

Accurate clinical diagnosis requires extensive domain knowledge and complex clinical reasoning capabilities. Although large language models (LLMs) hold great potential for clinical reasoning, their high computational and memory requirements…

Computers and Society · Computer Science 2026-05-12 Xinchun Su , Chunxu Luo , Lipeng Ma , Yixuan Li , Weidong Yang

One paradigm of language model (LM) fine-tuning relies on creating large training datasets, under the assumption that high quantity and diversity will enable models to generalize to novel tasks after post-training. In practice, gathering…

Machine Learning · Computer Science 2025-10-10 Emre Can Acikgoz , Cheng Qian , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur

Large Language Models (LLMs) are able to improve their responses when instructed to do so, a capability known as self-correction. When instructions provide only the task's goal without specific details about potential issues in the…

Computation and Language · Computer Science 2024-11-11 Guangliang Liu , Haitao Mao , Bochuan Cao , Zhiyu Xue , Xitong Zhang , Rongrong Wang , Jiliang Tang , Kristen Johnson

Large language models (LLMs) can spend extra compute during inference to generate intermediate thoughts, which helps to produce better final responses. Since Chain-of-Thought (Wei et al., 2022), many such System 2 techniques have been…

Computation and Language · Computer Science 2024-07-26 Ping Yu , Jing Xu , Jason Weston , Ilia Kulikov

The emergence of Large Language Models (LLMs) has brought to light promising language generation capabilities, particularly in performing tasks like complex reasoning and creative writing. Consequently, distillation through imitation of…

Computation and Language · Computer Science 2024-02-29 Sahithya Ravi , Patrick Huber , Akshat Shrivastava , Aditya Sagar , Ahmed Aly , Vered Shwartz , Arash Einolghozati