English
Related papers

Related papers: Refining the Responses of LLMs by Themselves

200 papers

Large Language Models have demonstrated outstanding performance across various downstream tasks and have been widely applied in multiple scenarios. Human-annotated preference data is used for training to further improve LLMs' performance,…

Computation and Language · Computer Science 2025-03-06 Shimao Zhang , Xiao Liu , Xin Zhang , Junxiao Liu , Zheheng Luo , Shujian Huang , Yeyun Gong

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

Information Retrieval · Computer Science 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Various techniques have been proposed to improve large language models (LLMs) adherence to formatting and instruction constraints. One of the most effective approaches involves utilizing high-quality data generated by powerful models.…

Computation and Language · Computer Science 2025-07-09 Sihyun Park

Traditional methods for evaluating the robustness of large language models (LLMs) often rely on standardized benchmarks, which can escalate costs and limit evaluations across varied domains. This paper introduces a novel framework designed…

Computation and Language · Computer Science 2024-12-03 Aihua Pei , Zehua Yang , Shunan Zhu , Ruoxi Cheng , Ju Jia

We propose a diffusion-based framework for prompt optimization that leverages Diffusion Language Models (DLMs) to iteratively refine system prompts through masked denoising. By conditioning on interaction traces, including user queries,…

Computation and Language · Computer Science 2026-02-24 Shiyu Wang , Haolin Chen , Liangwei Yang , Jielin Qiu , Rithesh Murthy , Ming Zhu , Zixiang Chen , Silvio Savarese , Caiming Xiong , Shelby Heinecke , Huan Wang

Self-correction has emerged as a promising solution to boost the reasoning performance of large language models (LLMs), where LLMs refine their solutions using self-generated critiques that pinpoint the errors. This work explores whether…

Computation and Language · Computer Science 2024-06-07 Yunxiang Zhang , Muhammad Khalifa , Lajanugen Logeswaran , Jaekyeom Kim , Moontae Lee , Honglak Lee , Lu Wang

Integrating free-text explanations to in-context learning of large language models (LLM) is shown to elicit strong reasoning capabilities along with reasonable explanations. In this paper, we consider the problem of leveraging the…

Computation and Language · Computer Science 2022-10-14 Shiyang Li , Jianshu Chen , Yelong Shen , Zhiyu Chen , Xinlu Zhang , Zekun Li , Hong Wang , Jing Qian , Baolin Peng , Yi Mao , Wenhu Chen , Xifeng Yan

Can language models (LMs) self-refine their own responses? This question is increasingly relevant as a wide range of real-world user interactions involve refinement requests. However, prior studies have largely tested LMs' refinement…

Computation and Language · Computer Science 2025-12-01 Young-Jun Lee , Seungone Kim , Byung-Kwan Lee , Minkyeong Moon , Yechan Hwang , Jong Myoung Kim , Graham Neubig , Sean Welleck , Ho-Jin Choi

Recent advancements in large language models (LLMs) have demonstrated that progressive refinement, rather than providing a single answer, results in more accurate and thoughtful outputs. However, existing methods often rely heavily on…

Computation and Language · Computer Science 2024-10-18 Chengyu Du , Jinyi Han , Yizhou Ying , Aili Chen , Qianyu He , Haokun Zhao , Sirui Xia , Haoran Guo , Jiaqing Liang , Zulong Chen , Liangyue Li , Yanghua Xiao

Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning. Past methods for enhancing SLMs' reasoning, such as…

Computation and Language · Computer Science 2024-12-12 Kaiyuan Chen , Jin Wang , Xuejie Zhang

Recent advances have greatly increased the capabilities of large language models (LLMs), but our understanding of the models and their safety has not progressed as fast. In this paper we aim to understand LLMs deeper by studying their…

Computation and Language · Computer Science 2023-10-12 Justin Lee , Tuomas Oikarinen , Arjun Chatha , Keng-Chi Chang , Yilan Chen , Tsui-Wei Weng

Large language models (LLMs) can refine their responses based on feedback, enabling self-improvement through iterative training or test-time refinement. However, existing methods predominantly focus on refinement within the same reasoning…

Computation and Language · Computer Science 2024-12-24 Dian Yu , Yuheng Zhang , Jiahao Xu , Tian Liang , Linfeng Song , Zhaopeng Tu , Haitao Mi , Dong Yu

Large language models (LLMs) have demonstrated remarkable proficiency in machine translation (MT), even without specific training on the languages in question. However, translating rare words in low-resource or domain-specific contexts…

Computation and Language · Computer Science 2024-11-14 Shangfeng Chen , Xiayang Shi , Pu Li , Yinlin Li , Jingjing Liu

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

Language models (LMs) have recently shown remarkable performance on reasoning tasks by explicitly generating intermediate inferences, e.g., chain-of-thought prompting. However, these intermediate inference steps may be inappropriate…

Computation and Language · Computer Science 2024-02-06 Debjit Paul , Mete Ismayilzada , Maxime Peyrard , Beatriz Borges , Antoine Bosselut , Robert West , Boi Faltings

It is often desirable for Large Language Models (LLMs) to capture multiple objectives when providing a response. In document-grounded response generation, for example, agent responses are expected to be relevant to a user's query while also…

Computation and Language · Computer Science 2024-03-05 Keshav Ramji , Young-Suk Lee , Ramón Fernandez Astudillo , Md Arafat Sultan , Tahira Naseem , Asim Munawar , Radu Florian , Salim Roukos

Large language models (LLMs) are increasingly deployed as "agents" for decision-making (DM) in interactive and dynamic environments. Yet, since they were not originally designed for DM, recent studies show that LLMs can struggle even in…

Artificial Intelligence · Computer Science 2025-11-07 Chanwoo Park , Ziyang Chen , Asuman Ozdaglar , Kaiqing Zhang

Large language models (LLMs) have shown impressive capabilities across a wide range of language tasks. However, their reasoning process is primarily guided by statistical patterns in training data, which limits their ability to handle novel…

Artificial Intelligence · Computer Science 2025-08-21 Hong Su

Current large language model (LLM) applications often employ multi-component prompts, comprising both system and user prompts, to guide model behaviors. While recent advancements have demonstrated the efficacy of automatically optimizing…

Computation and Language · Computer Science 2025-07-22 Xinyu Zhang , Yuanquan Hu , Fangchao Liu , Zhicheng Dou

The alignments of reasoning abilities between smaller and larger Language Models are largely conducted via Supervised Fine-Tuning (SFT) using demonstrations generated from robust Large Language Models (LLMs). Although these approaches…

Computation and Language · Computer Science 2025-01-28 Leonardo Ranaldi , Andrè Freitas